Lead Data Engineer

NR Consulting - India

🇮🇳 India

On-site

Staff / Principal

2 weeks ago

Apache Spark
Scala
Apache Kafka
Databricks
GCP
Delta Lake

2 weeks ago

Auto apply with Likeremote

Not scoredNo CV on file. Upload one and this job gets a score out of 100.Upload CV

Title: Lead Data Engineer
Location: Pan India
Exp: 8+ Years

Job Description:
Required Skills & Experience-
Spark Structured Streaming, Apache Spark, Scala, Apache Kafka, Databricks, Any cloud, preferably GCP.
In depth coding knowledge in Spark Structured Streaming.
Spark Internals - Spark execution concepts in depth, including query planning, DAG generation, shuffle operations, partitioning strategies, and memory management.
Understanding of Spark optimization techniques such as broadcast joins, caching/persistence strategies, partition pruning, adaptive query execution, and skew handling.
Databricks Platform Knowledge - cluster sizing strategies, job optimization, Delta Lake internals, workflow orchestration, and performance tuning.

Lead Data Engineer · NR Consulting - India

Auto apply with Likeremote