DL
Databricks Data Engineer
Diverse Lynx India
๐ฎ๐ณ India
On-site
2 months ago
- Databricks
- Delta Lake
- ETL
- ELT
- PySpark
- SQL
2 months ago
Role Summary
We are seeking a Databricks Data Engineer with 5+ years of experience building modern data platforms using Databricks Lakehouse architecture. The candidate should have strong expertise in Spark, Delta Lake, and large-scale cloud-native data engineering.
Key Responsibilities
- Design and develop scalable ETL/ELT pipelines using Databricks.
- Build and optimize data processing frameworks using PySpark and Spark SQL.
- Implement modern Lakehouse architectures using Delta Lake.
- Develop and maintain bronze, silver, and gold layer data models.
- Optimize cluster utilization and processing performance.
- Build reusable frameworks and accelerate data ingestion capabilities.
- Support real-time and batch data processing requirements.
- Collaborate with data analysts, architects, and business users.
Databricks Data Engineer ยท Diverse Lynx India