DL
Azure Databrics+ Pyspark
Diverse Lynx India
๐ฎ๐ณ India
On-site
Mid level
2 months ago
- PySpark
- Azure Databricks
- ETL
- Azure Cloud
- ELT
- Azure Data Factory
- SQL
- Delta Lake
- Git
- CI/CD
2 months ago
Job Title: Data Engineer โ PySpark & Azure Databricks
Experience: 5+ Years
Location: Gurugram
Job Summary
We are seeking an experienced Data Engineer with 5+ years of expertise inPySpark andAzure Databricks to build, optimize, and maintain scalable data pipelines and ETL solutions on the Azure cloud platform.
Key Responsibilities
- Develop and optimize ETL/ELT pipelines using PySpark and Azure Databricks.
- Build scalable data solutions using Azure Data Factory and ADLS.
- Write efficient SQL queries and optimize Spark jobs for performance.
- Collaborate with cross-functional teams to deliver reliable data solutions.
- Ensure data quality, security, and best practices.
Required Skills
- 5+ years of Data Engineering experience.
- Strong hands-on experience withPySpark,Azure Databricks,SQL,Azure Data Factory (ADF), andADLS.
- Good understanding of Delta Lake, Spark optimization, and Azure data ecosystem.
- Experience with Git and CI/CD is a plus.
Azure Databrics+ Pyspark ยท Diverse Lynx India