DL
Azure data Engineer (Pyspark, Databricks, Delta lake)
Diverse Lynx India
- ๐ฎ๐ณ India
- Hybrid
- 16 hours ago
- Azure Databricks
- PySpark
- Scala
- SQL
- Delta Lake
- Azure Data Factory
- Azure SQL
- Power BI
- CI/CD
- Azure DevOps
- GitLab
- Git
- Unity Catalog
- Azure
- ETL
- ELT
- Databricks
16 hours ago
Key Skills: Azure Databricks, PySpark/Scala, Spark SQL, Delta Lake
Azure Data Factory (ADF), ADLS Gen2
Azure SQL/Synapse, Event Hubs/Kafka
Power BI, SQL Optimization
CI/CD (Azure DevOps/GitLab), Git
Unity Catalog, Data Governance & Security
Responsibilities: Design, build, and optimize scalable batch and real-time data pipelines on Azure.
Develop ETL/ELT workflows using Databricks and Azure Data Factory.
Implement Lakehouse architectures using Delta Lake and Medallion (Bronze-Silver-Gold) layers.
Integrate data from multiple enterprise and external sources.
Ensure data quality, performance, security, and governance standards.
Collaborate with business and technical stakeholders to deliver analytics solutions and dashboards.
Azure data Engineer (Pyspark, Databricks, Delta lake) ยท Diverse Lynx India