DL
Azure Data Engineer
Diverse Lynx India
Location not stated
Manager or above
4 months ago
- Azure
- Azure Data Factory
- Azure Databricks
- SQL
- ETL
- ELT
- Apache Spark
- Azure Cloud
- PySpark
- Delta Lake
4 months ago
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines usingAzure Data Factory (ADF) andAzure Databricks.
- Build and optimize data transformation workflows usingSpark and SQL-based processing.
- Implement and manageLakeflow Declarative Pipelines for modern data engineering workflows.
- Ingest data from multiple structured and unstructured data sources into Azure data platforms.
- Write and optimize SQL queries, views, and transformation logic for analytics and reporting.
- Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
- Collaborate with data analysts, architects, and business stakeholders to understand data requirements.
- Ensure data quality, governance, and security standards are maintained.
- Support deployment, documentation, and maintenance activities.
- Strong hands-on experience withAzure Data Factory (ADF).
- Experience withAzure Databricks andApache Spark.
- Strong proficiency inSQL.
- Experience withLakeflow Declarative Pipelines.
- Good understanding of ETL/ELT concepts and data warehousing.
- Experience working with Azure cloud data services and data lake architectures.
- Basic knowledge ofPySpark is preferred.
- Familiarity with performance tuning and pipeline optimization.
- Bachelor's degree in Computer Science, Information Technology, or related field.
- Azure Data Engineering certifications are a plus.
- Experience with Delta Lake or Lakehouse architecture is an added advantage.
- Good communication and problem-solving skills
Azure Data Engineer · Diverse Lynx India