DL
Senior Data Engineer
Diverse Lynx India
Location not stated
Senior
4 months ago
- Azure Data Factory
- Azure Databricks
- Apache Spark
- SQL
- PySpark
- Azure Cloud
- ETL
- ELT
- Git
- CI/CD
- Delta Lake
- Unity Catalog
- Azure Synapse
- Microsoft Fabric
- Agile
- Scrum
4 months ago
Mandatory Skills
- Strong experience in:
- Azure Data Factory (ADF)
- Azure Databricks
- Apache Spark
- Lakeflow Declarative Pipelines
- SQL
- PySpark
- Hands-on experience with Azure cloud platform and data services.
- Strong understanding of ETL/ELT concepts and data warehousing principles.
- Experience working with large-scale distributed data processing systems.
- Proficiency in performance tuning and optimization techniques.
- Good understanding of data lake and lakehouse architectures.
- Experience with Git and CI/CD implementation.
- Experience with Delta Lake and Unity Catalog.
- Knowledge of streaming frameworks and real-time processing.
- Exposure to Azure Synapse Analytics or Microsoft Fabric.
- Experience working in Agile/Scrum environments.
Senior Data Engineer · Diverse Lynx India