DL
Azure Data Engineer
Diverse Lynx India
Location not stated
Hybrid
2 months ago
- Azure Databricks
- PySpark
- SQL
- Python
- Machine Learning
- Azure Data Factory
- ETL
- GitHub
- Azure DevOps
- CI/CD
- Agile
- Delta Lake
- Terraform
- IaC
- Snowflake
- Power BI
2 months ago
5-7+ years of experience in data engineering, working with Azure Databricks, PySpark, and SQL.
• Proficiency in Python for data processing and transformation.
• Expertise in machine learning for processing large data set.
• Strong expertise in Azure Data Factory (ADF) for building and managing ETL processes.
• Familiarity with GitHub and Azure DevOps for version control and CI/CD automation.
• Solid understanding of data modelling, warehousing, and performance optimization.
• Ability to work in an agile environment and manage multiple priorities effectively.
• Excellent problem-solving skills and attention to detail.
• Experience with Delta Lake and Lakehouse architecture.
• Hands-on experience with Terraform or Infrastructure as Code (IaC).
• Understanding of machine learning workflows in a data engineering context.
• In-depth knowledge of fundamental data warehousing concepts such as entity relational modelling, dimensional modelling, star and snowflake schemas, Data marts.
• Experience in handling technical issues in Data models, Data engineering logic document and Power BI reports.
Azure Data Engineer · Diverse Lynx India