Specialist - Data Engineering
- Azure Databricks
- Azure Data Factory
- PySpark
- SQL
- Python
- Delta Lake
- Databricks
- CI/CD
- Azure DevOps
- Azure Synapse
- Azure SQL
- Apache Spark
- T-SQL
- Data Modeling
- Git
- Unity Catalog
- Apache Airflow
- Power BI
- Azure
- Key Vault
- MLflow
- Ansible
- Azure Cloud
- Agile
Role Summary
Location-
Seeking an experiencedAzure Databricks Engineer to design develop optimize and support scalable cloudbased data platforms using Azure Data Services The candidate will be responsible for building highperformance data pipelines implementing data engineering best practices and driving data modernization initiatives
Key Responsibilities-
Design and implement scalable ETLELTpipelines usingAzure Databricks and Azure Data Factory
Develop data processing solutions usingPySpark Spark SQL and Python
Build and maintain Delta Lake architectures and Databricks workflows
Optimize performance of Spark jobs clusters and notebooks
Implement CICD pipelines using Azure DevOps for Databricks artifacts
Work with ADLS Gen2 Azure Synapse and Azure SQL for enterprise data solutions
Ensure data quality governance security and compliance standards
Monitor troubleshoot and support production data pipelines
Collaborate with architects business stakeholders and crossfunctional teams
Mentor junior engineers and participate in code reviews
Mandatory Skills-
Azure Databricks
PySpark Apache Spark
Azure Data Factory ADF
Azure Data Lake Storage ADLS Gen2
SQL TSQL
Python
Delta Lake
Databricks Workflows
Azure DevOps CICD
Data Modeling
Git Version Control
GoodtoHave Skills
Delta Live Tables DLT
Auto Loader
Unity Catalog
Azure Synapse Analytics
Apache Airflow
Power BI
Azure Key Vault
MLflow
Ansible
Data Governance Security Frameworks
Experience
7 to 11 years of overall ITData Engineering experience
3 years of handson Azure Databricks implementation experience
Experience building enterprisescale data platforms on Azure Cloud
Preferred Certifications-
Microsoft Certified Azure Data Engineer Associate DP203
Databricks Certified Data Engineer AssociateProfessional
Azure Fundamentals AZ900
Key Competencies
Strong analytical and problemsolving skills
Stakeholder management
Technical leadership and mentoring
Agile delivery experience
Excellent communication and collaboration skills
Specialist - Data Engineering · LTM