Specialist - Data Engineering

Job Summary

Seeking an experienced Azure Specialist with expertise in Azure Data Lake Azure Data Factory and Azure Synapse Analytics to design and implement scalable data solutions

Job Description

Design and develop scalable data integration and orchestration pipelines using Azure Data Factory Build batch and incremental data ingestion frameworks from diverse source systems to cloud data platforms Develop and optimize ETLELT workflows ensuring high performance reliability and scalability Implement parameterized and metadatadriven pipelines triggers and monitoring solutions Collaborate with business and technical teams to translate data requirements into robust cloud solutions Perform data validation reconciliation and troubleshoot production data issues Support CICD implementation and deployment of Azure Data Factory artifacts across multiple environments Create and maintain technical documentation data flow diagrams and operational runbooks Adhere to data governance security standards and best practices Leverage knowledge of Azure Synapse Analytics for cloudbased data warehousing and analytics Utilize Azure Data Lake Storage Gen2 for efficient data storage and management

Roles and Responsibilities

Lead the design development and maintenance of Azurebased data solutions within the Azure Databricks skill cluster family

Ensure seamless integration of data pipelines with Azure Data Lake Azure Data Factory and Azure Synapse Analytics

Optimize data workflows and pipelines for performance tuning debugging and monitoring

Implement incremental load strategies and change data capture CDC methodologies

Collaborate with crossfunctional teams to ensure alignment of data solutions with business objectives

Drive automation and CICD processes using Gitbased version control and Azure DevOps

Mentor junior team members and contribute to continuous improvement initiatives

Maintain strong documentation and knowledge sharing to support operational excellence

Stay updated with emerging Azure technologies and best practices to enhance solution delivery