Azure Data Engineer
- Azure
- ETL
- ELT
- Azure Data Factory
- REST API
- Excel
- Azure Synapse
- Azure Databricks
- Apache Spark
- Snowflake
- Azure DevOps
- CI/CD
- Azure Functions
- Logic Apps
- Microsoft Fabric
- Data Architecture
We are seeking a highly skilled and passionateLead Data Engineer to join our growing Data & Analytics team. In this role, you will be responsible for designing, developing, and managing end-to-end data solutions on the Microsoft Azure platform. You will play a critical role in enabling reliable data ingestion, transformation, storage, and analytics capabilities that support business operations, reporting, and strategic decision-making.
The ideal candidate will have strong experience in Azure Data Engineering technologies, data warehousing, ETL/ELT development, and cloud-native data architectures, with the ability to translate business requirements into scalable and efficient data solutions.
Key Responsibilities
- Design and develop end-to-end data pipelines usingAzure Data Factory (ADF).
- Ingest data fromREST APIs, SharePoint, Excel, and ADLS Gen2.
- Build scalableETL/ELT solutions usingADF Mapping Data Flows and metadata-driven frameworks.
- Develop and optimize data models, data warehouses, and analytics solutions usingAzure Synapse Analytics.
- LeverageAzure Databricks andApache Spark for large-scale data processing.
- Implement data quality, validation, and monitoring processes to ensure reliable datasets.
- Collaborate with business and technical teams to deliver robust data solutions.
- Monitor, troubleshoot, and enhance production data pipelines.
Required Skills
- 8+ Years of Strong hands-on experience withAzure Data Factory (ADF), including pipeline orchestration and Mapping Data Flows.
- Experience withAzure Synapse Analytics,ADLS Gen2, andAzure Databricks.
- Expertise inREST API integrations, authentication, pagination, and error handling.
- Strong knowledge ofETL/ELT, data pipeline design, incremental loading, and data validation.
- Experience inData Warehousing,Dimensional Modeling, Star Schema, and Snowflake Schema.
- Good understanding of metadata-driven architecture and scalable cloud data platforms.
Preferred Skills
- Experience withAzure DevOps (CI/CD pipelines).
- Hands-on exposure toAzure Functions andAzure Logic Apps.
- Knowledge ofMicrosoft Fabric and modern data architecture patterns.
- Azure certifications such asDP-203 are a plus.
Azure Data Engineer · UST