DS
Senior Azure Data Engineer
Damco Solutions Inc
π¨π¦ Canada | πΊπΈ United States
On-site
Senior
7 months ago
- Azure
- Databricks
- Microsoft Fabric
- Snowflake
- AI/ML
- ETL
- ELT
- Azure Data Factory
- Azure Functions
- Logic Apps
- Power BI
- CI/CD
- Git
- Devops
- AI
- Machine Learning
- Azure ML
- Apache Spark
- PySpark
- Delta Lake
- SQL
- Python
- Scala
- Java
- scikit-learn
- TensorFlow
- PyTorch
- Azure Cloud
7 months ago
Location: Hamilton, NJ (Hybrid β 4 days onsite)
Employment Type: Contract
Experience Level: 10+ years of experience
Job Overview
We are seeking a highly skilled Senior Azure Data Engineer to design, build, and optimize modern data platforms in an enterprise Azure environment. The ideal candidate will have strong hands-on experience with Databricks or Microsoft Fabric (preferred), with Snowflake exposure as a plus.This role focuses on developing scalable, secure, and high-performance data solutions that support analytics, reporting, and AI/ML-enabled workloads. The position offers the opportunity to work at the intersection of data engineering, analytics, and applied AI while collaborating with cross-functional business and technical teams.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines and data models using Microsoft Fabric, Databricks, or Snowflake
- Architect and optimize lakehouse and data warehouse solutions for analytics and enterprise reporting
- Implement data governance best practices, including data quality, metadata management, lineage, and access controls
- Integrate Azure services such as Azure Data Factory (ADF), Synapse Analytics, Azure Functions, and Logic Apps
- Enable seamless Power BI integration, including semantic models and enterprise dashboards
- Build and maintain CI/CD pipelines and manage source control using Git-based DevOps workflows
- Collaborate with analytics, business, and AI teams to deliver data-driven solutions
- Monitor, troubleshoot, and optimize data pipelines for performance, reliability, and scalability
- Support and implement machine learning workflows using Azure ML, Databricks ML, or open-source frameworks
- Stay current with emerging technologies in data engineering, analytics, and AI
Required Qualifications
- Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field
- 10 years of hands-on experience in data engineering, analytics, or data platform development
- Strong experience with at least one of the following platforms:
- Databricks (Apache Spark, PySpark, Delta Lake, notebooks) β preferred
- Microsoft Fabric (Lakehouse, Warehouse, Spark, Data Engineering pipelines, Power BI integration) β preferred
- Snowflake
- Advanced proficiency in SQL and Python (Scala or Java is a plus)
- Strong understanding of Apache Spark and distributed data processing concepts
- Experience with Azure Data Factory, Synapse Analytics, and related Azure services
- Exposure to machine learning frameworks such as scikit-learn, TensorFlow, or PyTorch
- Experience with Azure ML, Databricks ML, or similar ML platforms
- Solid knowledge of Azure cloud services, DevOps practices, and CI/CD pipelines
Technical Skills
- Advanced SQL and Python
- Apache Spark (PySpark) and Delta Lake
- Microsoft Fabric / Databricks / Snowflake
- Azure Data Factory (ADF), Synapse Analytics, Logic Apps
- Power BI, semantic models, and enterprise reporting
- CI/CD pipelines, Git, and DevOps workflows
- Applied ML and AI exposure using Azure or open-source tools
Soft Skills
- Strong communication and stakeholder collaboration skills
- Analytical mindset with excellent problem-solving abilities
- Ability to work cross-functionally in fast-paced environments
- High level of ownership, accountability, and adaptability to new technologies
Senior Azure Data Engineer Β· Damco Solutions Inc