PG
Data Engineer
Perfict Global, Inc.
Location not stated
Mid level
3 months ago
- Azure
- Microsoft Fabric
- Azure Data Factory
- Python
- SQL
- ETL
- ELT
- CI/CD
- Azure Synapse
- Delta Lake
- RBAC
- Key Vault
- Azure DevOps
- GitHub
- AI
- Agile
- Azure Databricks
- Azure SQL
- Power BI
- Git
- Identity Management
- Fabric
3 months ago
Location: Woburn, MA (Onsite)
Duration: Long-Term Contract
Job Summary
We are seeking an experiencedData Engineer with strong expertise in theMicrosoft Azure ecosystem to design, build, and maintain scalable, secure, and high-performance data platforms. The ideal candidate will have hands-on experience withMicrosoft Fabric, Azure Data Factory, Synapse, Python, SQL, and Spark, along with a solid understanding of modern data architectures, ETL/ELT pipelines, and CI/CD practices.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines usingMicrosoft Fabric, Azure Data Factory, and Azure Synapse.
- Build and optimize data pipelines and database solutions for structured and unstructured data.
- Develop data workflows usingPython, SQL, and Spark.
- Design modern data architectures, includingLakehouse andMedallion models.
- Integrate data from APIs, third-party applications, and hybrid (on-premises/cloud) environments.
- Optimize data storage and query performance using Delta Lake, partitioning, and columnstore technologies.
- Implement secure data solutions usingRBAC, Azure Key Vault, Managed Identities, and Private Endpoints.
- Develop and maintain CI/CD pipelines usingAzure DevOps orGitHub.
- Ensure data quality, reliability, monitoring, and automated alerting across data platforms.
- Support analytics and AI teams by delivering clean, governed, and production-ready datasets.
- Collaborate with architects, developers, analysts, and business stakeholders to deliver scalable data solutions.
- Mentor junior engineers and contribute to engineering best practices.
- Participate in Agile development processes.
- 8+ years of experience in Data Engineering, Software Engineering, or Platform Engineering.
- 5+ years of experience building enterprise data solutions on theMicrosoft Azure platform.
- Strong hands-on experience withMicrosoft Fabric.
- Experience with at least two of the following:
- Azure Data Factory
- Azure Synapse Analytics
- Azure Databricks
- Azure SQL
- Power BI
- Strong proficiency inPython, SQL, and Spark.
- Experience with modern data architectures such asLakehouse andMedallion.
- Experience with ETL/ELT development and performance tuning.
- Hands-on experience withCI/CD, Git, and Azure DevOps.
- Strong knowledge of enterprise security, access control, and identity management.
- Excellent troubleshooting, performance optimization, and problem-solving skills.
- Experience working in enterprise or regulated environments.
- Microsoft certifications:
- DP-700 – Fabric Data Engineer (or willingness to obtain within six months)
- DP-600
- DP-203
Data Engineer · Perfict Global, Inc.