Description:
Key Responsibilities for MS fabric :
- Design, build, and maintain end-to-end data pipelines and reporting solutions using Microsoft Fabric components including Lakehouse, Warehouse, and Notebooks.
- Develop scalable data ingestion, transformation, and migration pipelines using PySpark, Spark SQL, and Fabric Data Engineering workloads.
- Migrate and integrate data from legacy systems and on‐premise SQL Server into Fabric OneLake ensuring data accuracy and consistency.
- Build and optimize Fabric Dataflows Gen2 and Pipelines for batch and scheduled data processing.
- Develop and enhance Power BI semantic models, datasets, and dashboards for actionable insights across enterprise domains.
- Perform advanced SQL and PySpark transformations for data cleansing, deduplication, enrichment, and normalization.
- Manage schema evolution, missing data logic, and data type standardization across Lakehouse and Warehouse layers.
- Implement data validation, reconciliation, and quality checks to ensure high data reliability and stakeholder trust.
- Support continuous data onboarding and migration cycles, troubleshooting data quality, audit, and refresh issues.
- Operationalize pipelines for daily and weekly refresh cycles, monitor execution, and ensure SLA adherence.
|
| Mandatory skills* |
MS fabric, ADF, PySpark, Spark SQL |
|
