MS Fabric and ADF

Key Responsibilities for MS fabric :

• Design, build, and maintainend-to-end data pipelines and reporting solutions usingMicrosoft Fabric components includingLakehouse, Warehouse, and Notebooks.
• Develop scalable data ingestion, transformation, and migration pipelines usingPySpark, Spark SQL, and Fabric Data Engineering workloads.
• Migrate and integrate data fromlegacy systems and on‐premise SQL Server intoFabric OneLake ensuring data accuracy and consistency.
• Build and optimizeFabric Dataflows Gen2 andPipelines for batch and scheduled data processing.
• Develop and enhancePower BI semantic models, datasets, and dashboards for actionable insights across enterprise domains.
• Perform advancedSQL and PySpark transformations for data cleansing, deduplication, enrichment, and normalization.
• Manageschema evolution, missing data logic, and data type standardization across Lakehouse and Warehouse layers.
• Implementdata validation, reconciliation, and quality checks to ensure high data reliability and stakeholder trust.
• Support continuous data onboarding and migration cycles, troubleshooting data quality, audit, and refresh issues.
• Operationalize pipelines fordaily and weekly refresh cycles, monitor execution, and ensure SLA adherence.