NC
Data Engineer
NR Consulting - India
🇮🇳 India
On-site
1 week ago
- Azure
- Databricks
- Fabric
- AI/ML
- CI/CD
- YAML
- Azure DevOps
- Data Modeling
1 week ago
Location : Bangalore
EXP : 4+Years
Description
As a Data Engineer in MDO| you will drive critical initiatives to help our data platform scale to the needs of business priorities and technology advancements Build scalable data models and data pipelines to extract| load and transform data| ensure secure data storage| with focus on data quality and compliance on Azure using services (ADF| HDI| Databricks| Synapse and Fabric etc.) You will play a critical role in developing and building datasets and integrate with AI/ML and Co-Pilot applications Collaborate with data scientists| analysts| and other stakeholders to understand data requirements and deliver solutions Implement and manage CI/CD(YAML + Classic ) pipelines for data engineering projects| leveraging tools like Azure DevOps You will anticipate data governance needs| designing data modeling and handling procedures to ensure compliance with all applicable laws and policies. Youll also govern data accessibility within your assigned pipelines. Acts as a Designated Responsible Individual (DRI) and guides other engineers by developing and following the playbook| working on call to monitor system/product/service for degradation| downtime| or interruptions| alerting stakeholders about status and initiates actions to restore system/product/service for simple and complex problems when appropriate.
Essential Skills: Job Responsibilities: As a Data Engineer in MDO| you will drive critical initiatives to help our data platform scale to the needs of business priorities and technology advancements Build scalable data models and data pipelines to extract| load and transform data| ensure secure data storage| with focus on data quality and compliance on Azure using services (ADF| HDI| Databricks| Synapse and Fabric etc.) You will play a critical role in developing and building datasets and integrate with AI/ML and Co-Pilot applications Collaborate with data scientists| analysts| and other stakeholders to understand data requirements and deliver solutions Implement and manage CI/CD(YAML + Classic ) pipelines for data engineering projects| leveraging tools like Azure DevOps You will anticipate data governance needs| designing data modeling and handling procedures to ensure compliance with all applicable laws and policies. Youll also govern data accessibility within your assigned pipelines. Acts as a Designated Responsible Individual (DRI) and guides other engineers by developing and following the playbook| working on call to monitor system/product/service for degradation| downtime| or interruptions| alerting stakeholders about status and initiates actions to restore system/product/service for simple and complex problems when appropriate.
Data Engineer · NR Consulting - India