Senior Specialist - Data Engineering

Job Summary

Seeking a Senior Specialist with 7 to 11 years of experience in Azure Cloud Architecture and Azure Databricks to design and lead scalable data solutions within the Azure ecosystem

Job Description

Design develop and optimize endtoend data pipelines using Azure Databricks to support complex data processing and analytics scenarios Architect secure scalable and highperformance data storage and processing solutions leveraging Azure Cloud services Collaborate with crossfunctional teams to align data solutions with business objectives and technical requirements Implement best practices for data governance security and compliance within Azure environments Ensure high availability performance and reliability of data platforms through continuous monitoring and tuning Stay updated on emerging Azure data technologies and tools to drive innovation and enhance platform capabilities Utilize expertise in Azure Cloud Architecture to provision and manage Azure resources effectively

Roles and Responsibilities

Lead the design and implementation of Azurebased data integration and processing platforms with a focus on Azure Databricks

Mentor and guide data engineers and architects on best practices and technical solutions within Azure Databricks and Azure Cloud

Collaborate with stakeholders to gather requirements and translate them into scalable technical architectures

Oversee data migration transformation and integration activities ensuring seamless data flow

Establish and enforce data architecture standards policies and procedures to maintain data quality and security

Conduct performance tuning troubleshooting and optimization of data pipelines

Manage Azure resource provisioning and configuration aligned with security and compliance standards

Drive adoption of DevOps practices including CICD pipelines and Azure DevOps for efficient code management

Serve as a technical advisor during project execution and provide strategic direction for data platform evolution