VI
Azure Data Engineer
VARITE INDIA PRIVATE LIMITED
- 🇮🇳 India
- On-site
- 10 months ago
- ETL
- ELT
- Azure Data Factory
- Azure Synapse
- Databricks
- Data Modeling
- Delta Lake
- RBAC
- GDPR
- Azure
- PySpark
- SQL
- CI/CD
- Azure DevOps
10 months ago
About The Client:
Client is a pioneering Software Engineering and IT consultancy company, transforming and executing at the intersection of Domain and Technology to create digital leaders for our people, clients, partners, and communities.
Essential Job Functions:
Data Pipeline Development & Optimization
- Design and implement scalable ETL/ELT pipelines using Azure Data Factory, Azure Synapse, and
- Databricks.
- Optimize data workflows for performance and cost efficiency.
- Integrate data from multiple sources (on-premises, cloud, APIs) into Azure data platforms.
- Develop and maintain notebooks in Databricks for data transformation and analytics.
- Implement Spark-based solutions for large-scale data processing.
- Optimize cluster configurations and job performance in Databricks.
- Design and implement data models for structured and semi-structured data.
- Work with Azure Data Lake, Delta Lake, and Synapse for storage and analytics.
- Ensure proper partitioning, indexing, and schema evolution for performance.
- Implement data security best practices including RBAC, encryption, and masking.
- Ensure compliance with organizational and regulatory standards (GDPR, ISO, etc.).
- Manage access controls and monitor data usage across Azure resources.
- Monitor data pipelines and jobs for failures and performance bottlenecks.
- Implement logging, alerting, and automated recovery mechanisms.
- Continuously improve data engineering processes through automation and optimization.
- Work closely with Data Scientists, BI teams, and business stakeholders to deliver data solutions.- Provide technical guidance on best practices for Azure and Databricks.
- Participate in architecture reviews and contribute to solution design.
Qualifications :
- Exp: 2-5 Yrs
- Hands-on experience with Azure Data Factory, Azure Synapse, Azure Data Lake, and Databricks.
- Strong knowledge of PySpark, SQL, and data transformation techniques.
- Familiarity with Delta Lake and Lakehouse architecture.
- Experience with CI/CD for data pipelines using Azure DevOps or similar tools.
- Understanding of data governance, security, and compliance in cloud environments.
Preferred Certifications:
- Microsoft Certified: Azure Data Engineer Associate
- Databricks Certified Data Engineer
- Azure Solutions Architect or related certifications
How to Apply:Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visit Jobs In India – VARITE.
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral:
| 0-2 years | INR 5,000 |
| 2-6 years | INR 7,500 |
| 6+ years | INR 10,000 |
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer:
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.
Azure Data Engineer · VARITE INDIA PRIVATE LIMITED