VI
Databricks Developer
VARITE INDIA PRIVATE LIMITED
🇮🇳 India
On-site
8 months ago
- PySpark
- Databricks
- ETL
- Azure
- Azure Databricks
- Delta Lake
- Python
- SQL
- Azure DevOps
- CI/CD
- Unity Catalog
8 months ago
About The Client:
Client is an American multinational corporation known for its wide range of consumer products, including personal care items, tissue, and hygiene products. With a global presence, it has established itself as a leader in its industry, focusing on innovation, sustainability, and customer satisfaction.
About The Job:
- A Pyspark and Databricks Developer with a good understanding of the entire ETL/Azure lifecycle with a background of data projects.
- Design, develop, and maintain scalable data pipelines and ETL processes using Azure Databricks, Data Factory, and other Azure services
- Implement and optimize Spark jobs, data transformations, and data processing workflows, Managing Databricks notebooks, Delta lake with Python, Delta Lake with Sparks SQL in Databricks
- Leverage Azure DevOps and CI/CD best practices to automate the deployment /DAB Deployments and management of data pipelines and infrastructure
- Ensure Data Integrity checks and Data Quality checks with zero percent errors when deployed to production
- Understand Databricks new features Unity Catalog/Lake flow/DAB Deployments/Catalog Federation
- Hands on experience Data extraction (extract, schemas, corrupt records, error handling, parallelized code), transformations and loads (user defined functions, join optimizations) and Production optimize (automate ETL)
- Bachelor’s degree in computer science, Information Technology, or related field.
- Minimum of 5 years of experience in data engineering or similar roles.
- Proven expertise with Azure Databricks and data processing frameworks.
- Strong understanding of data warehousing, ETL processes, and data pipeline design.
- Experience with SQL, Python, and Spark.
- Excellent problem-solving and analytical skills.
- Effective communication and teamwork abilities.
How to Apply:Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visit Jobs In India – VARITE.
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral:
| 0-2 years | INR 5,000 |
| 2-6 years | INR 7,500 |
| 6+ years | INR 10,000 |
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer:
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.
Databricks Developer · VARITE INDIA PRIVATE LIMITED