VI
Databricks Data Engineer with GenAI Expertise
VARITE INDIA PRIVATE LIMITED
- 🇮🇳 India
- Hybrid
- Mid level
- 10 months ago
- Databricks
- Machine Learning
- AI/ML
- PySpark
- ETL
- Python
- SQL
- Azure
- AWS
- GCP
- Delta Lake
- MLflow
- CI/CD
- Devops
- Large Language Models
10 months ago
About The Client:
KPMG is one of the world’s leading professional services firms and the fastest growing Big Four accounting firm
About The Job:
- We are seeking an experienced Databricks Data Engineer with strong expertise in Generative AI (GenAI) to join our team for a 6-month contractual engagement.
- The ideal candidate will have a proven track record of designing and implementing data solutions on Databricks, along with hands-on experience in AI/ML and GenAI frameworks.
- Design, develop, and optimize data pipelines and workflows using Databricks and PySpark.
- Implement data ingestion, transformation, and processing for large-scale datasets.
- Collaborate with AI/ML teams to integrate Generative AI models into data workflows.
- Ensure data quality, governance, and security compliance across all processes.
- Work closely with stakeholders to understand business requirements and deliver scalable solutions.
- Troubleshoot and optimize performance for ETL processes and data lake architectures.
Required Skills & Experience:
- 5+ years of experience in Data Engineering with strong proficiency in Databricks and Spark.
- Hands-on experience with Python, SQL, and cloud platforms (Azure/AWS/GCP).
- Strong understanding of GenAI concepts, frameworks, and integration with data pipelines.
- Experience with Delta Lake, MLflow, and data orchestration tools.
- Familiarity with CI/CD pipelines and DevOps practices for data solutions.
- Excellent problem-solving and communication skills.
- Exposure to LLM (Large Language Models) and prompt engineering.
- Knowledge of data security and compliance standards.
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral:
| 0-2 years | INR 5,000 |
| 2-6 years | INR 7,500 |
| 6+ years | INR 10,000 |
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer:
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.
Databricks Data Engineer with GenAI Expertise · VARITE INDIA PRIVATE LIMITED