VI
AI Data Engineer
VARITE INDIA PRIVATE LIMITED
- 🇮🇳 India
- On-site
- Senior
- 10 months ago
- Python
- Azure
- CI/CD
- AI
- RAG
- LangChain
- LangGraph
- CrewAI
- Docker
- Kubernetes
- AWS
- GCP
- Machine Learning
- GPT
- ETL
- ELT
- Hadoop
- SQL
- TensorFlow
- PyTorch
- Azure Cloud
- Azure Data Factory
- Azure Databricks
- Azure SQL
- Jenkins
- GitLab CI/CD
- NoSQL
10 months ago
About The Client:
A global information technology, consulting, and business process services company, headquartered in India, provides a broad spectrum of services, including IT consulting, application development, business process outsourcing, and digital solutions. Serving clients across diverse industries and in over 167 countries, the company offers technology-driven solutions to enhance efficiency and innovation. With a global presence, it has emerged as a key player in the IT services and consulting space, contributing to the digital transformation of businesses worldwide.
About The Job:
- We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team.
- The ideal candidate will have a strong background in Python, Azure, CI/CD, deployment, and writing efficient data pipelines.
- You will be responsible for designing, developing, and maintaining robust data infrastructure and pipelines that support our data-driven decision-making processes.
- AI Integration:
- Implement LLM-based workflows, RAG pipelines, and agentic orchestration using frameworks like LangChain, LangGraph, CrewAI, or similar.
- Data Pipeline Development:
- Design, develop, and maintain efficient and scalable data pipelines using Python and Azure tech stack.
- Collaboration:
- Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
- Automation & Deployment:
- Containerize and deploy solutions using Docker, Kubernetes, and cloud-native architectures (Azure/AWS/GCP).
- Monitoring & Governance:
- Ensure data quality, observability, and compliance with security standards.
- Documentation:
- Create and maintain comprehensive documentation for data pipelines, processes, and solutions.
- Troubleshooting:
- Identify and resolve data-related issues and bottlenecks.
- Experience: 6 to 10 yrs.
- Education: Bachelor's or Master's degree in Computer Science, Information Technology, or equivalent in related field.
- Experience: 6-8 years of experience in data engineering, with a strong focus on Python, Azure, CI/CD, and deployment.
- Technical Skills:
- Machine Learning Fundamentals: Model training, feature engineering.
- Generative AI & LLMs: Fine-tuning GPT/BERT, prompt engineering, RAG pipelines.
- Data Engineering Expertise: Advanced ETL/ELT, handling structured/unstructured data.
- Cloud & Big Data Tools: Spark, Hadoop, Kafka, AWS/Azure/GCP.
- Programming: Python (dominant for AI), SQL, ML libraries (TensorFlow, PyTorch).
- Proficiency in Python, Api’s for data processing and automation.
- Extensive experience with Azure cloud services (Azure Data Factory, Azure Databricks, Azure SQL Database, etc.).
- Understanding of CI/CD principles and tools (e.g., Jenkins, GitLab CI/CD).
- Understandin with containerization and orchestration tools (e.g., Docker, Kubernetes).
- Knowledge of SQL and NoSQL databases.
- Familiarity with data warehousing concepts and technologies.
- Soft Skills:
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration abilities.
- Ability to work independently and as part of a team.
- Detail-oriented with a focus on quality and accuracy.
- Experience with big data technologies (e.g., Hadoop, Spark).
- Knowledge of machine learning and data science concepts.
- Certification in Azure or other relevant technologies.
- Competitive salary and performance-based bonuses.
- Health, dental, and vision insurance.
- Retirement savings plan with company match.
- Professional development opportunities.
- Flexible working hours and remote work options.
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral:
| 0-2 years | INR 5,000 |
| 2-6 years | INR 7,500 |
| 6+ years | INR 10,000 |
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer:
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.
AI Data Engineer · VARITE INDIA PRIVATE LIMITED