TI
Senior Data Engineer (Databricks & Azure) _AMAT
Tranzeal Inc.
š®š³ India
On-site
Senior
4 months ago
- ETL
- ELT
- SQL
- PySpark
- Python
- Databricks
- Delta Lake
- Unity Catalog
- Azure
- Azure Cloud
- Key Vault
- Azure DevOps
- CI/CD
- Agile
- AI
- AI/ML
- RAG
- Azure OpenAI
- LangChain
- Machine Learning
- ChatGPT
- Claude
- Large Language Models
4 months ago
Location: ITPL, Bangalore
Work Mode: 4days Work from Office
Customer: AMAT
Billrate:22-24 LPA
Mandates:
Looking for candidates in Bangalore location only and mandatory work from office (AMAT Client Office location)
Mandatory to attend the final round of the interview in person.
JD:
ā¢ 8+ years in Data Projectsā Proven track record of delivering end-to-end data engineering solutions including ETL/ELT pipelines, data models, and platform builds at enterprise scale.
ā¢ Expert SQL Skills ā Advanced proficiency in complex joins, window functions, CTEs, query optimization, and performance tuning across large datasets.
ā¢ Strong PySpark & Python ā Hands-on experience building distributed data processing pipelines, transformations, and automation scripts using PySpark and Python.
ā¢ Databricks Expertise ā Working knowledge of Delta Lake, Unity Catalog, Workflows, medallion architecture (bronze-silver-gold), and lakehouse best practices.
ā¢ Azure & Cloud Skills ā Solid experience with Azure cloud services including ADLS Gen2, Data Factory, Synapse, Key Vault, Azure DevOps, and CI/CD pipelines.
ā¢ Problem Solving & Debugging ā Strong ability to diagnose and resolve complex data pipeline failures, distributed system issues, and production incidents under pressure.
ā¢ Performance Tuning ā Demonstrated expertise in optimizing Spark jobs, SQL queries, and cloud storage layers for cost efficiency, throughput, and reliability.
ā¢ Adaptability ā Comfortable navigating evolving technology stacks, shifting priorities, and cross-functional collaboration in a dynamic, fast-paced Agile environment.
ā¢ Team Player ā Collaborative engineer who actively contributes to code reviews, architecture discussions, knowledge sharing, and mentoring within a globally distributed team.
ā¢ AI Exposure (Nice to Have) ā Familiarity with AI/ML concepts such as model training pipelines, feature engineering, RAG architectures, or tools like Azure OpenAI and LangChain.
ā¢ GenAI Skills:Strong hands-on experience with Databricks Genie, ChatGPT, Claude, and various Large Language Models (LLMs).
Senior Data Engineer (Databricks & Azure) _AMAT Ā· Tranzeal Inc.