Lead Data Engineer - Data Engineering 4C
- 🇮🇳 India
- Hybrid
- Staff / Principal
- 12 hours ago
- AI
- Databricks
- Python
- Scala
- Delta Lake
- Unity Catalog
- SQL
- Hive
- Azure
- AWS
- GCP
- Cosmos DB
- DynamoDB
- SQS
- CI/CD
- dbt
- Docker
- Kubernetes
- Apache Spark
- Oracle Database
- Agile
- Design Thinking
- Risk Management
- Snowflake
Ready to turn bold ideas into real-world impact?
At Genpact, we don’t just adapt to change, we lead it. AI and digital innovation are transforming the way businesses work, and we’re at the forefront of it.Genpact’s AI Gigafactory, our industry-first accelerator, exemplifies how we scale advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. Whether tackling complex challenges through large-scale models oragentic AI, our breakthrough solutions tackle companies’ most complex challenges.
If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what’s possible, this is your moment.
Genpact (NYSE: G) is an agentic and advanced technology solutions company. We leverage process intelligence and artificial intelligence to deliver measurable outcomes. With a strong partner ecosystem and decades of client trust, we provide innovative solutions that transform how businesses run. Powered by a team with an active learning mindset and client centricity at its core, we deliver lasting value for the world’s leading enterprises.
Get to know us atgenpact.com and onLinkedIn,YouTube,X, andFacebook.
Job Description
Inviting applications for the role of Principal Consultant- Databricks Lead Developer!
In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements.
Maintains close awareness of new and emerging technologies and their potential application for service offerings and products. • Work with architect and lead engineers for solutions to meet functional and non functional requirements. • Demonstrated knowledge of relevant industry trends and standards. • Demonstrate strong analytical and technical problem-solving skills. • Must have experience in Data Engineering domain .
• Bachelor’s Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience. • Overall 8+ years of experience in IT • Maintains close awareness of new and emerging technologies and their potential application for service offerings and products. • Work with architect and lead engineers for solutions to meet functional and non functional requirements. • Demonstrated knowledge of relevant industry trends and standards. • Demonstrate strong analytical and technical problem-solving skills. • Must have excellent coding skills either Python, Spark / Scala, preferably Python & Spark. • Must have experience in Data Engineering domain. • Must have implemented at least 2 project end-to-end in Databricks. • Must have at least experience on databricks which consists of various components as below AutoLoader Delta lake Unity Catalog Lakeflow Connect db API 2.0 Databricks workflows orchestration • Must be well versed with the Databricks Lakehouse concept and its implementation in enterprise environments. • Must have good understanding to create complex data pipeline • Must have good knowledge of Data structure & algorithms. • Must be strong in SQL and sprak-sql. • Must have strong performance optimization skills to improve efficiency and reduce cost. • Must have worked on both Batch and streaming data pipeline. • Must have extensive knowledge of Spark and Hive data processing framework. • Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases. • Must be strong in writing unit test case and integration test • Must have strong communication skills and have worked on the team of size 15 plus • Must have great attitude towards learning new skills and upskilling the existing skills. Preferred Qualifications • Good to have Genie One, MosaicAI, DQX, and basic governance knowledge. • Good to have Databricks SQL Endpoint understanding. • Good To have CI/CD experience to build the pipeline for Databricks jobs. • Good to have if worked on migration project to build Unified data platform. • Good to have knowledge of DBT.
• Good to have knowledge of docker and Kubernetes.
Qualifications
Bachelors - Business Analytics, Bachelors - Computer Science, Bachelors - Statistics, Masters - Data ScienceCertifications
Certified Data Management Professional - RiversandRiversand, Databricks Certified Associate Developer for Apache Spark 3.0 - Databricks AcademyDatabricks Academy, Databricks Certified Associate Developer for Apache Spark - Databricks AcademyDatabricks Academy, Microsoft Certified: Azure Data Engineer Associate - MicrosoftMicrosoft, Oracle Database 12c Certified Implementation Specialist - OracleOracleRequired Skills
Agile Methodology, Banking Capital Markets, Client Relations, Cloud Computing, Collaboration Tools, Commercial Sales, Consumer Packaged Goods (CPG), Databricks Platform, Data Engineering, Data Literacy, Design Thinking, Electronic Hardware, Executive Presence, Inclusion, Manufacturing Equipment, People Leadership, Personal Effectiveness, Risk Management, Semiconductors, Snowflake (Platform), Sourcing and Procurement, StorytellingLanguage
English (Required)Language Proficiency -
Proficient - C2Additional Job Location -
Job Type
RegularMaster Skill List -
Data EngineeringRemote Type -
HybridWork Shift -
Flex Time (India)Why join Genpact?
• Lead AI-powered transformation – Drive innovation and solve real-world business challenges that matter
• Make an impact– Help global enterprises solve business challenges that matter
• Accelerate your career – Gain hands-on experience, mentorship, and world-class learning opportunities to stay ahead
• Work with the best – Join 140,000+ bold thinkers and problem-solvers who push boundaries every day
• Thrive in a values-driven culture – Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress
Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up.
Let’s build tomorrow together.
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation.
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.
Lead Data Engineer - Data Engineering 4C · Genpact