DL
Data Engineering Lead
Diverse Lynx India
Location not stated
Staff / Principal
2 months ago
- Databricks
- Apache Spark
- AWS
- dbt
- Airflow
- Python
- Java
- SQL
- PostgreSQL
- CI/CD
2 months ago
Max Budget : 14 k Per day maximum
Duration : 12 months
Location :Hybrid, (Mumbai BKC Bandra Kurla Complex)
Shift :UK Shift
Notice period-Only Immediate joiners.
JD Link :https://smrtr.io/yH6v9
Job Description
We are looking for a Data Tech Lead to join our Data Engineering practice, delivering modern data platforms for enterprise and regulated clients. This is a hands‐on leadership role for a technically strong engineer who can lead design and delivery, act as a trusted technical authority, and mentor engineers while maintaining strong engineering discipline in real‐world environments.
This is a delivery‐focused role for an experienced engineer and Tech Lead who enjoys solving complex data challenges, takes ownership of outcomes, and applies strong engineering discipline in real‐world environments.
- Leading end‐to‐end delivery of data engineering workstreams; shaping solution approach, setting technical direction, and ensuring outcomes are delivered to a high standard
- Designing and building scalable batch and streaming pipelines and operating production systems
- Providing technical governance and oversight: design reviews, implementation guidance, risk/issue escalation, and delivery assurance
- Building strong stakeholder relationships and operating as a credible client‐facing technical lead
- Coaching and mentoring engineers, supporting learning plans, and helping develop capability standards and accelerators
- Partnering with business and technology stakeholders to build and enhance reliable, scalable data platforms
- Developing high‐throughput, low‐latency data processing systems
- Working within the Databricks and Apache Spark ecosystem to support large‐scale data workloads
- Building and maintaining cloud‐native data solutions on AWS
- Using dbt for data transformation, modelling, testing, and documentation
- Orchestrating data workflows using Airflow or similar orchestration tools
- Writing clean, efficient, and well‐tested code following software engineering best practices
- Collaborating closely with product, analytics, and platform teams
- Supporting production systems by troubleshooting issues and implementing continuous improvements
- Ensuring solutions are production‐ready: secure, tested, observable, and cost‐efficient
- Optimising data performance, reliability, and data quality in live environments
- 8-10 years' experience in hands‐on data engineering, including technical leadership on production platforms
- Experience providing technical governance (design reviews, standards, delivery assurance) and supporting delivery at pace
- Comfortable contributing to estimation and commercial discussions and ensuring solutions are feasible and deliverable
- Proven ability to mentor and help develop engineers through coaching, feedback, and structured development support
- Strong hands‐on coding skills in Python, Java, or similar languages, with strong SQL capability
- Proven experience building and operating batch and streaming pipelines in production
- Experience with AWS, Databricks/Spark, and modern data architectures
- Hands‐on experience using dbt for transformations and Airflow (or equivalent) for orchestration
- Solid understanding of data modelling, data quality, and production data systems
- Experience working with relational databases such as Postgres or SQL Server.
- Familiarity with CI/CD pipelines, testing frameworks, and monitoring / observability tooling.
Data Engineering Lead · Diverse Lynx India