DEVELOPMENT LEAD_APACHE SPARK

Role Overview:

We are looking for a seasonedDevelopment Lead to guide and mentor a high-performing engineering team. The ideal candidate will have strong hands-on expertise inJava, Scala, Apache Spark, andETL batch frameworks, with proven leadership skills to drive end-to-end delivery of scalable data solutions.

Key Responsibilities

• Lead a team of developers and data engineers in designing and implementing enterprise-grade solutions.
• Architect and oversee development ofETL batch pipelines using Spark and related frameworks.
• Provide technical leadership inJava/Scala programming for backend services and data processing.
• Collaborate with product owners, architects, and stakeholders to define technical roadmaps.
• Ensure adherence to coding standards, best practices, and performance optimization.
• Conduct code reviews, mentor junior engineers, and foster a culture of continuous learning.
• Drive automation, CI/CD integration, and deployment strategies.
• Troubleshoot complex issues in distributed systems and ensure high availability.
• Align development efforts with business goals and timelines in an onsite leadership capacity.

Required Skills & Experience

• Strong programming expertise inJava and Scala.
• Hands-on experience withApache Spark (batch processing, distributed computing).
• Deep knowledge ofETL batch frameworks (e.g., Informatica, Talend, Spark ETL, custom frameworks).
• Experience withdata warehousing concepts and large-scale data pipelines.
• Familiarity withcloud platforms (AWS, Azure, GCP) and big data ecosystems (HDFS, Hive, Kafka).
• Strong leadership and communication skills to manage onsite teams and coordinate with offshore PODs.
• Proven track record of delivering complex projects in Agile/Scrum environments.

Preferred Qualifications

• Exposure tostreaming frameworks (Spark Streaming, Flink, Kafka Streams).
• Experience withcontainerization and orchestration (Docker, Kubernetes).
• Knowledge ofDevOps practices and CI/CD tools (Jenkins, GitLab CI, Azure DevOps).
• Prior experience as atechnical lead or architect in data-intensive projects.