Lead Data Engineer

Title: Lead Data Engineer (Azure)

Experience: 9 to 5 Years

Work Location: Bangalore/Pune/Client

Notice Period: Immediate to 30 Days Max only

Required Skills (Mandatory):

Industrial Experience - Investment Management (Asset/fund management):

• Managing investments (equities, bonds, derivatives, etc.)
• Handling mutual funds, hedge funds, pension funds
• Making decisions to grow client portfolios

Also called:

• Asset Management
• Fund Management
• Wealth Management (slightly broader)

Technical Skills:

• Mandatory Skills - Snowflake, DBT, Azure, python, good coding principles - high weightage
• Good to have - Databricks
• Additional skills - Devops experience using tools like Gitlab and alikes

Job Summary:

The Senior Data Engineer will design, develop, and optimize data solutions to support business processes and analytics within Investment Management. This role requires deep expertise in modern data engineering practices, cloud-native development, and advanced data transformation techniques. The engineer will work extensively with Azure Data Factory (ADF), Python, PL/SQL, DBT, PySpark, Snowflake, Databricks, and job scheduling tools, while leveraging Azure Function Apps and Gen AI tools such as Cortex AI and GitHub Copilot for automation and productivity.

Key Responsibilities:

• Architect and implement scalable data pipelines and ETL workflows using ADF, PySpark, and DBT.
• Design and optimize data models for Snowflake and other cloud-based data platforms.
• Develop and maintain complex data transformation logic using Python, PL/SQL, DBT, Snowpark, Snowsight web interface, Databricks notebooks, and Pyspark.
• Integrate job schedulers and Azure Function Apps for orchestration and automation.
• Apply Gen AI tools (Cortex AI, GitHub Copilot) to accelerate development, improve code quality, and enhance productivity.
• Ensure robust data governance, security, and compliance across all solutions.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
• Mentor junior engineers and provide technical leadership in data engineering best practices.
• Participate in Scrum ceremonies and contribute to continuous improvement initiatives.

Requirements & Qualifications:

• 6+ years of hands-on experience in data engineering with strong coding skills.
• Proven expertise in: dbt, Snowflake, Azure Data Factory (ADF), Python, PySpark, PL/SQL, Databricks.
• Experience with job schedulers and Azure Function Apps for automation.
• Familiarity with Gen AI tools (e.g., Cortex AI, GitHub Copilot) for accelerating development.
• Strong hands-on understanding of CI/CD pipelines, DevSecOps, Data Engineering best practices, and Agile methodologies.
• Excellent problem-solving skills and ability to work in a fast-paced environment.
• Strong communication and stakeholder management skills.

Education & Certifications:

• Bachelor of Engineering degree in Computer Science, Information Technology, or related field.
• Certifications in Azure Data Engineering, Snowflake, or Databricks are a plus.
• Exposure to Investment Management or Financial Services domain preferred.

About Voya Financial India:

Voya Financial is an American financial services company based in the United States. It provides retirement, investment, and insurance solutions to individuals, employers, and institutional clients. Voya Financial operates through several subsidiaries and has a presence in the retirement, investment management, and employee benefits markets. It is a leading health, wealth and investment company that provides products, solutions and technologies that help Americans become well planned, well invested and well protected. Serving the needs of 14.3 million individual, workplace and institutional clients, Voya is purpose-driven and is equally committed to conducting business in a way that is socially, environmentally, economically and ethically responsible.

Voya India (Formerly known as VFISLK), originally established in 2019 as a joint venture between Voya Financial, a US-based financial services company headquartered in New York, and SLK Software, a global IT services company based in Bangalore, has transitioned into a wholly-owned subsidiary of Voya Financial. AsVoya India, we're dedicated to delivering innovative solutions to support Voya's retirement, employee benefits, and investment management businesses.