NC
Senior Snowflake & Python ETL Developer
NR Consulting - India
🇮🇳 India
On-site
Senior
1 week ago
- Snowflake
- Python
- ETL
- SQL
- Git
- CI/CD
- IaC
- Data Modeling
- Vault
- AWS
- Step Functions
- Amazon EventBridge
- Risk Management
- Apache Airflow
- SNS
- Agile
- Scrum
1 week ago
Location: Chennai, Bangalore & Hyderabad
Exp: 8+ Yrs
Job Description:
Key Responsibilities-
· Take ownership of complex data engineering initiatives from conception through production deployment.
· Develop and implement high-performance ETL frameworks using Snowflake and Python,
· Establish patterns and standards that other developers can follow while ensuring scalability, reliability, and maintainability.
· Leverage advanced Snowflake features including Snowpark , Snowpipe for real-time ingestion, streams and tasks for event-driven processing, dynamic tables for incremental transformations, and stored procedures for complex business logic.
· Conduct code reviews, mentor junior and mid-level developers.
· Identify opportunities to improve data quality, pipeline reliability, and operational efficiency.
· Implement comprehensive monitoring and alerting systems,
· Develop automated testing frameworks, and self-service capabilities that empower data consumers across the organization.
Production Support:
· Participate in a rotational production support schedule (approximately one month rotations) to monitor data pipelines, respond to alerts, and resolve operational issues.
· Troubleshoot production issues, perform root cause analysis, and implement permanent fixes that prevent recurrence.
Required Qualifications
Technical Skills & Experience:
• 8-10 years of progressive experience in data engineering, with at least 3 years focused on Snowflake and Python-based ETL development
• Expert-level proficiency in Snowflake, including advanced features (Snowpipe,snowpark, streams, tasks, dynamic tables), performance tuning, resource optimization, query profiling, and data sharing capabilities
• Advanced Python programming skills with demonstrated ability to build robust, production-grade ETL frameworks, implement design patterns, and develop reusable libraries
• Proven track record of architecting and deploying enterprise-scale ETL pipelines processing terabytes of data with high reliability and performance
• Deep expertise in SQL optimization, including complex window functions, recursive CTEs, and execution plan analysis
• Strong experience with version control (Git), CI/CD pipelines for data workflows, and infrastructure-as-code practices
• Comprehensive understanding of data modeling methodologies (dimensional modeling, Data Vault, star/snowflake schemas) and when to apply each approach
• Experience mentoring developers and leading technical initiatives
Education:
• Bachelor's degree in computer science, Information Systems, Engineering, or related technical field; Master's degree preferred, or equivalent practical experience
Preferred Qualifications
• Extensive hands-on experience with AWS services (Glue, S3, Lambda, Step Functions, EventBridge) and their integration with Snowflake
• Good to have experience in the asset management industry with understanding of investment data workflows, portfolio analytics, risk management data, or fund accounting processes
• Experience with workflow orchestration platforms (Apache Airflow, Autosys)
• Knowledge of data streaming technologies (Kafka, SNS) and real-time processing patterns
• Good to have SnowPro certifications (Data Engineer, Architect) and/or AWS Professional certifications
• Understanding of data governance, security, and compliance frameworks
• Experience working in Agile/Scrum environments
Senior Snowflake & Python ETL Developer · NR Consulting - India