Snowflake Data Engineer - Lead

Snowflake Data Engineer – Lead

Snowflake Data Warehouse & SQL Development

· Develop and optimize complex SQL queries, including joins, aggregations, window functions, and stored procedures

• Support Snowflake Data Warehouse development, maintenance, and performance optimization

Data Ingestion & Integration

· Design and implement data loading solutions using COPY INTO, Snowpipe, and Snowflake stages

• Manage internal and external stages for efficient data ingestion and processing

CDC & Pipeline Automation

· Implement Change Data Capture (CDC) solutions using Snowflake Streams

• Automate data pipelines and workflows using Snowflake Tasks

AWS Integration

· Integrate Snowflake with AWS services including Amazon S3 and AWS Glue

• Support secure and scalable data movement between cloud storage and Snowflake environments

External Tables & Data Access

· Create and manage Snowflake External Tables for querying data directly from Amazon S3

• Support Data Lake integration and external data access requirements

AWS Glue ETL Development

· Build and maintain ETL pipelines using AWS Glue

• Develop and support Python/PySpark-based Glue jobs for data transformation and processing

Workflow Orchestration

· Design and manage workflow automation using AWS Step Functions

• Implement state machines, job sequencing, dependency management, and error handling

Performance Optimization & Troubleshooting

· Monitor and optimize Snowflake query performance and warehouse utilization

• Troubleshoot ETL pipelines, data loading processes, and integration issues across Snowflake and AWS platforms