Description:
- Design and implement data pipelines using S3 Medallion Architecture (Bronze, Silver, Gold layers)
- Build and maintain scalable ETL/ELT workflows using AWS Lambda and Step Functions
- Develop data ingestion frameworks to pull data from external APIs
- Transform and load data into Amazon Redshift for analytics and reporting
- Write efficient, reusable, and scalable code in Python
- Ensure data quality, validation, and monitoring across pipelines
- Optimize data storage and query performance in S3 and Redshift
- Collaborate with data analysts, data scientists, and business stakeholders
- Implement logging, alerting, and error-handling mechanisms
- Maintain documentation for pipelines, data models, and workflows
|
|
|
|
TN | CHENNAI |
|
|
MAH | PUNE |
|
|
KRNK | BANGALORE |
|
|
5 |
|
|
Hands-on experience with AWS S3, Redshift, Lambda, and Step Functions; strong understanding of Medallion Architecture; proficiency in Python and SQL; experience with REST API integrations, JSON processing, authentication, data warehousing, workflow orchestration, event-driven architectures, data modeling, and schema design |
|
|
• Experience with Glue / Athena / EMR (nice to have)
• Knowledge of CI/CD pipelines for data workflows
• Experience with data quality frameworks and monitoring tools
• Exposure to streaming pipelines (Kafka/Kinesis) is a plus |
|
|
Banking |
| Total Experience (Ex. 5-7 Years) |
|
|
7+ |
|
|
Face to Face |
|
|
Hybrid |
| Please enter shift timings |
|
|
11 AM-8 PM |
|
|
General |
