data engineer

We are looking for a talented seasoned engineer to work collaboratively on a geographically diverse team. These engineers will develop and enhance API, ETL using AWS Cloud technologies business customers.

What you will be doing:

• Develop and maintain APIs, Data Jobs and Services using Python frameworks

• Develop and maintain data workflows using ELT and ETL frameworks

• Ability to troubleshoot and analyze ETL tasks with little direction.

• Ability to suggest alternative approaches and solutions to complex ETL data challenges

• Ability to design and maintain backend system & integration architecture using AWS cloud services

• Collaborate with both engineering team members and business stakeholders

• Utilize Jira/Confluence for team communication and planning

• Perform Automation Tests (Unit Tests Integration Test Performance Tests)

Skills & Qualifications:

• Cloud Environments: AWS, Azure, GCP (Preferred AWS Certified Dev)

• API Testing: Postman, Swagger UI

• Coding Languages/Scripting: Python, Python frameworks like Fast API, Django, Flask, Celery, SQL Alchemy

• Database: Experience browsing, filter and perform advance queries on the data from relational & NO-SQL databases like MySQL, Redshift, Postgres, MongoDB

• Hands on with S3, Lambda, Aws Glue, Fargate, SQS, SNS, Event bridge, Airflow

• Hands on with Containers, Docker, Kubernetes, ECS, EKS, EC2

• Jenkins, Git Actions

• SQL, Shell, Groovy

• Unix/Linux

• Jira, Confluence, GitHub, Bitbucket

• Version Control: Bitbucket, Github, Git