EI
ETL Migration & Pipeline Development
Expert In Recruitment Solutions
šŗšø United States
Remote
5 months ago
- ETL
- Apache Airflow
- Airflow
- Python
- Snowflake
- SQL
- AWS
- RDS
- Aurora
- IAM
- ELT
- Git
- CI/CD
- Informatica
- Talend
- SSIS
- Docker
- Kubernetes
- EKS
- Datadog
- CloudWatch
- Data Modeling
5 months ago
Duration2āYear Contract
Location:100% Remote
Interview ProcessOne virtual interview (oneāandādone)
Data Engineer - ETL Migration & Pipeline Development
We are seeking a Data Engineer contractor (100% remote) to support and execute the migration of ETL pipelines from Matillion to Apache Airflow. This role focuses on rebuilding pipelines, improving reliability, and enabling scalable, code-based data workflows.
This is a hands-on role requiring someone who can ramp quickly, work with existing ETL logic, and contribute within the first 1ā2 weeks.
Responsibilities:
Ā· Migrate existing ETL pipelines from Matillion to Apache Airflow while preserving logic and dependencies
Ā· Develop and maintain Airflow DAGs with proper scheduling, retries, and failure handling
Ā· Reverse engineer existing Matillion jobs and translate them into Python-based workflows
Ā· Build and optimize data pipelines across systems such as S3, Snowflake, and relational databases
Ā· Perform data validation and reconciliation between source and target systems
Ā· Write and optimize SQL transformations for large-scale datasets
Ā· Implement monitoring, alerting, and error handling for pipelines
Ā· Collaborate with data, platform, and analytics teams to ensure smooth migration and deployment
Ā· Document pipelines, workflows, and operational processes
Required Qualifications:
Ā· 3+ years of experience in Data Engineering or ETL development
Ā· Strong hands-on experience with Apache Airflow or similar orchestration tools
Ā· Proficiency in Python for building data pipelines and workflows
Ā· Strong SQL skills and experience working with large datasets
Ā· Experience with cloud platforms (AWS preferred: S3, RDS/Aurora, IAM)
Ā· Experience with cloud data warehouses (Snowflake preferred or similar)
Ā· Experience building and maintaining ETL/ELT pipelines
Ā· Familiarity with Git and CI/CD workflows
Preferred Qualifications:
Ā· Experience migrating ETL workflows from tools like Matillion, Informatica, Talend, or SSIS to Airflow
Ā· Experience with Airflow in containerized environments (Docker, Kubernetes/EKS)
Ā· Familiarity with data validation, reconciliation, and pipeline testing strategies
Ā· Experience with monitoring tools such as Datadog or CloudWatch
Ā· Understanding of data modeling or medallion architecture
ETL Migration & Pipeline Development Ā· Expert In Recruitment Solutions