RC
Data pipeline
RAPS Consulting - India
Location not stated
2 months ago
- ETL
- ELT
- SQL
- Python
- Java
- Scala
- Apache Airflow
- Azure Data Factory
- Step Functions
2 months ago
- Data engineering and ETL/ELT development (6+ years)
- Advanced SQL
- Programming in at least one: Python, Java, Scala, or Spark SQL
- Processing large data volumes in distributed or cloud environments
- Orchestration and workflow tools: Apache Airflow, Azure Data Factory, AWS Step Functions
- Data storage and analytics platforms: relational and non-relational databases, data warehouses, data lakes
- Resilient pipeline design: logging, monitoring, retry logic, idempotency, failure recovery
Data pipeline · RAPS Consulting - India