IW
GCP + Java/Spark + Airflow Resources
Info Way Solutions LLC
Location not stated
2 weeks ago
- GCP
- Java
- Apache Spark
- Apache Airflow
- ETL
- ELT
- SQL
- Airflow
- BigQuery
- Pub/Sub
- Dataflow
2 weeks ago
GCP Data Engineer / Java-Spark Data Engineer
Location
Bentonville, AR — likely onsite/hybrid depending on client requirement
Core Skills
- GCP – Google Cloud Platform
- Java
- Apache Spark
- Apache Airflow
- Big Data / Data Engineering
- ETL/ELT pipelines
- SQL
- Cloud data platforms
Seeking aGCP Data Engineer with strong experience inJava, Apache Spark, and Airflow to design, develop, and maintain scalable data processing and ETL pipelines.
Responsibilities:
- Develop and maintain data pipelines usingGCP, Java, Spark, and Airflow.
- Build scalable batch and/or streaming data processing solutions usingApache Spark.
- Develop and optimize ETL/ELT workflows.
- Create and manage Airflow DAGs for data pipeline orchestration.
- Work with GCP services such asBigQuery, Cloud Storage, Dataproc, Pub/Sub, Dataflow, and related services.
- Optimize Spark jobs for performance, scalability, and reliability.
- Write complexSQL queries for data transformation and analysis.
- Monitor pipelines, troubleshoot failures, and improve data quality.
- Collaborate with application, data, and business teams.
GCP + Java + Spark + Airflow
For sourcing, I would prioritize candidates with5+ years of Data Engineering experience and strong hands-onGCP/Spark/Airflow rather than generic Java developers.
GCP + Java/Spark + Airflow Resources · Info Way Solutions LLC