|
Job Description
|
We are looking for a hands-on GCP Data Engineer with strong expertise in data ingestion, transformation, and orchestration using BigQuery, Dataflow, and Cloud Composer (Airflow).
The role involves building scalable, production-grade data pipelines to support analytics, reporting, and AI/ML initiatives.Design and develop batch & streaming pipelines using Dataflow (Apache Beam)
- Build and optimize data models & transformations in BigQuery (advanced SQL)
- Develop and maintain Cloud Composer (Airflow) DAGs for orchestration
- Implement incremental loads, CDC patterns, and data validation checks
- Optimize BigQuery performance (partitioning, clustering, cost control)
- Monitor pipelines using Cloud Monitoring & Logging - Ensure security, IAM compliance, and data governance standards
- Collaborate with Data Scientists, BI teams, and ML Engineers - 6+ years of Data Engin
|
