PL
Senior GCP Data Engineer
PeopleNTech LLC
๐บ๐ธ United States
On-site
Senior
3 months ago
- GCP
- Dataflow
- Pub/Sub
- Cloud Run
- BigQuery
- Data Architecture
- CI/CD
- SQL
- Composer
- Airflow
- PySpark
- Python
- Apache Spark
- Data Modeling
- Terraform
- GitOps
3 months ago
- Detailed JD:
You will collaborate closely with cross-functional teams includingEnterprise Architecture, Platform Engineering, Data Activation, and Solution Architects to enable robust data ingestion (batch and streaming) and transformation pipelines across multiple data sources.
Key Responsibilities
- Design, develop, and maintainscalable data pipelines on GCP for batch and real-time processing.
- Implementdata ingestion frameworks (push/pull) using services like Dataflow, DataStream, Pub/Sub, and Cloud Run.
- Build and optimizedata transformation pipelines using BigQuery, Dataform, and Spark-based frameworks.
- Act as thetechnical lead/owner ensuring alignment with EA-approved data architecture.
- Drivebest practices in data engineering, including CI/CD, testing, monitoring, and cost optimization.
- Collaborate with cross-functional teams to deliverend-to-end data solutions.
- Ensure data quality, reliability, governance, and performance across pipelines.
Experience
- 6+ years of experience indata engineering, with strong focus onGoogle Cloud Platform (GCP).
- GCP Professional Data Engineer certification - must have
Strong hands-on experience with:
- Medallion architecture (Centralized Hub/Spoke model)
- BigQuery (data warehousing & optimization)
- Dataform (SQL-based transformations)
- Dataflow (batch & streaming pipelines)
- Datastream (CDC ingestion)
- Cloud Composer (Airflow) (orchestration)
- Dataproc (Spark/PySpark)
- Cloud Run
- Cloud Storage
- Pub/Sub
Advanced proficiency in:
- Python
- PySpark / Apache Spark
- SQL (complex transformations, performance tuning)
Deep understanding of:
- Data modeling techniques
- Medallion architecture (Bronze/Silver/Gold layers)
- Centralized Hub/Spoke data platform design
- Experience withreal-time streaming architectures
- Familiarity withCI/CD pipelines (Terraform, Cloud Build, GitOps)
- Strong understanding ofdata governance, security, and compliance
- Experience working inlarge enterprise or utility/regulated environments
- Strong ownership and accountability
- Ability to work across distributed teams and vendors
- Excellent communication with technical and non-technical stakeholders
- Sell Rate:$85/hr & 135K.
- Client Full Address: 4 Irving Place, New York, NY 10003.
- Remote / WFO / Hybrid:Hybrid ( 2/3 days work from client office), Prefer NY/NJ candidates
- Hire Type (FTE/Contract):FTE / C2H
- Project Duration:1 Year
- Expected Start Date:22 Jun 26
- Day 1 Billing Confirmation: Yes
- No. of client interviews for this role: 1 to 2
Senior GCP Data Engineer ยท PeopleNTech LLC