NC
GCP Data Engineer
NR Consulting - India
๐ฎ๐ณ India
On-site
1 week ago
- GCP
- PySpark
- SQL
- BigQuery
- Pub/Sub
- Apache Airflow
- Composer
- dbt
- Python
- Git
- Docker
- Terraform
- GitHub Actions
- CI/CD
- IaC
1 week ago
Location : Mumbai
EXP : 4+Years
Description
Key Skills :
Strong hands-on experience in PySpark (Spark Core, Spark SQL, Spark Streaming).
Expertise in Google Cloud Platform (GCP): BigQuery, Cloud Storage (GCS), Dataproc, Pub/Sub.
Advanced SQL skills with BigQuery optimization and data warehousing concepts.
Experience in workflow orchestration using Apache Airflow / Cloud Composer.
Hands-on experience with dbt Core / dbt Cloud for data transformation.
Strong programming skills in Python.
Experience with Git and Docker.
Familiarity with Terraform, Google Cloud Build, and GitHub Actions.
Good understanding of CI/CD, Infrastructure as Code (IaC), and cloud-native data platforms.
Responsibilities
Build and maintain scalable data pipelines on GCP.
Develop batch and streaming data processing solutions using PySpark.
Design and optimize BigQuery data warehouse solutions.
Implement orchestration, transformation, and deployment frameworks.
Work with cross-functional teams to deliver data engineering solutions.
Qualification: BE/BTech/MTech in Computer Science.
GCP Data Engineer ยท NR Consulting - India