TC
GCP Cloud Engineer
TechDigital Corporation
🇺🇸 United States
Remote
5 months ago
- GCP
- Composer
- Apache Airflow
- Dataflow
- Airflow
- BigQuery
- Cloud Functions
- Cloud Run
- IAM
- PL/SQL
- Spring Boot
- Angular
- IaC
- Terraform
- Devops
- CI/CD
- Jenkins
- Java
- Python
- DNS
5 months ago
Job Description:
• Fix and enhance Dataflow and/or Dataproc Data ingestion pipelines (batch & Streaming) .
• Have Good Understanding ofGCP Composer(Apache Airflow) environments.
• Manage Airflow DAGs and troubleshoot Airflow-related issues.
• Monitor and optimize Composer performance and scalability.
• Maintain GCP infrastructure including services like: o Google Cloud Storage (GCS)
o BigQuery (BQ)
o Cloud Dataflow ( Apache Beam )
o Cloud Dataproc
o Cloud Functions
o Cloud Run • Have Good Understanding of: o IAM and service account permissions
o Secret Manager • Monitor GCP usage and quotas, and proactively prevent quota-related issues.
• Set up and manage alerting, logging, and monitoring using tools like Stackdriver (Cloud Monitoring & Logging).
• DB design experience (with Excellent RDBS-PLSQL knowledge )
• Design Springboot APIs
• Analyze, design, create Dockerfile
• Knowledge on Angular ( Good to Have )
• Design and implement infrastructure as code using Terraform for provisioning and managing GCP resources.
• Collaborate with DevOps and development teams to manage CI/CD pipelines using Jenkins and other automation tools.
• Ensure security, compliance, and cost-efficiency across the cloud environment.
• Document system configurations, procedures, and best practices.
• Proficient in either Java or Python programming languages.
• Excellent problem-solving and troubleshooting skills.
• Strong communication and documentation abilities.
• Knowledge on DNS and SSO configuration setup
• Knowledge on CDC Pipelines/Application (Good to Have)
GCP Cloud Engineer · TechDigital Corporation