Subscribe to the latest remote jobs:

Lead Data Engineer - GCP

Lead Data Engineer - GCP

from

Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to unlocking value and fostering innovation for its clients by harnessing world-class people and data-driven strategy. We believe that the power of people and AI can have a meaningful impact on your world, creating more fulfilling work and projects for our people and clients. For more information, visit www.blend360.com.

We are looking for aSenior GCP Data Engineer with 6+ years of experience in designing, developing, and maintaining scalable data engineering solutions onGoogle Cloud Platform (GCP). The ideal candidate should have strong hands-on expertise inPython, SQL, data pipelines, and GCP data services.

Key Responsibilities

  • Design and develop scalable and reliabledata pipelines using GCP services.
  • Develop data processing and transformation solutions usingPython and SQL.
  • Build and optimize ETL/ELT pipelines for large-volume datasets.
  • Work with business and technical teams to understand data requirements and deliver robust solutions.
  • Perform data modeling, data validation, and performance optimization.
  • Monitor and troubleshoot data pipelines and resolve production issues.
  • Implement data quality, security, and governance best practices.
  • Participate in code reviews and contribute to technical design and architecture discussions.
  • 6+ years of experience in Data Engineering.
  • Strong hands-on experience withGoogle Cloud Platform (GCP).
  • Strong programming experience inPython.
  • Strong expertise inSQL, including complex queries, joins, CTEs, window functions, and query optimization.
  • Experience developingETL/ELT data pipelines.
  • Hands-on experience with one or more GCP services such as:
    • BigQuery
    • Cloud Storage (GCS)
    • Cloud Composer / Airflow
    • Dataflow
    • Pub/Sub
    • Dataproc
  • Experience withApache Spark / PySpark is preferred.
  • Good understanding of data warehousing, data modeling, and distributed data processing.
  • Experience with Git and CI/CD practices.

Nice to Have

  • Experience withTerraform or Infrastructure as Code.
  • Exposure toGCP Dataform.
  • Experience with real-time/streaming data pipelines.
  • Knowledge of cloud security and IAM.
  • Experience working in Agile environments.

All your information will be kept confidential according to EEO guidelines.

by @maxrusakovic