Likeremote

Subscribe to the latest remote jobs:

  • Likeremote jobs on https://LinkedIn.com/
  • Likeremote jobs on https://telegram.org/
  • Likeremote jobs on Reddit.com
ES

Lead Data Engineer (GCP)

EPAM Systems
  • ๐Ÿ‡ฒ๐Ÿ‡พ Malaysia
  • Hybrid
  • Staff / Principal
  • 2 days ago
  • Python
  • SQL
  • Apache Airflow
  • BigQuery
  • GCP
  • ETL
  • ELT
  • Jira
  • Confluence
  • Data Modeling
  • CI/CD
  • GitHub
  • Dataflow
  • IaC
  • Terraform
Not scoredNo CV on file. Upload one and this job gets a score out of 100.Upload CV

We are seeking a Lead Data Engineer to build scalable pipelines across multiple data domains. You will use Python, SQL, Apache Airflow and BigQuery to deliver reliable cloud data products on Google Cloud Platform (GCP). You will also help strengthen governance, performance and platform standards.

Responsibilities

  • Design, build, optimize and monitor scalable data pipelines using Python and SQL
  • Develop and operate ETL/ELT workflows orchestrated with Apache Airflow
  • Create, maintain and tune data models and warehouse structures in BigQuery
  • Build and support data infrastructure and platform operations on Google Cloud Platform (GCP)
  • Partner with engineering, analytics and product teams to deliver trusted datasets and data products
  • Document designs, changes and runbooks in Jira and Confluence
  • Improve data governance, architectural standards and platform performance

Requirements

  • Hands-on experience with Python for data transformation and pipeline development
  • Practical knowledge of Apache Airflow for orchestration and scheduling
  • Experience with Google Cloud Platform (GCP), including BigQuery
  • Strong understanding of data modeling, ETL design and data warehousing concepts
  • Familiarity with continuous integration and continuous delivery (CI/CD) practices and GitHub
  • Clear communication and confidence collaborating across teams

Nice to have

  • Experience with Google Cloud Dataflow
  • Exposure to Business Intelligence Markup Language (BIML) for metadata-driven ETL
  • Familiarity with infrastructure as code such as Terraform

Lead Data Engineer (GCP) ยท EPAM Systems

Auto apply with Likeremote