ES
GCP Dataplex Engineer
Epsilon Solutions LTD
Location not stated
4 months ago
- GCP
- BigQuery
- Composer
- Airflow
- RBAC
- KMS
- Pulumi
- Terraform
- SQL
- Python
- IaC
4 months ago
Location: Remote- Canada
Hire Type: Contract
JD
Google Data Analytics,Google Dataplex,Google Identity and Access Management,IT security,analytics solutions,cybersecurity,data analysis,data management,data processing,identity and access management,information technology
We are seeking a skilled GCP Dataplex Engineer to design and implement data governance, security, and scalable data pipelines on Google Cloud Platform. This role will focus on operationalizing governance for sensitive telecom datasets (e.g., NETSCOUT, Sandvine probe data) by leveraging Dataplex, BigQuery, and Composer (Airflow). The candidate will help transition from uncontrolled data access models to a secure, governed, and reusable data platform aligned with enterprise standards.
Key Responsibilities:
Implement Dataplex Lakes, Zones, and asset structures aligned to medallion architecture (Bronze/Silver/Gold)
Register and manage data assets (BigQuery, GCS) within Dataplex
Define and apply metadata tagging strategy (classification, ownership, sensitivity labels)
Configure data lineage tracking across ingestion and transformation pipelines
Build and enhance data pipelines (Composer/Airflow) with embedded governance controls
Implement role-based access control (RBAC) and fine-grained security (row/column-level security, data masking)
Apply encryption and KMS-based controls for sensitive data (e.g., IMSI/subscriber data)
Develop Dataplex data quality rules and automate validation checks (missing data, delays, anomalies)
Configure pipeline monitoring, alerting, and observability dashboards for SLA compliance and data reliability
Enable and publish governed data products aligned with business use cases
Automate infrastructure and governance using Pulumi or Terraform
Produce low-level architecture designs and reusable governance patterns ("rinse & repeat”)
Required Skills & Experience:
Strong experience with GCP (BigQuery, Composer, GCS, Dataplex)
Hands-on expertise in data governance (RBAC, classification, data security)
Proficiency in SQL and Python
Experience with IaC tools (Pulumi or Terraform)
Familiarity with data quality frameworks and observability
GCP Dataplex Engineer · Epsilon Solutions LTD