ES
Data Engineer
Epsilon Solutions LTD
🇨🇦 Canada
On-site
4 weeks ago
- Debezium
- GCP
- Pub/Sub
- Dataflow
- Cloud SQL
- PostgreSQL
- CRM
- Incident Management
- Java
- triage
4 weeks ago
Location: Toronto, hybrid
Duration: Contract
JOB DESCRIPTION:
Position: Data Engineer at C1 level
Job Description
• 6–8+ years of experience in supporting and managing data pipelines in production (L1/L2 support)
• Experience in Data Collection flows using CDC tools (e.g., Debezium) and file-based ingestion (CSV)
• Hands-on experience with GCP services including Pub/Sub, Dataflow (Apache Beam), and Datastream
• Experience working with Cloud SQL (PostgreSQL) environments
• Experience in CRM data ingestion and extraction into staging and harmonized data layers
• Understanding of API-based data enrichment within ingestion workflows
• Strong knowledge of production monitoring, alerting, and incident management processes
• Programming experience in Java for pipeline support and enhancements
Roles & Responsibilities
• Provide L1 and L2 operational support for data pipelines across staging and harmonized data layers
• Monitor data ingestion and extraction processes including CDC pipelines and CSV-based feeds, identifying failures, delays, and data inconsistencies
• Perform incident triage and analysis using logs, metrics, Pub/Sub events, and alerts; resolve known issues within SLA boundaries
• Support data enrichment workflows ensuring accurate and timely processing before downstream consumption
• Work with GCP Pub/Sub topics, subscriptions, DLQs, alerts, and scheduled jobs for monitoring and operations
• Support minor enhancements and configuration changes under guidance of senior engineers
• Assist in testing and validation in lower environments and support controlled production deployments
• Handle service requests, including data fixes, reruns, reconciliation, and contributing to RCA for recurring issues
• Perform monitoring and housekeeping activities across GCP components
• Maintain and update runbooks, operational procedures, and known issue documentation
• Continuously identify improvement opportunities for stability, reliability, and operational efficiency
Data Engineer · Epsilon Solutions LTD