MI
Lead Data Engineer
MetaSense Inc
- Location not stated
- Hybrid
- Staff / Principal
- 3 hours ago
- GCP
- BigQuery
- ETL
- ELT
- Pub/Sub
- Airflow
- Composer
- CI/CD
- GitHub Actions
- Data Visualization
- Looker
- Data Modeling
- Cloud SQL
- Vertex AI
- Python
- PostgreSQL
- Microservices
3 hours ago
Below is the job description for your reference..!!
Position Details:
Client:Healthcare Client
Job Title: Lead Data Engineer
Location: Dallas, TX (Hybrid)
Job Summary: We are looking for anexperienced Lead Data Engineer to guide and mentor the data engineering team, oversee technical delivery, and drive best practices in building scalable, secure, and reliable cloud-based data solutions. The ideal candidate will have strong expertise inGoogle Cloud Platform (GCP) services,BigQuery, anddata pipeline development, along with leadership experience in managing data engineering projects.
Key Responsibilities:
- Lead the design, development, and deployment ofdata pipelines and data integration frameworks on GCP.
- Provide technical leadership, mentorship, and hands-on guidance to the data engineering team.
- Architect and optimizeETL/ELT processes for both batch and real-time data ingestion.
- Implement scalable data processing solutions usingBigQuery, DataProc, and Pub/Sub.
- Oversee and manageworkflow orchestration usingAirflow Composer.
- Drivedata quality, performance optimization, and automation initiatives across the platform.
- Collaborate closely with cross-functional teams (Data Scientists, BI Developers, Cloud Architects) to deliver end-to-end solutions.
- Manage version control and CI/CD processes usingGitHub Actions.
- Support data visualization and reporting initiatives usingGoogle Looker (data modeling and dashboard development).
- Ensure compliance, data governance, and security standards in all data operations.
- Coordinate with stakeholders to translate business needs into scalable data solutions.
Required Skills & Qualifications:
- 12+ years of total experience in Data Engineering, with at least3 years on GCP.
- Proven experience inleading or mentoring technical teams.
- Strong hands-on expertise in:
- Google Cloud Platform (GCP) – BigQuery, Cloud Storage, Cloud SQL, DataProc, Pub/Sub, Vertex AI, Airflow Composer.
- Programming/Scripting: Python (Advanced), Shell scripting.
- Data Modeling, ETL, and Data Pipeline Development (batch and real-time).
- Experience withGitHub Actions or similar CI/CD pipelines.
- Working knowledge ofPostgres DB andGoogle Looker for BI and analytics.
- Excellent analytical, communication, and problem-solving skills.
Preferred Qualifications:
- Prior experience working withHealthcare or in thehealthcare insurance domain.
- Understanding ofmicroservices architecture andAPI integrations.
- Familiarity withdata governance, metadata management, anddata cataloging tools.
Key Attributes:
- Strong leadership and team collaboration abilities.
- Hands-on problem solver with a focus on delivery excellence.
- Strategic thinker who can balance technical depth with business priorities.
Lead Data Engineer · MetaSense Inc