EI
Sr. Data Engineer
Expert In Recruitment Solutions
🇺🇸 United States
On-site
Senior
8 months ago
- GCP
- BigQuery
- Dataflow
- Terraform
- IaC
- PostgreSQL
- Oracle
- NoSQL
- MongoDB
- Python
- Data Modeling
- DLP
8 months ago
Key Requirements
- Experience & Education:
- 5-6 years of experience as a Data Engineer or in a comparable Business Intelligence role.
- Bachelor of Science in Information Technology, Computer Science, or a related technical field.
- Cloud & Pipeline Expertise (Required):
- Proficiency with GCP (Google Cloud Platform) offering is required
- Expertise in designing and building large-scale, automated data pipelines using GCP native services (e.g., BigQuery, Dataflow, Dataproc).
- Experience with Terraform to create and maintain intermediate to advanced infrastructure-as-code scripts is a plus
- Database & Coding Skills:
- 4-5 years minimum experience with relational databases ( MS-SQL, Postgres, or Oracle).
- 3-4 years of experience with NoSQL databases ( Capella or MongoDB).
- 2-3 years of experience with Python or a similar language.
- Ability to work with multi-statement complex queries and enhance performance/troubleshoot issues.
- Architecture & Governance:
- Proven ability to make key architectural decisions related to data modeling, storage, and real-time processing.
- Experience assisting with data governance, quality, and lineage practices using tools like Data Catalog, DLP, or Cloud Audit Logs.
- Experience translating business requirements into technical design documents.
- Work Schedule & Location:
- Full-time onsite commitment required (Monday-Friday, 8a-5p), with remote flexibility for Fridays pending manager approval.
- Desired Experience (Bonus):
- Experience in the logistics or transportation industry (1-3 years).
- Proven ability to mentor junior engineers and provide technical guidance.
- Experience with monitoring and optimizing GCP resources for cost management.
· Design and build large-scale automated and cost-efficient data pipelines that are integrated across multi-platform and disparate data sources using GCP native services (e.g., BigQuery, Dataflow, Dataproc)
· Make key architectural decisions related to data modeling, storage, real-time processing, and orchestration
· Work with multi statement complex queries and enhance performance or able to troubleshoot issues related to performance
· Implement scalable, reusable and efficient data frameworks that ensure data quality, data integrity and performance consistently
· Assist in establishing data governance, quality, and lineage practices using tools like Data Catalog, Data Loss Prevention (DLP), or Cloud Audit Logs.
· Creates and maintains intermediate to advanced terraform scripts
· Mentor junior and mid-level engineers, conduct code reviews, and provide technical guidance on best practices
· Translate business requirements into technical design documents and implementation plans
· Participate in support rotation and proactively identify issues while implementing issue resolutions as appropriate.
ADDITIONAL DESIRED DUTIES/RESPONSIBILITIES:
· Monitor and optimize GCP resources to manage costs effectively
· Stay updated with latest GCP services and features
· Evaluate and recommend new tools and technologies to improve data engineering practices
Sr. Data Engineer · Expert In Recruitment Solutions