AL
Full Stack Data Engineer
Artech LLC
- ๐บ๐ธ United States
- On-site
- Mid level
- 2 weeks ago
- GCP
- SQL
- Java
- Python
- BigQuery
- Dataflow
- Microservices
- PostgreSQL
- MySQL
- NoSQL
- CI/CD
- IaC
- Terraform
- Cloud Run
2 weeks ago
Introduction
We're seeking a highly skilled and experienced professional to play a pivotal role in the development and maintenance of our Enterprise Data Platform. In this role, you'll be responsible for designing, building, and optimizing scalable data pipelines within our Google Cloud Platform (GCP) environment. This is a fantastic opportunity to leverage your full-stack expertise, collaborate with talented teams, and establish best practices for data engineering.
Required Skills & Qualifications
- Bachelor's degree in Computer Science, Information Technology, Information Systems, Data Analytics, or a related field (or equivalent combination of education and experience).
- 5-7 years of experience in Data Engineering or Software Engineering, with at least 2 years of hands-on experience building and deploying cloud-based data platforms (GCP preferred).
- Strong proficiency in SQL, Java, and Python, with practical experience in designing and deploying cloud-based data pipelines using GCP services like BigQuery, Dataflow, and DataProc.
- Solid understanding of Service-Oriented Architecture (SOA) and microservices, and their application within a cloud data platform.
- Experience with relational databases (e.g., PostgreSQL, MySQL), NoSQL databases, and columnar databases (e.g., BigQuery).
- Knowledge of data governance frameworks, data encryption, and data masking techniques in cloud environments.
- Familiarity with CI/CD pipelines, Infrastructure as Code (IaC) tools like Terraform and Tekton, and other automation frameworks.
- Excellent analytical and problem-solving skills, with the ability to troubleshoot complex data platform and microservices issues.
- Passion for data, innovation, and continuous learning.
- Applicants must be able to work directly for Artech on W2
Preferred Skills & Qualifications
- Master's Degree
- Experience in monitoring and optimizing cost and compute resources for processes in GCP technologies (e.g., BigQuery, Dataflow, Cloud Run, DataProc).
- Prior work experience in the industry.
Day-to-Day Responsibilities
- Collaborate with business and technology stakeholders to understand current and future data requirements.
- Design, build, and maintain reliable, efficient, and scalable data infrastructure for data collection, storage, transformation, and analysis.
- Plan, design, build, and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow.
- Design, implement, and maintain existing and future data platforms like data warehouses, data lakes, data lakehouse, etc., for structured and unstructured data.
- Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks.
- Ensure optimum performance and identify improvement opportunities.
For immediate consideration please click APPLY to begin the screening process with Alex.
Full Stack Data Engineer ยท Artech LLC