VS
Data Engineer
Veracity Software Inc
πΊπΈ United States
On-site
Mid level
11 months ago
- AI
- ETL
- Data Architecture
- ELT
- Snowflake
- Redshift
- AWS
- Athena
- Step Functions
- Python
- SQL
- Devops
- CI/CD
- Azure
- GCP
- Data Modeling
- Hadoop
- Flink
- NoSQL
- Airflow
- dbt
- AWS Glue
11 months ago
Location: Ridgefield, Connecticut, United States
Work Arrangement: Flexible work-from-home days (onsite 2β3x per week)
Openings: 2
Step into the future with ourEnterprise Data, AI & Platforms (EDP) team! At our company, we harnessData & AI to transform healthcare, positively impacting the lives of millions of patients and animals. As part of the EDP team, you will contribute to building astrong data-driven culture, drivekey data transformation initiatives, and shape thefuture of decision-making across our global organization.
We are seeking ahighly skilled and experienced Data Engineer todesign, build, and maintain scalable data infrastructure on a cloud platform. You will be responsible fordata pipelines, ETL processes, and overall data architecture strategy, ensuringdata availability, quality, and integrity for business stakeholders and analytics teams.
Key Responsibilities:
- Design, develop, and maintainscalable data pipelines andETL/ELT processes.
- Collaborate withdata architects, modelers, IT, and business stakeholders to define and evolve cloud-based data architecture.
- Optimizedata storage solutions (e.g., S3, Snowflake, Redshift), ensuringdata integrity, security, and accessibility.
- Implementdata quality, validation processes, and monitoring frameworks.
- Maintaindocumentation for data workflows, architecture, and pipeline processes.
- Troubleshoot and optimizedata pipeline performance.
- Engage with clients and stakeholders toanalyze requirements and recommend data solutions.
- Stay current withemerging technologies and industry trends in cloud and data engineering.
Data Engineer:
- Associate degree in Computer Science/MIS (4+ years experience) or Bachelor's (2+ years) or Master's (1+ year) in related field.
- Hands-on experience withAWS services (Glue, Lambda, Athena, Step Functions, Lake Formation).
- Proficiency inPython and SQL.
- Familiarity withDevOps/CI/CD principles and project lifecycle methodologies.
- Moderate knowledge ofcloud platforms (AWS, Azure, GCP) anddata integration concepts.
- Associate degree (8+ years experience) or Bachelor's (4+ years) or Master's (2+ years) in relevant field.
- Expert-level experience incloud platforms, preferably AWS.
- AdvancedSQL skills, data modeling, anddata warehousing concepts (Kimball, star/snowflake schemas).
- Experience withbig data frameworks (Spark, Hadoop, Flink) andrelational/NoSQL databases.
- Hands-on experience withETL/ELT tools (Airflow, dbt, AWS Glue).
- Knowledge ofDevOps/CI/CD for data solutions.
- 4+ years of progressivedata engineering experience with cloud-based data platforms.
- Understanding ofdata governance, data quality, and metadata management.
- Familiarity withSnowflake and dbt (data build tool).
- Strongproblem-solving skills in pipeline troubleshooting and optimization.
- AWS Solutions Architect certification is a plus.
- AWS services: Glue, Lambda, Athena, Step Functions, Lake Formation
- Programming Languages: Python, SQL
Data Engineer Β· Veracity Software Inc