Job Description:

We are looking for a Senior Data Engineer with technical skills in data engineering, a deep understanding of data management principles, and the ability to adapt to evolving technologies and industry best practices in data engineering and analytics.

Responsibilities:

Code SQL for both on-premises and Azure SQL environments, including optimizing queries, data manipulation, and ensuring high performance.
Design and build data pipelines from various data sources (mainly databases) to a target Data Warehouse / Lakehouse, using batch data load strategies, and leveraging Microsoft Azure technologies (Data Factory and Databricks).
Implement data validation and quality assurance checks to maintain high data integrity standards, ensuring accurate and reliable data for analytical purposes.
Collaborate with a cross-functional team of business analysts, architects, engineers, data analysts, and key stakeholders to formulate and implement data pipelines.
Participate in architecture discussions, take ownership and responsibility over new projects or requirements, and perform audits to ensure data quality and integrity.
Utilize programming languages, databases & cloud Data Warehouses / Lakehouses.
Document database designs that include data models, metadata, ETL specifications, and process flows for business data project integrations.
Monitor, maintain, and optimize production systems. Investigate and resolve incidents reported by users. Identify opportunities to automate, consolidate, and simplify data solutions at scale.
Define best practices and create coding standards and patterns that can be reused by the rest of the data engineers.

Qualifications

Experience:

5+ years of work experience as a Data Engineer.
Demonstrated strength in data modeling, ETL development, and data warehousing.

Technical skills:

Advanced working SQL knowledge.
Working knowledge of Azure Data Factory (ADF).
Familiarity with NoSQL databases.
Solid understanding of cloud technologies (Microsoft Azure).
Coding proficiency in Python.
Experience with GitHub and CI/CD processes for data pipelines.
Working knowledge and understanding of SDLC.
English Proficiency (B2).
LATAM Based.

Soft skills:

Able to work in a fast-paced, dynamically changing business environment with minimal supervision.
Excellent communication and collaboration skills with a desire to learn and teach.
Excellent understanding of development processes and agile methodologies.
Enthusiastic, highly motivated, and able to learn quickly.

Bonus skills:

Experience with Databricks or similar tools (Spark) is a plus.
Experience with / Understanding of unit testing approaches is a plus.
Experience with data Visualization tools (Microsoft PowerBI) is a plus.

Perks:

Job type: long-term, full-time job.
Fully remote.
USD competitive salary.
20+ Paid time off days.

Upstart 13 remote jobs

Senior Data Engineer (SQL/ ADF)