Senior Data Engineer

TechDigital Corporation

🇺🇸 United States

On-site

Senior

7 months ago

Databricks
Python
ETL
Devops
Delta Lake
ELT
CI/CD
Azure Data Factory
SQL
IaC

7 months ago

Auto apply with Likeremote

Not scoredNo CV on file. Upload one and this job gets a score out of 100.Upload CV

The Senior Data Engineer will design, build, and optimize scalable data pipelines and solutions leveragingDatabricks,Python, ETL, DevOps. This role requires strong experience in cloud-based data platforms and advanced data engineering practices to support analytics and business intelligence initiatives.

Key Responsibilities

Architect and implementdata pipelines usingDatabricks andDelta Lake for batch and streaming data.
Develop and maintainETL/ELT workflows integrating diverse data sources into cloud data lakes and warehouses.
Implementdata governance, security, and compliance standards.
Automate workflows usingPython scripting and CI/CD pipelines.
Troubleshoot and resolve issues in data ingestion, transformation, and storage.

Required Skills & Experience

8+ years in data engineering or related roles.
Expert-level Python programming for data processing and automation.
Hands-on experience withDatabricks andDelta Lake.
Strong knowledge ofAzure Data Factory,Data Lake, andSynapse (or equivalent cloud platforms).
Proficiency inSQL and performance tuning.
Familiarity withDevOps practices, CI/CD, and infrastructure-as-code tools.
Experience withdata migration andcloud-native architectures.
Excellent problem-solving and communication skills

Senior Data Engineer · TechDigital Corporation

Auto apply with Likeremote