TC
Data Engineer
TechDigital Corporation
- 🇺🇸 United States
- Remote
- 10 months ago
- ETL
- ELT
- Azure Data Factory
- Databricks
- PySpark
- SQL
- Azure Cloud
- Azure SQL
- Python
- Unit Testing
10 months ago
8+ years of experience.
- Design and develop ETL/ELT pipelines usingAzure Data Factory (ADF) and Databricks (PySpark).
- Build and manageAPI integrations for data exchange between systems.
- Write and optimizeSQL queries and stored procedures for data transformation and analysis.
- Implement Azure cloud services, including Azure Data Lake, Azure SQL Database
- DevelopPython-based data processing solutions for automation and orchestration.
- Monitor, troubleshoot, and optimize data workflows and pipelines.
- Ensure data security, governance, and compliance with industry standards.
- Undertake Unit testing making full utilization of automation tools available and working with the system test team to ensure tests are integrated as
- part of the overall test plan.
- Good multi-tasking and flexibility to stretch when situation demands.
Data Engineer · TechDigital Corporation