TC
Cloud Data Engineer
TechDigital Corporation
Location not stated
Remote
Manager or above
11 months ago
- Azure Data Factory
- Snowflake
- Databricks
- Python
- PySpark
- ETL
- SQL
- Azure Cloud
- Logic Apps
- SSIS
- T-SQL
- XML
- JSON
- Agile
- Data Architecture
11 months ago
Skills Used - ADF, Databricks, Python/ Pyspark, SQL, Snowflake
Minimum of 5+ years of experience as a Cloud Data Engineer.
Hands-on experience with Azure Cloud data tools (ADF, SHIR, Logic Apps, ADLS Gen2, Blob Storage) and Snowflake.
Strong experience in ETL development using SQLServer, SSIS, and T-SQL.
Key Responsibilities
Analyze and organize raw data from diverse sources, including healthcare datasets.
Design and implement ETL pipelines using Azure Data Factory.
Develop and optimize SQL queries, stored procedures, and data models in Snowflake.
Parse and flatten semi-structured data (XML, JSON) using Snowflake and SQL.
Build scalable data systems and pipelines to support analytics andreporting.
Migrate on-premise data workloads to cloud platforms, preferably Snowflake.
Work with Databricks using PySpark, SparkSQL, and Python for data transformation.
Ensure data quality through profiling, validation, and adherence to governance standards.
Collaborate in Agile development environments and contribute to continuous improvement.
Identify opportunities to enhance data architecture and storageefficiency.
Cloud Data Engineer · TechDigital Corporation