Data Engineer

Design and implement data storage solutions

•Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.

•Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure Create data models for analytics purposes

•Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations

•Use Azure Data Factory and Databricks to assemble large, complex data sets

•Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.

•Ensure data security and compliance

•Optimize Azure SQL databases for efficient query performance

•Collaborate with data engineers, and other stakeholders to understand requirements and translate them into scalable and reliable data platform architectures

•Participate in all scrum ceremonies

•Required skills:

•Blend of technical expertise, analytical problem-solving, and collaboration with cross-functional teams

•Azure DevOps

•Apache Spark, Python

•SQL proficiency

•Data modeling

•ETL processes

•Azure Databricks knowledge

•Familiarity with data warehousing

•Big data technologies

•Data governance principles