Azure Databricks Data Engineer

Job Requirements

• Location: Louisville, KY

• Duration: 6 months

• Experience Required: 8–10 years

• Role: Databricks / Azure Data Engineer

Must-Have Technical & Functional Skills

• Experience developing and implementingdata pipelines using Azure Data Factory (ADF).

• Experience ingesting data from multiple sources usingAzure ADF.

• Experience transforming data usingAzure Databricks and Delta Lake.

• Experience withAzure DevOps for CI/CD, including:

  • Stories

  • Bugs

  • Issue management

• Experience implementingPrefect.

• Strong hands-on experience withDatabricks.

• Experience working withMicrosoft Azure integration solutions.

Roles & Responsibilities

• Work onAgile development projects and participate in sprint delivery.

• Design and implementdata integration solutions in Microsoft Azure.

• Develop and maintain data pipelines usingAzure Data Factory.

• Ingest data from various source systems into Azure.

• Perform data transformations usingAzure Databricks and Delta Lake.

• Implement and maintain workflows usingPrefect.

• Performdata analysis and troubleshooting for data-related issues.

• Assist in identifying and resolving data quality and pipeline issues.

• Collaborate with development teams to supportCI/CD processes using Azure DevOps.

• Act as anindividual contributor and problem solver.

• Participate in Agile ceremonies, sprint planning, and delivery activities.

Generic Managerial / Agile Skills

• Experience working inAgile development environments.

• Experience withsprint planning and sprint delivery.

• Strong analytical and problem-solving skills.

• Ability to work independently as anindividual contributor.

Role Details

• Role Description: Databricks

• Essential Skill: Databricks

• Desirable Skills: Not specified

• Keyword: Databricks

• Skill Category: Digital – Databricks