Azure Databricks Data Engineer

Our Client, an IT Services and Consultant company, is looking for an Azure Databricks Data Engineer for their Fort Worth, TX / Tempe, AZ / Hybrid location.
 
Responsibilities:

• Design, develop, and maintain scalable data pipelines using Azure Databricks and Python.
• Build and optimize ETL/ELT workflows for structured and unstructured data.
• Develop high-performance data processing solutions using Py Spark and Spark SQL.
• Design and implement data lake architecture leveraging Delta Lake.
• Create and manage data ingestion frameworks from multiple enterprise sources.
• Implement data quality, validation, governance, and monitoring mechanisms.
• Must have hands on experience using Gen AI tools like GitHub CoPilot
• Optimize Databricks jobs, clusters, notebooks, and workflows for performance and cost efficiency.
• Collaborate with business analysts, data scientists, architects, and application teams to deliver enterprise data solutions.
• Support batch and near real-time data processing requirements.
• Participate in architecture discussions, code reviews, and best-practice implementation.
• Ensure secure, scalable, and reliable cloud data solutions aligned with organizational standards.

• Primary Skills (Must Have):
• Azure Databricks
• Python
• Py Spark
• Delta Lake
• Spark SQL
• Data Engineering
• ETL/ELT Development
• Azure Data Lake Storage (ADLS Gen2)
• SQL
• Azure Platform Skills
• Azure Databricks
• Azure Data Factory (ADF)
• Azure Storage Accounts
• Azure Key Vault
• Azure Monitor
• Azure App Insights
• Azure Networking Concepts
• Secondary Skills:
• Data Modeling (Star Schema, Snowflake Schema)
• DataWarehousing Concepts
• Performance Tuning and Optimization
• REST API Integration
• NoSQL Databases
• Azure Synapse Analytics
• Years of Experience:  
• 7-9 Years of Experience

• Health Benefits
• Referral Program
• Excellent growth and advancement opportunities