Databricks Data Engineer (Data & AI)

Join us. But be you. At Deloitte, you’ll do more than just join something, you’ll add something.  You’ve found a place that values your curiosity, passion, and desire to work alongside brilliant people on the things that really matter. There really is only one question: What impact do YOU want to make?

We are looking for an experienced and motivatedDatabricks Data Engineer to join our growing AI & Data Engineering team.

This role is ideal for someone who is passionate about modern data engineering, enjoys solving complex business and technical challenges, and is keen to embraceAI-assisted engineering practices to deliver solutions faster and smarter.

As aDatabricks Data Engineer in Deloitte, you will design, build, and maintain scalable data and AI solutions usingDatabricks. You will have the opportunity to work across the full engineering lifecycle, from data ingestion and transformation through to modelling, orchestration, deployment, optimisation, and production support as well as leverage the wider capabilities that Databricks offers with Lakebase, Unity Catalog, Databricks Apps etc.

YourAI-enabled engineering mindset will help you leverageGenie Code, GitHub Copilot, and other AI development tools to accelerate delivery while maintaining strong engineering, security, and quality standards.

Key Responsibilities

• Design, develop, and maintain scalable data and AI solutions onDatabricks.
• Build robustdata ingestion, ELT/ETL, and data processing pipelines using Databricks.
• Develop high-quality and reusabletransformations throughLakeflow Declarative Pipelines.
• Design and implementLakehouse architectures.
• Build dimensional, curated, and feature-ready data models to support reporting, analytics, machine learning, and Generative AI use cases.
• Develop and maintain integrations between Databricks and cloud platforms, APIs, databases, files, streaming platforms, and enterprise applications.
• Implement automatedCI/CD pipelines and modern DevOps practices for Databricks deployments.
• Develop and orchestrate workloads usingLakeflow Jobs, Azure Data Factory, Airflow, or similar technologies.
• Implement appropriatesecurity, governance, data quality, lineage, and monitoring controls.
• Optimise Databricks workloads forperformance, scalability, reliability, and cost efficiency.
• Troubleshoot complex platform, pipeline issues across development and production environments.
• Collaborate with architects, analysts, data scientists, ML engineers, and business stakeholders to translate requirements into practical technical solutions.
• Contribute to engineering standards, reusable frameworks, technical documentation, and continuous improvement initiatives.
• Proactively leverageGenie Code, GitHub Copilot, and other AI-powered development tools across solution design, coding, testing, troubleshooting, code review, and documentation.
• Identify opportunities to useAI and automation to reduce repetitive engineering effort and accelerate the development lifecycle.

Required Experience

• Strong hands-on experience withDatabricks.
• Experience designing and building modernLakehouse architectures.
• Strong understanding of data engineering, data modelling, data warehousing, and distributed processing concepts.
• Experience building batch and/or streaming data pipelines.
• Experience with orchestration technologies such asLakeflow Jobs,Azure Data Factory, Airflow, or similar tools.
• Understanding of cloud data services acrossAzure and/or AWS.
• Experience withGit, CI/CD, and modern software engineering practices.
• Experience usingPython in data engineering solutions are advantageous.
• Familiarity with infrastructure-as-code technologies such as Terraform or similar.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and stakeholder engagement skills.

Preferred Experience

• Experience withGenerative AI, Machine Learning, or MLOps on Databricks.
• Experience withDatabricks Declarative Automation Bundles
• Databricks certifications such as:
  • Databricks Certified Data Engineer Associate
  • Databricks Certified Data Engineer Professional

AI-Assisted Engineering

• AnAI-enabled engineering mindset, proactively using tools such as Genie Code, Claude, GitHub Copilot, and other AI capabilities to accelerate development, automate repetitive tasks, improve code quality, and deliver solutions more efficiently.
• Good judgement when using AI-generated outputs, with a strong focus onsecurity, maintainability, accuracy, and engineering quality.

What Success Looks Like

You are someone who can take ownership of a data engineering problem fromdesign through to production.

You care about building solutions that are not only functional, but alsoscalable, maintainable, secure, automated, and well engineered.

You are comfortable working across the broader cloud, data, analytics, and AI ecosystem and are always looking for better ways of working through reusable patterns, automation, and effective use of AI-assisted development tools.

Most importantly, you combine strong technical capability with adelivery-focused and continuous-improvement mindset.

Why Join Us?

You will have the opportunity to:

• Work on exciting project for some of New Zealand’s best companies.
• Work on modern, enterprise-scaleDatabricks Lakehouse platforms.
• Deliver solutions acrossData Engineering, Analytics, AI, Machine Learning, and Generative AI.
• Solve complex, real-world data engineering challenges.
• Develop experience with modern engineering andAI-assisted development practices.
• Work alongside experienced data engineers, architects, platform specialists, and technology leaders.
• Contribute to reusable frameworks, accelerators, and engineering practices that improve how we deliver modern data platforms.

If you are passionate aboutDatabricks, modern data engineering, AI, and building Lakehouse solutions at scale, we would love to hear from you.

So, who is Deloitte in Aotearoa?  

We are driven to create an impact that matters at every opportunity. Supported by a strong leadership team and member firms from over 150 countries across the globe, Deloitte in Aotearoa is in the business of solving complex problems. Over our 175-year history, we have built a reputation for impactful delivery across all areas of our business. 

Deloitte in Aotearoa recognises the uniqueness of our country identified in our founding document, Te Tiriti o Waitangi.  We uphold our responsibility(s) to the founding document and acknowledge Māori as the Tangata Whenua/Indigenous people.  

Our shared values are at the heart of everything we do. Living these values, including ‘Manaaki/taking care of each other’ and ‘Hāpai tangata/fostering inclusion’, is essential to ensuring everyone feels included at work and able to reach their full potential. Our values drive our desire to create positive outcomes for our clients, communities, and people. 

Deloitte Talent Experience  

We hold a simple belief – that our people’s hard work should be recognised and rewarded beyond their remuneration. We have reimagined what ‘work’ looks like and how we can empower all our people to create a work experience that is distinct to their needs. Founded on concepts of trust, balance, wellbeing, and the importance of personal connection, this is the Deloitte experience.  

We offer:  

•  Flexible work arrangements – work in a way that suits you, us and our clients best  
•  Subsidised professional qualifications and paid professional memberships  
•  Subsidised health insurance  
•  Income protection insurance  
•  22 days annual leave  
•  Social events, social sports teams, and monthly firm drinks  
•  A focus on wellness and well-being   
•  Community focused volunteer days  
•  A focus on the environment and sustainability  

We believe the strongest teams are made up of diverse individuals and we are proud to be an equal opportunities employer. We recognise that women and individuals from under-represented backgrounds may hesitate to apply if they don't meet all criteria. If you're passionate about this role and believe you have the skills, we encourage you to apply, even if your experience, ideal working hours or qualifications aren't a perfect match.

Please be aware of phishing attempts posing as Deloitte recruiters. Official communications from Deloitte New Zealand will come from “@deloitte.co.nz,” “@smartrecruiters.com,” or our video interview platform Deloitte<interviews@hirevue.com>. If you receive a suspicious email, verify its authenticity by contacting us at NZinfo@deloitte.co.nz.