Senior Databricks Platform Engineer

CirrusLabs

Location not stated

Hybrid

Senior

4 months ago

Databricks
Azure Cloud
Devops
Azure
AKS
GitHub
CI/CD
Delta Lake
Unity Catalog
Azure DevOps
IaC
RBAC
PySpark
Python
SQL
Scala
Kubernetes
Terraform
Bicep
Azure Monitor
Datadog
ETL
AI

4 months ago

Auto apply with Likeremote

Not scoredNo CV on file. Upload one and this job gets a score out of 100.Upload CV

We areCirrusLabs. Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our customers, partners and community. Our goal is to enable employees to dream, grow and make things happen. We are committed to excellence. We are a dependable partner organization that delivers on commitments. We strive to maintain integrity with our employees and customers. Every action we take is driven by value. The core of who we are is through our well-knit teams and employees. You are the core of a values driven organization.

You have an entrepreneurial spirit. You enjoy working as a part of well-knit teams. You value the team over the individual. You welcome diversity at work and within the greater community. You aren't afraid to take risks. You appreciate a growth path with your leadership team that journeys how you can grow inside and outside of the organization. You thrive upon continuing education programs that your company sponsors to strengthen your skills and for you to become a thought leader ahead of the industry curve.

You are excited about creating change because your skills can help the greater good of every customer, industry and community. We are hiring a talented<Job Title>to join our team. If you're excited to be part of a winning team, CirrusLabs (http://www.cirruslabs.io) is a great place to grow your career.

Role: Senior Databricks Platform Engineer – Azure Cloud & Data Operations
Location: Remote – United States
Engagement Type: Long-Term Enterprise Consulting Engagement
Domain Focus: Databricks, Azure Cloud, Enterprise Data Platforms, Platform Engineering, DevOps Enablement

About the Opportunity
Our client is undergoing a large-scale enterprise modernization initiative focused onAzure-native infrastructure, platform engineering, automation, and modernization of data-intensive application ecosystems.
As part of this transformation, multiple calculation-heavy and operationally critical applications are being integrated into a growingDatabricks-centered enterprise data platform spanning:

Azure cloud services
AKS and containerized platforms
GitHub andCI/CD ecosystems
enterprise automation and analytics environments

We are seeking aSenior Databricks Platform Engineer to support architecture, operational engineering, platform enablement, and modernization activities across this evolving environment.
This role blends:

Databricks platform expertise
cloud infrastructure awareness
DevOps-aligned engineering
operational platform support

The ideal candidate understands how Databricks workloads, APIs, pipelines, storage layers, and operational processes integrate within broader enterprise cloud ecosystems.

Role Overview
The Senior Databricks Platform Engineer will support the design, operational enablement, modernization, and ongoing support of enterpriseDatabricks platforms and associated data processing environments.
This engineer will work closely with:

cloud platform teams
DevOps organizations
infrastructure engineering teams
application modernization groups
data and analytics stakeholders

The role requires strong awareness of how Databricks modernization activities impact:

existingCI/CD pipelines
automation frameworks
operational governance
enterprise cloud platform standards

Key Responsibilities
Databricks Platform Engineering & Operations

Support architecture and operational engineering across enterpriseDatabricks environments
Design and maintain scalableLakehouse,Delta Lake, andUnity Catalog solutions
Support administration of:
- Databricks Workspaces
- Jobs
- Notebooks
- Clusters
OptimizeSpark workloads, cluster configurations, and platform performance
Support batch and streaming data processing workloads
Assist with multi-environment platform management across Dev, QA, and Production

Platform Integration & DevOps Alignment

Support integration ofDatabricks platforms with Azure-native ecosystems and enterprise applications
Work across integrations involving:
- APIs
- Azure Storage Accounts
- Data Lakes
- reporting and analytics platforms
Collaborate with platform and DevOps teams to align Databricks activities with existingCI/CD and automation standards
Support deployment workflows utilizing:
- GitHub
- Azure DevOps
- Infrastructure as Code frameworks
Help ensure modernization activities do not disrupt existing automated deployment pipelines and operational processes

Governance, Reliability & Platform Support

Support governance, access management, monitoring, logging, and operational security practices
Assist with implementation of:
- RBAC
- lineage
- encryption
- platform governance controls
Participate in troubleshooting, operational support, and root cause analysis activities
Contribute to documentation, operational standards, and platform best practices

Required Qualifications

6+ years of experience within cloud, platform engineering, data engineering, or enterprise analytics ecosystems
3+ years of hands-on experience supporting enterpriseDatabricks environments
Strong experience with:
- Delta Lake
- Unity Catalog
- Spark workloads
- cluster operations
- Databricks Workspaces
Experience withAzure cloud services and cloud-native platform concepts
Familiarity with:
- Azure DevOps
- GitHub workflows
- CI/CD pipeline concepts
- deployment automation
Experience supporting APIs, distributed application integrations, and enterprise data platforms
Strong troubleshooting and operational support capabilities
Strong communication and stakeholder collaboration skills

Preferred Qualifications

Experience with:
- PySpark
- Python
- SQL
- Spark SQL
- Scala
Familiarity with:
- AKS/Kubernetes
- Terraform
- Bicep
- Infrastructure as Code practices
Experience with:
- Azure Data Lake
- Event Hub
- streaming architectures
- enterprise analytics environments
Familiarity with monitoring and observability platforms such as:
- Azure Monitor
- Datadog
Exposure to enterprise modernization and cloud migration initiatives

What This Role Is

A hands-on enterpriseDatabricks platform engineering role
A modernization-focused engineering opportunity within a large Azure ecosystem
A hybrid role spanning cloud integration, operational engineering, and DevOps-aware platform support
A collaborative engineering role supporting scalable enterprise data and analytics platforms

What This Role Is Not

A pure data scientist or analytics-only role
A narrowly scoped ETL development position
A traditional infrastructure administration role
A short-term migration-only engagement

Why Work With Us
You will be joining a globally recognized consulting and technology organization supporting enterprise-scale transformation initiatives across:

Azure cloud platforms
platform engineering
DevOps and automation
large-scale data modernization
analytics and AI-enabled ecosystems

This role provides the opportunity to help shape and support modern enterprise data platform operations within a highly collaborative global engineering environment.

Senior Databricks Platform Engineer · CirrusLabs

Auto apply with Likeremote