Databricks Platform Admin

Role: Databricks Platform Administrator

Location: St. Louis (Hybrid – 3 days onsite/week)
Duration: Contract
Rate: $60–$63/hour on W2 (No C2C – Candidate will be on Infoway Software Solutions W2)
Experience: 10+ Years
Openings: 2

Note: Only candidateslocal to St. Louis or willing to relocate will be considered.

Job Description

Key Responsibilities

• Design, deploy, and managescalable and secure Azure Databricks platforms.

• Create and manageDatabricks workspaces and clusters, including cluster lifecycle management and resource optimization.

• Automate infrastructure provisioning usingInfrastructure as Code tools such asTerraform, GitLab CI/CD, and scripting (Python/Bash/PowerShell).

• Monitor platform health, performance, and cost using dashboards and monitoring tools.

• Troubleshoot cluster configuration issues, job failures, and performance bottlenecks inDatabricks environments.

• Collaborate withdata scientists, ML engineers, and product teams to deploy and maintaindata pipelines on Databricks.

• Implement security and governance usingUnity Catalog, access controls, and compliance policies.

• Optimize compute and storage performance usingDelta Lake and Photon.

• Document platform architecture, troubleshooting guides, and best practices.

• Mentor junior engineers on Databricks platform usage and optimization.

• Work with architects and stakeholders to design platform solutions based on business requirements.

• Coordinate with offshore teams and customer stakeholders to ensure timely delivery.

Required Skills

• Strong hands-on experience withAzure Databricks Platform administration.

• Experience withAzure Data Lake (ADLS) and Azure cloud architecture.

• Expertise incluster management and Unity Catalog governance.

• Experience withInfrastructure as Code tools such asTerraform.

• Hands-on withCLI tools and scripting (Azure CLI, Databricks CLI, PowerShell, Bash, SQL).

• Experience building and maintainingCI/CD pipelines using Git-based tools.

• Experience optimizingdata platforms and data pipelines.

Preferred Skills

• Experience withdata ingestion and ETL tools such as:

  • Qlik Replicate

  • Qlik Compose

  • Kafka

  • Matillion ELT

  • Snowflake

• Experience working inAgile development environments.

• Strong communication and leadership skills.