EI
Databricks Admin
Echo IT Solutions, Inc
๐บ๐ธ United States
On-site
2 months ago
- Databricks
- Secrets Management
- Unity Catalog
- CI/CD
- IaC
- Configuration Management
- Delta Lake
- Azure Cloud
- SCIM
- RBAC
- VPC
- DNS
- Python
- PowerShell
- Bash
- Terraform
- Incident Response
- Logic Apps
2 months ago
Key Responsibilities
- Administer and support the Databricks workspace environment across development, test, and production.
- Manage user provisioning, role-based access controls, service principles, groups, and entitlements.
- Configure and maintain cluster policies, instance pools, job compute, and all-purpose compute resources.
- Monitor platform health, job performance, usage trends, and operational incidents.
- Implement security controls for secrets management, data access, encryption, private connectivity, and audit logging.
- Support Unity Catalog, data governance standards, and workspace-level administration.
- Develop and maintain automation for workspace setup, policy enforcement, monitoring, and administrative tasks.
- Support CI/CD and infrastructure-as-code practices for Databricks deployments and configuration management.
- Troubleshoot platform, connectivity, identity federation, and job execution issues.
- Create and maintain operational documentation, runbooks, standards, and support procedures.
- Understanding data engineering workflows using Spark, notebooks, Delta Lake, and job scheduling.
Required Qualifications
- Experience with Azure Cloud.
- Strong understanding of identity and access management, including SSO, SCIM, RBAC, and service principals.
- Experience with Databricks cluster management, workspace administration, job orchestration, and governance controls.
- Knowledge of networking concepts such as VNet/VPC, private endpoints, firewalls, DNS, and secure connectivity.
- Experience with scripting or automation using Python, PowerShell, Bash, Terraform, or similar tools.
- Familiarity with monitoring, logging, alerting, and incident response processes.
- Strong troubleshooting, communication, and cross-functional collaboration skills.
Key Skills
- Databricks Workspace Administration
- Unity Catalog and Governance
- Cluster Policies and Performance Tuning
- Cloud Platform Integration
- Security and Access Management
- Automation and Infrastructure as Code
- Cost Optimization
- Troubleshooting and Operational Support
- Documentation and Cross-Functional Collaboration
- Logic Apps, APIM, App Gateways
Databricks Admin ยท Echo IT Solutions, Inc