UT
Databricks Lead # 26-18311
US Tech Solutions, Inc.
🇺🇸 United States
On-site
Staff / Principal
2 months ago
$80 / hour
- Databricks
- AWS S3
- Delta Lake
- Unity Catalog
- PySpark
- Terraform
- GitHub
- CI/CD
- CloudWatch
- AI
- Vector Search
- MLflow
- Airflow
- Kubernetes
- AWS
- VPC
- IAM
- IaC
- Machine Learning
- Jenkins
- FinOps
- Devops
2 months ago
Core Technologies:Databricks, AWS S3, Delta Lake, Unity Catalog, Spark/PySpark, Terraform, GitHub, CI/CD, CloudWatch, Mosaic AI, Genie, Vector Search, MLflow, Kafka, Airflow, Kubernetes.
Requriements:
- Architect and manage a secure, scalable, and highly available Databricks Lakehouse Platform on AWS.
- Design data platforms leveraging AWS S3, Delta Lake, Unity Catalog, and Databricks Workspaces for enterprise analytics and AI.
- Define networking architecture including VPC, PrivateLink, IAM roles, security groups, and encryption standards.
- Establish multi-environment strategies (Dev, Test, UAT, Prod) with automated provisioning through Terraform and Infrastructure as Code (IaC).
- Implement enterprise-wide data governance, lineage, metadata management, and compliance controls using Unity Catalog.
- Design high-performance data ingestion and processing architectures supporting batch, streaming, and real-time analytics workloads.
- Enable AI and GenAI capabilities through Mosaic AI, Vector Search, Model Serving, AI/BI Dashboards, and Genie Spaces.
- Define CI/CD, monitoring, logging, and observability frameworks using GitHub, Jenkins, CloudWatch, and Databricks Workflows.
- Optimize platform performance, reliability, scalability, and cloud costs through FinOps and workload optimization practices.
- Provide architectural leadership and best practices for Lakehouse modernization, advanced analytics, AI governance, and enterprise data platform adoption
- DataBricks Platform Administrator /Databricks Certified Data Engineer
- AWS Certification (DevOps/Solution Architect)
- Terraform
About US Tech Solutions:
US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit www.ustechsolutions.com .
US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
AI Statement:By applying, you acknowledge that AI-assisted tools may be used during hiring.
Databricks Lead # 26-18311 · US Tech Solutions, Inc.