DevOps Engineer (AI / GenAI Platforms)

Job Title: DevOps Engineer (AI / GenAI Platforms)

Location:Austin, TX-

Job Description

We are seeking a skilledDevOps Engineer with strong AI platform experience to design, build, and operate scalable, secure, and highly available infrastructure for AI and Generative AI solutions. The role focuses on automating cloud infrastructure, CI/CD pipelines, and MLOps/LLMOps workflows. Experience withSAP BTP is a strong plus.

You will work closely with AI engineers, data scientists, and platform teams to support enterprise-grade AI applications in production.

Key Responsibilities

• Design, implement, and maintainCI/CD pipelines for AI, ML, and GenAI applications
• Build and managecloud-native infrastructure using AWS, Azure, or GCP
• SupportMLOps / LLMOps pipelines for model training, deployment, monitoring, and retraining
• Containerize and deploy applications usingDocker and Kubernetes
• Automate infrastructure provisioning usingTerraform / CloudFormation
• Implement monitoring, logging, and alerting using tools likeDatadog, Prometheus, Grafana, CloudWatch
• Collaborate with AI/ML teams to deploy LLM-based applications and APIs
• Ensuresecurity, compliance, and governance across environments
• Optimize system performance, scalability, and cost
• Support DevOps integration withSAP BTP services (if applicable)

Required Skills & Qualifications

• 5–8 years of experience inDevOps / Platform Engineering
• Strong experience withCI/CD tools (GitHub Actions, GitLab CI, Jenkins, Azure DevOps)
• Hands-on experience withDocker and Kubernetes
• Experience withcloud platforms (AWS / Azure / GCP)
• Infrastructure as Code usingTerraform or CloudFormation
• Experience supportingAI/ML or GenAI workloads in production
• Strong scripting skills (Python, Bash, or similar)
• Knowledge ofsecurity best practices, IAM, secrets management, and networking
• Good communication and collaboration skills

Good to Have (Plus Skills)

• Experience withMLOps / LLMOps tools (MLflow, Kubeflow, SageMaker, Vertex AI)
• Exposure toGenerative AI platforms (LLM APIs, model deployment, inference optimization)
• Experience withSAP Business Technology Platform (BTP):
  • SAP BTP Cloud Foundry / Kyma
  • Integration with SAP AI Core / AI Launchpad
  • SAP CPI or BTP services
• Experience withevent streaming (Kafka, Kinesis, Pub/Sub)
• Knowledge ofFinOps / cost optimization for AI workloads

Nice to Have

• Experience in regulated or enterprise environments
• Knowledge of monitoring AI model performance and drift
• Certifications in cloud or DevOps tools