Lead Azure DevOps Engineer

We are seeking aLead Azure DevOps Engineer to drive the deployment, integration, and operation of AI/LLM gateway technologies within enterprise environments, ensuring secure, scalable, and resilient production systems.

Responsibilities

• Deploy and manage AI/LLM gateway technologies such as LiteLLM, Citadel, or Azure APIM AI Gateway
• Integrate models and providers into gateway solutions to support enterprise-scale operations
• Configure routing, policy enforcement, and token/rate controls across gateway infrastructure
• Establish observability and resilience mechanisms to maintain production stability
• Implement LLM routing and broker logic to optimize model performance and reliability
• Enforce enterprise policies, including PII detection and redaction, to ensure compliance and security
• Take ownership of gateway implementation projects and deliver functional solutions rapidly
• Collaborate with cross-functional teams to align gateway operations with organizational security standards
• Monitor and troubleshoot production systems to ensure continuous availability

Requirements

• 5+ years of hands-on engineering experience with AI/LLM gateway technologies, including deployment, integration, and production operations
• Expertise in Azure API Management, Azure DevOps, and Azure AI Content Safety
• Proficiency in LiteLLM and other LLM gateway platforms
• Knowledge of LLM security, PII detection and redaction, and enterprise policy enforcement
• Understanding of LLM routing, broker logic, and token/rate control mechanisms
• Skills in observability, resilience engineering, and production system operations
• Capability to take ownership and deliver functional gateway implementations rapidly
• English proficiency at B2 level or higher