Senior Backend Engineer- AI Agents (Remote)
🇺🇸 United States
Management
C
Docker
Kubernetes
AWS
GCP
Azure
Machine Learning
Design
Large Language Models
NoSQL
Backend
SQL
Analyst
Testing
Senior Backend Engineer- AI Agents (Remote)
from 🇺🇸 United States
About Level AI
Level AI is on a mission to turn every customer interaction into a strategic advantage. Our AI-native platform helps enterprises transform contact centers from cost centers into engines of customer intelligence, operational efficiency, and business growth. By combining advanced AI with deep domain understanding of customer experience, Level AI empowers teams to unlock actionable insights, automate workflows, and deliver more consistent, higher-quality support across the customer journey.
Headquartered in Mountain View, California, Level AI is a Series C company backed by leading investors including Battery Ventures and ENIAC. Our platform leverages Large Language Models and Custom Small Language Models (SLMs) to power AI Agents across the entire CX journey—customer-facing agents, agent-assist, and backend automation—along with deep conversation analytics for QA, coaching, and insights.
About the role
As aSenior Engineer – AI Agents, you will play a critical role in building the scalable backend systems that power Level AI’s next-generation AI Agents. These systems operate in real-time, high-volume enterprise environments and are central to delivering intelligent, production-grade AI experiences.
You will work at the intersection of distributed systems, cloud infrastructure, and AI-powered applications—bringing agentic AI capabilities into production at scale.
What you’ll get to do at Level AI (and more as we grow together):
- Design and build scalable backend systems powering AI Agents that operate in real-time enterprise environments
Develop agent orchestration frameworks (multi-step reasoning, tool usage, decisioning workflows)
Build systems foragent memory, context management, and state persistence across interactions
Architectlow-latency inference pipelines integrating LLMs, SLMs, and external tools/services
Implementevaluation (evals) frameworks to measure agent performance, accuracy, and reliability
Enablecontinuous improvement loops (feedback → retraining → deployment) for AI agents in production
Design and manageevent-driven, asynchronous workflows for complex agent tasks
Optimize systems forhigh throughput, low latency, and cost-efficient inference at scale
Build and maintainrobust APIs and service layers (REST / gRPC) for agent capabilities
Partner closely withApplied AI / ML teams to productionize models and agent behaviours.
Collaborate with Product and Solutions teams totranslate real customer workflows into agentic systems
Drive best practices inobservability, monitoring, safety, and guardrails for AI systems
Contribute toarchitecture decisions for scaling multi-tenant, enterprise-grade AI platforms
Â
We'll love to explore more about you if you have:
- Â 5+ years of experience in backend engineering, distributed systems, or platform engineering
- Strong experience buildinghigh-scale, production-grade backend systems
- Experience designing systems forreal-time processing, streaming, or event-driven architectures
- Strong understanding ofAPI design (REST, gRPC) and microservices architectures
- Experience withdatabases (SQL + NoSQL) and data modeling for high-scale systems
- Hands-on experience withDocker, Kubernetes, and cloud platforms (AWS/GCP/Azure)
- Strong fundamentals insystem design, concurrency, and performance optimization
Strong Plus (Agent / AI focus):
- Experience working withLLMs, conversational AI, or AI-powered products in production
- Familiarity withagent frameworks, tool calling, or multi-step reasoning systems
- Experience building or integratingRAG pipelines, vector databases, or retrieval systems
- Exposure toevaluation systems (offline/online evals, A/B testing for AI systems)
- Understanding ofprompting strategies, context windows, and model behavior optimization
- Experience withreal-time decisioning systems or workflow orchestration engines
Perks & Benefits
Competitive compensation with performance-based upside
Flexible vacation policy
Health insurance coverage
Work with a globally distributed, high-impact team
Opportunity to build cutting-edge AI products at scale
Regular team offsites and in-person collaborationÂ






