AI ML Python Developer

Position:

Job Description:

• Design and develop scalable backend services and REST APIs usingPython, FastAPI/Flask/Django.

• Build and integrateGenerative AI/LLM-based applications, includingRAG, AI agents, embeddings, and tool/function calling.

• Work withAzure OpenAI and other LLM providers.

• Use AI frameworks such asLangChain, LlamaIndex, LangGraph, or similar.

• ImplementLiteLLM for LLM gateway, routing, fallback, and usage/cost management.

• Implementrate limiting, throttling, caching, retries, and API quotas for scalable services.

• UseLangfuse for LLM observability, tracing, prompt management, token/cost tracking, and evaluation.

• Design and work withPostgreSQL/MySQL, MongoDB, and Redis.

• Deploy and manage applications usingMicrosoft Azure, Docker, and CI/CD.

• Develop unit/integration tests, troubleshoot production issues, and optimize performance and cost.

• Participate insystem design, code reviews, and technical architecture discussions.
   

• Required

• 5–7 years of software development experience with strongPython and backend development skills and hands-on experience inGenerative AI/LLM applications.

• Strong understanding ofREST APIs, microservices, RAG, embeddings, vector databases, prompt engineering, AI agents, rate limiting, and distributed systems.

• Hands-on experience withAzure OpenAI, LiteLLM, and Langfuse is preferred, along with exposure toLangChain/LlamaIndex/LangGraph or similar AI frameworks.

• Experience withMicrosoft Azure, Docker, CI/CD, databases, Redis, API security, and cloud-native application development is required.

• Strong problem-solving, communication, ownership, and ability to buildproduction-grade AI solutions are essential.

Location:

Time Type:

Job Category: