Principal AI Solution Engineer

We are seeking aPrincipal AI Solution Engineerto join an engineering organization building a sovereign, multi-tenant agentic AI platform, along with the applied products on top of it. Everything ships under strict data residency constraints and operates in both Arabic and English. Squads are small — three senior engineers — and decisions are made in the room. You will work across three layers and need to be credible in all of them: applied AI, AI infrastructure, and the backend platform.

Responsibilities

• Set architecture for systems that span squads; write the decision down and defend it
• Build and tune GPU-based serving — vLLM, TGI or TensorRT-LLM — for latency, throughput and a cost per token you can justify
• Own the reference RAG and agent architecture other teams build against
• Define service boundaries, API contracts, event-driven infrastructure and the SLO work that prevents incidents rather than answering them
• Develop offline and online evaluation and regression detection, so models, prompts and retrieval can change without flying blind

Requirements

• 5+ years of hands-on engineering experience with shipped production systems spanning applied AI, AI infrastructure and backend platforms
• At least 1 year of relevant leadership experience
• Expertise in Python and its production ecosystem, including FastAPI, Pydantic and asyncio
• Proficiency in production RAG end-to-end: ingestion, vector search, reranking and grounding evaluation
• Background in agent orchestration frameworks such as LangGraph, LangChain, OpenAI Agent SDK or Microsoft Agent Framework
• Competency in distributed systems, including idempotency, back-pressure and retry semantics, with strong event-driven architecture skills
• Knowledge of PostgreSQL at scale, along with GPU inference and serving using vLLM, TGI or TensorRT-LLM
• Familiarity with Kubernetes on Azure
• Skills in at least one infrastructure language: Go, Rust, Java or Kotlin
• Capability to use agentic coding tooling as a daily workflow, including project setup with CLAUDE.md, skills and agent configuration
• Excellent command of written and spoken English (B2+ level)

Nice to have

• Showcase of pgvector or Qdrant at production scale
• Experience with Arabic-language, voice or conversational AI
• Background in AI or mission-critical delivery in regulated environments such as government, defence or financial services
• Familiarity with Azure sovereign cloud, Entra ID and Azure OpenAI
• Understanding of Langfuse, Grafana, Prometheus and Terraform