DS
US_East | DATA ARCHITECT / DATA OFFICER_L3
Datum Software, Inc
- 🇮🇱 Israel
- On-site
- Staff / Principal
- 3 months ago
- AI
- AI/ML
- LangChain
- Semantic Kernel
- AutoGen
- CrewAI
- Azure OpenAI
- OpenAI
- RAG
- CRM
- ERP
- Python
- FAISS
- Pinecone
- Azure AI
- Azure
- AWS
- GCP
- Microservices
- Event-Driven Architecture
- OAuth
- Model Context Protocol
- MCP
- MLOps
3 months ago
Location: Charlotte
Â
Role Summary
We are seeking a highly experienced Agentic AI Architect to lead the design and implementation of enterprise-scale agentic AI solutions. This role is responsible for defining architecture, guiding development teams, and ensuring scalable, secure, and high-performing AI systems leveraging LLMs, multi-agent frameworks, and enterprise integrations.
The ideal candidate brings deep expertise in AI/ML, strong architectural design capability, and proven experience delivering complex, production-grade AI solutions.
Â
Key Responsibilities:
- Define end-to-end architecture for agentic AI solutions, including multi-agent systems, orchestration layers, and integrations
- Design and implement scalable agent frameworks using tools such as LangChain, Semantic Kernel, AutoGen, CrewAI, etc.
- Lead development of LLM-driven systems (Azure OpenAI, OpenAI, Anthropic, etc.) with robust prompt engineering strategies
- Architect RAG pipelines, memory systems, and tool integration layers
- Establish best practices for AI governance, security, and Responsible AI
- Design integration strategies with enterprise systems (CRM, ERP, APIs, data platforms)
- Provide technical leadership, mentorship, and code quality oversight to development teams
- Collaborate with business stakeholders to translate requirements into technical solutions
- Ensure performance, scalability, reliability, and cost optimization of AI systems
- Drive innovation by evaluating emerging AI technologies and frameworks
Required Skills & Experience:
- 10+ years of experience in software engineering, AI/ML, or solution architecture
- Strong expertise in Python and modern backend architecture
- Hands-on experience with LLM ecosystems and agent frameworks
- Proven experience designing multi-agent systems and distributed architectures
- Deep understanding of:
- Prompt engineering and LLM optimization
- Embeddings and vector databases (FAISS, Pinecone, Azure AI Search, etc.)
- Retrieval-Augmented Generation (RAG)
- Experience with cloud platforms (Azure preferred; AWS/GCP acceptable)
- Strong knowledge of API design, microservices, and event-driven architecture
- Familiarity with security, authentication (OAuth, SSO), and data governance
- Experience leading technical teams and driving architecture decisions
Good to Have:
- Experience with Model Context Protocol (MCP) or similar integration standards
- Exposure to enterprise AI transformation programs
- Knowledge of MLOps / LLMOps frameworks
- Experience with frontend or conversational UI frameworks
- Certifications (Azure AI Engineer, Solutions Architect, etc.)
Â
"All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran”
Â
Â
Â
US_East | DATA ARCHITECT / DATA OFFICER_L3 · Datum Software, Inc