AI Platform Architect: Agentic & Generative AI - Cogentiq

Role Overview

As anAI Platform Architect, you will design and scaleenterprise-grade Agentic AI and Generative AI platforms that power copilots, autonomous workflows, and multi-agent systems. This is a hands-on architect role for a builder who combines deep distributed-systems thinking with practical expertise in LLMs, agent orchestration, and cloud-native platforms.

You will define reference architectures, engineering standards, and core platform capabilities that enable teams to build, deploy, and operate AI systems at scale.

Key Responsibilities

Platform & Architecture Leadership

• Architectscalable Agentic AI platforms supporting multi-agent orchestration, tool usage, memory, planning, and reasoning workflows
• Designend-to-end GenAI platforms, including:
  • Prompt orchestration
  • Retrieval-Augmented Generation (RAG) pipelines
  • Vector databases
  • LLM integrations
• Define modular,microservices-based, API-first architectures enabling rapid development of AI copilots and autonomous systems

Agentic & GenAI Systems

• Define architectural patterns for:
  • Agent orchestration and coordination
  • Planning, reflection, and reasoning loops
  • Human-in-the-loop and feedback-driven systems
• Evaluate and integrate emerging frameworks such asLangChain, LlamaIndex, AutoGen, CrewAI, and related ecosystems into enterprise platforms

Production Readiness & Reliability

• Ensureproduction-grade reliability across AI platforms, including:
  • Observability and monitoring
  • Evaluation and experimentation frameworks
  • Guardrails, safety, and governance
  • Cost optimization for LLM-based systems
• Lead architecture acrossLLMOps, MLOps, and platform operations

Cloud, DevOps & Infrastructure

• Drive cloud-native platform architecture usingAWS, Azure, or GCP
• LeadKubernetes-based deployments, CI/CD pipelines, and Infrastructure as Code (IaC)
• Ensure scalability, security, and resilience of AI workloads

Collaboration & Technical Leadership

• Partner withdata science, product, and business teams to translate AI use cases into robust platform capabilities
• Mentor senior engineers and architects; setengineering standards, reference architectures, and best practices
• Act as a technical thought leader for enterprise AI platform strategy

Required Skills & Experience

• 12–15 years of experience inplatform engineering / architecture, with strong depth in distributed systems
• Deep expertise incloud platforms (AWS / Azure / GCP) and Kubernetes-based architectures
• Hands-on experience withLLMs, RAG architectures, and vector databases (e.g., Pinecone, FAISS, Weaviate)
• Strong understanding ofagentic frameworks, multi-agent systems, and orchestration patterns
• Experience acrossLLMOps / MLOps, including:
  • Model deployment
  • Monitoring and evaluation
  • Lifecycle and version management
• Proficiency inmicroservices, APIs, event-driven systems, and scalable backend engineering
• Strong coding experience inPython / Java / Go, with system-design depth
• Experience working withdata platforms (real-time + batch, large-scale data processing)
• Solid understanding ofAI safety, governance, and responsible AI frameworks

Good to Have

• Experience buildingenterprise AI copilots or autonomous workflows
• Exposure to reasoning frameworks,chain-of-thought orchestration, and agent memory systems
• Priorconsulting or client-facing experience leading AI-driven transformations

What We’re Looking For

Abuilder–architect who combines deep engineering rigor with a strong grasp ofAgentic and Generative AI—someone who can turn cutting-edge AI concepts intoscalable, secure, and production-ready enterprise platforms.