About AgentHub

The simulation and evaluation engine for AI agents

Tech description:

We’re building the simulation evaluation engine for AI agents. AgentHub is defining the core infra layer that makes agents reliable enough for production at scale for industry-specific tasks. If you’re excited about building a category defining product pushing the boundaries of what it means to evaluate and ship agents that operate in complex environments we’d love to have you on board. We work at the intersection of AI research, large-scale infrastructure, and highly streamlined user experiences. The problems we tackle include: - Sandboxing agents and running thousands of concurrent simulations at scale. - Designing evaluation pipelines that capture reasoning, safety, reliability, and edge-case behavior. - Building scalable systems for ingesting, storing, and analyzing structured + unstructured outputs from agents. - Rethinking the optimal user experience to quickly onboard arbitrary agents and leverage robust evaluation infrastructure. - Exposing tools and interfaces that make evaluation results understandable and actionable. The work is both research and systems heavy. You’ll have the opportunity to wear multiple hats and exercise a variety of skills, own features end-to-end, and meet with customers. You might be building a new evaluation method, scaling an infra service, and sitting with a customer to design a custom environment all within the same week.

Job description:

**The Role:** You will work directly with the founders on the core product and in shaping the future roadmap. You’ll have significant ownership and make foundational technical decisions. This role is a fit for you if you’re looking to wear many hats and are excited about our mission to define the infra layer for agent evaluation. **What you will do:** * Design and build the core platform and infrastructure to define, run, and extract insights from agent simulations. * Define the ideal user experience for the product and continue to shape it as it evolves. Critical and out-of-the-box thinking encouraged. * Work closely with customers to onboard them, provide continuous support, and collect feedback. **Signs you might thrive in this role:** * Bachelors/Masters/PhD in Computer Science or related field. * Passionate about building category-defining products. * Demonstrated experience working on LLM-systems and infra (optional but great to have). * Strong background in systems and infrastructure. * Enjoy owning, scoping, developing, and maintaining features end-to-end. * Confidently navigates through ambiguity and thoughtfully considers tradeoffs and design decisions.

Skills:

Python, React, TypeScript, SQL, Linux, Distributed Systems, Machine Learning, Reinforcement learning (RL), Docker, Amazon Web Services (AWS)

AgentHub remote jobs

Founding Engineer

Founding Research Engineer