Expert-authored evaluations.
Challenging tasks, grounded reference work, and explicit rubrics. A sharper view of what agents can do—and where they break.
HUMAN EXPERTISE. MACHINE PROGRESS.
AI learns by doing. We’re building the environments, evaluations, and expert data that make the experience matter.
An independent lab in formation. An open frontier.
Intelligence needs experience.
Experience needs a world worth learning from.
01 / RESEARCH DIRECTIONS
Our research agenda connects human knowledge with the systems that teach agents to reason, act, and improve.
Challenging tasks, grounded reference work, and explicit rubrics. A sharper view of what agents can do—and where they break.
Sequences of decisions across files, tools, and applications. Capturing the path from an open-ended goal to a finished work product.
Resettable worlds with meaningful constraints and verifiable outcomes. Places for agents to practice, explore, and learn from feedback.
02 / INSIDE THE LOOP
We’re interested in the whole episode: the starting conditions, the choices along the way, and the evidence of a successful outcome.
THE SIMULATED WORLD
A persistent workspace of documents, applications, and tools. An objective that takes more than one answer. Constraints that make the choices meaningful.
Explore the components of a learning episode.
03 / OUR APPROACH
The question behind our work: what kinds of experience lead to capabilities that transfer beyond the training task?
Translate the decisions, constraints, and edge cases practitioners recognize into tasks with substance.
Combine expert-authored rubrics with executable checks. Preserve the evidence behind each assessment.
Study tool use, recovery, and generalization on held-out tasks. Track the cost of the behavior that improves.
THE QUESTIONS AHEAD
We’re building Calibrated around a simple conviction: the design of an agent’s experience matters as much as the difficulty of its task.
04 / BUILD WITH US
Build worlds agents can learn in. Design evaluations that reveal something new. Turn hard-won expertise into the next training signal.
We’d like to meet researchers, engineers, and domain experts who want to work at this intersection—and partners who share the ambition.
Expressions of interest for future collaboration. Specific roles and projects will be shared as they become available.
THE NEXT FRONTIER IS BUILT.
Research collaborations. Data partnerships. Shared ambition.