Skip to content

Off-the-shelf data

Start with data.
Build new capabilities.

Expert-designed tasks, trajectories, and RL environments for frontier model training.

Find your next capability.

Browse task families across five domains. Request samples and current availability.

11 collections

Long-horizon coding

Multi-step coding

Sequential engineering tasks on persistent codebases, with step-level tests for implementation quality, error recovery, and regressions.

  • Feature sequences
  • Persistent codebases
  • Regression testing
Data & environment components

Harbor task packages · Repository snapshots · Step-level verifiers

Request samples

Long-horizon coding

Terminal & systems tasks

Software installation, configuration, and debugging through the terminal, with executable outcome checks.

Research references

  • Terminal-Bench
  • Frontier-Bench
  • FrontierSWE
Data & environment components

Containers · Instructions · Execution checks

Request samples

Long-horizon coding

Repository-level engineering

Feature development, bug fixes, and refactoring in complete repositories, evaluated with executable tests.

Research references

  • SWE-bench Multilingual
  • DeepSWE
  • SWE-bench Pro
  • ProgramBench
Data & environment components

Repositories · Patches · Tests

Request samples

Long-horizon coding

Cybersecurity

Vulnerability discovery, exploit reproduction, and patch verification in isolated software environments.

  • Vulnerability analysis
  • Exploit reproduction
  • Patch validation
Data & environment components

Codebases · Sandboxed targets · Regression tests

Request samples

AI4Science

Scientific research workflows

Expert-designed tasks for reproducing experiments, analyzing results, and validating scientific findings.

  • Scientific computing
  • Experiment reproduction
  • Data analysis
Data & environment components

Research tasks · Reference artifacts · Expert rubrics

Request samples

RSI

Recursive self-improvement

Controlled experiments for agents that improve models, training procedures, and their own research workflows.

Research references

  • PostTrainBench
  • AutoResearch
Data & environment components

Experiment environments · Trajectories · Reward signals

Request samples

RSI

Frontier computer science

Research tasks in algorithm design, implementation, and empirical validation.

Research references

  • FrontierCS
Data & environment components

Challenges · Solutions · Evaluation criteria

Request samples

Knowledge work

Enterprise knowledge work

Expert-designed document and spreadsheet workflows, evaluated on accuracy, evidence, and deliverable quality.

Research references

  • Apex Agents
Data & environment components

Workspaces · Reference deliverables · Expert rubrics

Request samples

Knowledge work

Expert agentic reasoning

Multi-step investigations requiring research, tool use, and evidence-based reasoning.

Research references

  • Agent Last Exam
Data & environment components

Tasks · Evidence · Expert review

Request samples

Agentic tool use

Agent workspaces & rubrics

Agent trajectories with expert rubrics for reward modeling, critic training, and evaluation.

Research references

  • OpenClaw
  • Hermes
  • Toolathlon
Data & environment components

Session trajectories · Rubrics · Reward signals

Request samples

Agentic tool use

Computer use & GUI

Browser and desktop tasks requiring visual grounding, interface navigation, and cross-application execution, verified against final state.

  • Browser workflows
  • Desktop applications
  • Visual grounding
Data & environment components

Application environments · Screenshot–action trajectories · Outcome verifiers

Request samples

Custom work

A different research question?

Specify a target capability or failure mode. We build the tasks, environments, and verification.

Talk to our team

Before your training run

Inspect the data.
Understand the signal.

Work with our team to assess task difficulty, verification, and fit with your training stack.

Walk through a sample
Task design
Review representative instructions, source materials, and the capabilities each task targets.
Execution & evaluation
Inspect runtimes, reference artifacts, programmatic checks, and expert review criteria.
Delivery fit
Align on formats, data provenance, licensing, and integration with your training or evaluation pipeline.

Open research

Multi-step-SWE

How well can coding agents keep building on their own code? Explore our benchmark for evolving software.

Paper & leaderboard