Long-horizon coding
Multi-step coding
Sequential engineering tasks on persistent codebases, with step-level tests for implementation quality, error recovery, and regressions.
- Feature sequences
- Persistent codebases
- Regression testing
Data & environment componentsHarbor task packages · Repository snapshots · Step-level verifiers
Request samples Long-horizon coding
Terminal & systems tasks
Software installation, configuration, and debugging through the terminal, with executable outcome checks.
Research references
- Terminal-Bench
- Frontier-Bench
- FrontierSWE
Data & environment componentsContainers · Instructions · Execution checks
Request samples Long-horizon coding
Repository-level engineering
Feature development, bug fixes, and refactoring in complete repositories, evaluated with executable tests.
Research references
- SWE-bench Multilingual
- DeepSWE
- SWE-bench Pro
- ProgramBench
Data & environment componentsRepositories · Patches · Tests
Request samples Long-horizon coding
Cybersecurity
Vulnerability discovery, exploit reproduction, and patch verification in isolated software environments.
- Vulnerability analysis
- Exploit reproduction
- Patch validation
Data & environment componentsCodebases · Sandboxed targets · Regression tests
Request samples AI4Science
Scientific research workflows
Expert-designed tasks for reproducing experiments, analyzing results, and validating scientific findings.
- Scientific computing
- Experiment reproduction
- Data analysis
Data & environment componentsResearch tasks · Reference artifacts · Expert rubrics
Request samples RSI
Recursive self-improvement
Controlled experiments for agents that improve models, training procedures, and their own research workflows.
Research references
- PostTrainBench
- AutoResearch
Data & environment componentsExperiment environments · Trajectories · Reward signals
Request samples RSI
Frontier computer science
Research tasks in algorithm design, implementation, and empirical validation.
Research references
Data & environment componentsChallenges · Solutions · Evaluation criteria
Request samples Knowledge work
Enterprise knowledge work
Expert-designed document and spreadsheet workflows, evaluated on accuracy, evidence, and deliverable quality.
Research references
Data & environment componentsWorkspaces · Reference deliverables · Expert rubrics
Request samples Knowledge work
Expert agentic reasoning
Multi-step investigations requiring research, tool use, and evidence-based reasoning.
Research references
Data & environment componentsTasks · Evidence · Expert review
Request samples Agentic tool use
Agent workspaces & rubrics
Agent trajectories with expert rubrics for reward modeling, critic training, and evaluation.
Research references
Data & environment componentsSession trajectories · Rubrics · Reward signals
Request samples Agentic tool use
Computer use & GUI
Browser and desktop tasks requiring visual grounding, interface navigation, and cross-application execution, verified against final state.
- Browser workflows
- Desktop applications
- Visual grounding
Data & environment componentsApplication environments · Screenshot–action trajectories · Outcome verifiers
Request samples Custom work
A different research question?
Specify a target capability or failure mode. We build the tasks, environments, and verification.
Talk to our team