Controlled-domain
Benchmarks
TaskDatasetSOTA resultTrendResults
Controlled-domain Long-memory
0.453G (Mean Task-Rubric Score)
2
Controlled-domain Research
0.314Mean Task Rubric Score (G)
2
Controlled-domain Planning
0.412Mean Task Rubric Score (G)
2
Controlled-domain Multi-tool
52.8Mean Task Rubric Score (G)
2
Controlled-domain Coding
0.812Mean Task Rubric Score (G)
2
Controlled-domain Knowledge-work
0.464Mean Task Rubric Score (G)
2