Synthetic Tasks
Benchmarks
TaskDatasetSOTA resultTrendResults
Synthetic tasks 5 families, 50 tasks Section 9.2 generator
0False Completion Rate (FCR)
26
Synthetic tasks Dependent Chain (unseen editing)
77.9DINO-I
12
Synthetic Tasks
98.5Exact Match
10