ComplexInstruct
Benchmarks
TaskDatasetSOTA resultTrendResults
ComplexInstruct Level 2
94.6ISR
32
ComplexInstruct Level 6
64.2ISR
23
ComplexInstruct Level 5
0.76ISR
23
ComplexInstruct Level 4
82.2ISR
23
ComplexInstruct Level 3
88.7ISR
23
ComplexInstruct Level 1
0.982ISR
23
ComplexInstruct Level 6 v1.0
23.6ISR
9
ComplexInstruct Level 5 v1.0
36.4Instruction Success Rate
9
ComplexInstruct Level 4 v1.0
51.4ISR
9
ComplexInstruct Level 3 v1.0
66.6ISR
9
ComplexInstruct Level 2 v1.0
81.3ISR
9
ComplexInstruct Level 1 v1.0
95ISR
9