Instruction Following on ComplexInstruct Level 4 v1.0
51.4ISRDVR
Evaluation results
| Method | Links | |
|---|---|---|
| DVRBase Model=Mistral-7B-Instruct-v0.3, Strategy=warm-start, Variant=DVRWS2024.10 | 51.4 | |
| DVRBase Model=Mistral-7B-Instruct-v0.3, Strategy=cold-start, Variant=DVRCS2024.10 | 49.3 | |
| CRITICBase Model=Mistral-7B-Instruct-v0.32024.10 | 43.5 | |
| ReActBase Model=Mistral-7B-Instruct-v0.32024.10 | 32.5 | |
| R-SampleBase Model=Mistral-7B-Instruct-v0.32024.10 | 23 | |
| U-SCBase Model=Mistral-7B-Instruct-v0.32024.10 | 20.4 | |
| ReflxionBase Model=Mistral-7B-Instruct-v0.32024.10 | 20.1 | |
| VanillaBase Model=Mistral-7B-Instruct-v0.32024.10 | 19.9 | |
| BSMBase Model=Mistral-7B-Instruct-v0.32024.10 | 19.3 |