Instruction Following on ComplexInstruct Level 5 v1.0
36.4Instruction Success RateDVR
Evaluation results
| Method | Links | |
|---|---|---|
| DVRBase Model=Mistral-7B-Instruct-v0.3, Strategy=warm-start, Variant=DVRWS2024.10 | 36.4 | |
| DVRBase Model=Mistral-7B-Instruct-v0.3, Strategy=cold-start, Variant=DVRCS2024.10 | 35.8 | |
| CRITICBase Model=Mistral-7B-Instruct-v0.32024.10 | 28.1 | |
| ReActBase Model=Mistral-7B-Instruct-v0.32024.10 | 18.2 | |
| R-SampleBase Model=Mistral-7B-Instruct-v0.32024.10 | 13.5 | |
| U-SCBase Model=Mistral-7B-Instruct-v0.32024.10 | 12.9 | |
| VanillaBase Model=Mistral-7B-Instruct-v0.32024.10 | 12.4 | |
| ReflxionBase Model=Mistral-7B-Instruct-v0.32024.10 | 12 | |
| BSMBase Model=Mistral-7B-Instruct-v0.32024.10 | 11.3 |