Instruction Following on ComplexInstruct Level 2
94.6ISRDVRws
Evaluation Results
| Method | Links | |
|---|---|---|
| DVRwsBackbone=Llama-3.1-70B-Instruct-AWQ-INT4, warm-start=true2024.10 | 94.6 | |
| DVRcsBackbone=Llama-3.1-70B-Instruct-AWQ-INT4, cold-start=true2024.10 | 94.3 | |
| CRITICBackbone=Llama-3.1-70B-Instruct-AWQ-INT42024.10 | 93.2 | |
| ReActBackbone=Llama-3.1-70B-Instruct-AWQ-INT42024.10 | 91 | |
| R-SampleBackbone=Llama-3.1-70B-Instruct-AWQ-INT42024.10 | 90.8 | |
| DVRBackbone=Llama3.1-8B, Evaluation Protocol=zero-shot2024.10 | 88.7 | |
| DVR_WSBackbone=Llama-3.1-8B-Instruct, Refinement Repository=warm-start2024.10 | 88.7 | |
| GPT-4-turboEvaluation Protocol=zero-shot2024.10 | 88.4 | |
| DVR_CSBackbone=Llama-3.1-8B-Instruct, Refinement Repository=cold-start2024.10 | 87.9 | |
| DVRBackbone=Llama-3-8B-Instruct, Start Type=Warm-Start2024.10 | 87.6 | |
| CRITICBackbone=Llama-3.1-8B-Instruct2024.10 | 87.1 | |
| DVRBackbone=Llama-3-8B-Instruct, Start Type=Cold-Start2024.10 | 86.7 | |
| R-SampleBackbone=Llama-3.1-8B-Instruct2024.10 | 86.7 | |
| ReActBackbone=Llama-3.1-8B-Instruct2024.10 | 86.1 | |
| CRITICBackbone=Llama-3-8B-Instruct2024.10 | 85.8 | |
| BSMBackbone=Llama-3.1-70B-Instruct-AWQ-INT42024.10 | 84.5 | |
| VanillaBackbone=Llama-3.1-70B-Instruct-AWQ-INT42024.10 | 83.7 | |
| ReflexionBackbone=Llama-3.1-70B-Instruct-AWQ-INT42024.10 | 83.5 | |
| U-SCBackbone=Llama-3.1-70B-Instruct-AWQ-INT42024.10 | 83.3 | |
| DVRBackbone=Mistral-7B, Evaluation Protocol=zero-shot2024.10 | 81.3 | |
| ReActBackbone=Llama-3-8B-Instruct2024.10 | 81.3 | |
| R-SampleBackbone=Llama-3-8B-Instruct2024.10 | 80.9 | |
| ReflxionBackbone=Llama-3.1-8B-Instruct2024.10 | 78.1 | |
| Llama3.1-8BEvaluation Protocol=zero-shot2024.10 | 76.6 | |
| VanillaBackbone=Llama-3.1-8B-Instruct2024.10 | 76.6 | |
| U-SCBackbone=Llama-3.1-8B-Instruct2024.10 | 76.3 | |
| BSMBackbone=Llama-3.1-8B-Instruct2024.10 | 75.3 | |
| ReflexionBackbone=Llama-3-8B-Instruct2024.10 | 72.1 | |
| BSMBackbone=Llama-3-8B-Instruct2024.10 | 71.9 | |
| U-SCBackbone=Llama-3-8B-Instruct2024.10 | 71.8 | |
| VanillaBackbone=Llama-3-8B-Instruct2024.10 | 71.7 | |
| Mistral-7BEvaluation Protocol=zero-shot2024.10 | 55.3 |