Multi-turn Instruction Following on MT-Eval
93.62CSR+GraphIF
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| +GraphIFBackbone Model=Llama-3.1-Storm-8B2025.11 | 93.62 | 81.3 | 93.33 | 94.87 | |
| +GraphIFBackbone Model=Qwen2.5-7B-Instruct2025.11 | 91.3 | 76.96 | 91.06 | 90.72 | |
| +GraphIFBackbone Model=Llama-3.1-8B-Instruct2025.11 | 91.27 | 80.35 | 90.87 | 92.58 | |
| +GraphIFBackbone Model=Llama-3.1-Tulu-3.1-8B2025.11 | 88.48 | 76.96 | 88.03 | 89.68 | |
| +GraphIFBackbone Model=Hermes-3-Llama-3.1-8B2025.11 | 86.96 | 70.43 | 86.52 | 86.64 | |
| LLM-onlyBackbone Model=Llama-3.1-Storm-8B2025.11 | 80.36 | 56.96 | 81.36 | 80.87 | |
| LLM-onlyBackbone Model=Qwen2.5-7B-Instruct2025.11 | 80.22 | 51.3 | 79.7 | 79.57 | |
| LLM-onlyBackbone Model=Hermes-3-Llama-3.1-8B2025.11 | 76.74 | 48.7 | 76.21 | 76.09 | |
| LLM-onlyBackbone Model=Llama-3.1-Tulu-3.1-8B2025.11 | 74.13 | 44.35 | 75.3 | 72.7 | |
| +MemoryBankBackbone Model=Llama-3.1-Tulu-3.1-8B2025.11 | 73.7 | 43.04 | 73.03 | 73.45 | |
| +MemoryBankBackbone Model=Qwen2.5-7B-Instruct2025.11 | 70.29 | 30.87 | 69.84 | 67.88 | |
| +MemoryBankBackbone Model=Hermes-3-Llama-3.1-8B2025.11 | 68.41 | 34.35 | 68.33 | 69.07 | |
| +MemoryBankBackbone Model=Llama-3.1-8B-Instruct2025.11 | 67.17 | 31.74 | 66.97 | 67.74 | |
| LLM-onlyBackbone Model=Llama-3.1-8B-Instruct2025.11 | 67.03 | 27.51 | 67.88 | 64.22 | |
| +MemoryBankBackbone Model=Llama-3.1-Storm-8B2025.11 | 66.16 | 28.7 | 65.45 | 66.35 | |
| +MemoChatBackbone Model=Qwen2.5-7B-Instruct2025.11 | 59.42 | 16.52 | 58.79 | 56.35 | |
| +MemoChatBackbone Model=Llama-3.1-8B-Instruct2025.11 | 56.3 | 15.22 | 55.45 | 53.97 | |
| +MemoChatBackbone Model=Llama-3.1-Storm-8B2025.11 | 55.36 | 13.04 | 54.39 | 53.59 | |
| +MemoChatBackbone Model=Hermes-3-Llama-3.1-8B2025.11 | 54.93 | 11.3 | 53.94 | 52.26 | |
| +MemoChatBackbone Model=Llama-3.1-Tulu-3.1-8B2025.11 | 50.65 | 19.57 | 51.36 | 49.83 |