Multi-turn Instruction Following on StructFlowBench
89.46CSR+GraphIF
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| +GraphIFBackbone Model=Qwen2.5-7B-Instruct2025.11 | 89.46 | 69.25 | 89.47 | 88.6 | |
| +GraphIFBackbone Model=Llama-3.1-8B-Instruct2025.11 | 88.91 | 70.29 | 89.38 | 88.04 | |
| +GraphIFBackbone Model=Llama-3.1-Tulu-3.1-8B2025.11 | 88.68 | 69.71 | 88.98 | 87.9 | |
| +GraphIFBackbone Model=Llama-3.1-Storm-8B2025.11 | 86.92 | 64.18 | 86.83 | 85.32 | |
| LLM-onlyBackbone Model=Llama-3.1-Tulu-3.1-8B2025.11 | 80.92 | 47.85 | 81.93 | 78.78 | |
| +GraphIFBackbone Model=Hermes-3-Llama-3.1-8B2025.11 | 78.74 | 46.74 | 79.73 | 76.54 | |
| +MemoryBankBackbone Model=Llama-3.1-Tulu-3.1-8B2025.11 | 78.51 | 42.24 | 78.88 | 75.32 | |
| +MemoryBankBackbone Model=Qwen2.5-7B-Instruct2025.11 | 74.63 | 29.99 | 74.92 | 70.58 | |
| +MemoryBankBackbone Model=Llama-3.1-8B-Instruct2025.11 | 74.37 | 35.85 | 75.48 | 70.83 | |
| LLM-onlyBackbone Model=Llama-3.1-Storm-8B2025.11 | 74.07 | 34.12 | 74.99 | 70.75 | |
| +MemoryBankBackbone Model=Llama-3.1-Storm-8B2025.11 | 73.92 | 31.94 | 74.37 | 70.02 | |
| +MemoChatBackbone Model=Llama-3.1-8B-Instruct2025.11 | 73.51 | 32.07 | 74.29 | 69.86 | |
| +MemoChatBackbone Model=Qwen2.5-7B-Instruct2025.11 | 72.87 | 27.08 | 73.23 | 68.72 | |
| +MemoChatBackbone Model=Llama-3.1-Storm-8B2025.11 | 71.55 | 30.6 | 71.62 | 67.78 | |
| LLM-onlyBackbone Model=Llama-3.1-8B-Instruct2025.11 | 71.03 | 29.32 | 72.75 | 67.98 | |
| LLM-onlyBackbone Model=Qwen2.5-7B-Instruct2025.11 | 70.7 | 23.02 | 71.22 | 67.07 | |
| +MemoryBankBackbone Model=Hermes-3-Llama-3.1-8B2025.11 | 69.2 | 23.57 | 70.03 | 64.98 | |
| +MemoChatBackbone Model=Hermes-3-Llama-3.1-8B2025.11 | 68.79 | 24.64 | 69.89 | 64.76 | |
| LLM-onlyBackbone Model=Hermes-3-Llama-3.1-8B2025.11 | 68.39 | 23.55 | 69.74 | 65.11 | |
| +MemoChatBackbone Model=Llama-3.1-Tulu-3.1-8B2025.11 | 64.71 | 25.13 | 66.46 | 61.85 |