Question Answering on LongReason
72.3AccPPA-Plan
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| PPA-PlanLLM Model=Qwen-2.5-14B2026.01 | 72.3 | 66.3 | 68.9 | |
| PPA-PlanLLM Model=Llama-3.1-8B2026.01 | 67.9 | 62.3 | 77.9 | |
| PPA-PlanLLM Model=GPT-4o mini2026.01 | 67.6 | 66.6 | 69.9 | |
| CoTLLM Model=GPT-4o mini2026.01 | 67.4 | 68.1 | 49 | |
| CoTLLM Model=Qwen-2.5-14B2026.01 | 67 | 64.9 | 43.2 | |
| PSLLM Model=GPT-4o mini2026.01 | 65.2 | 65.5 | 41.6 | |
| GQALLM Model=Qwen-2.5-14B2026.01 | 64.1 | 63.2 | 40.2 | |
| GQALLM Model=GPT-4o mini2026.01 | 61.8 | 66.9 | 50.6 | |
| PSLLM Model=Qwen-2.5-14B2026.01 | 61.1 | 60.5 | 30.9 | |
| PEARLLLM Model=Qwen-2.5-14B2026.01 | 60.1 | 61.2 | 66.6 | |
| GQALLM Model=Llama-3.1-8B2026.01 | 59.2 | 57.7 | 37.1 | |
| PEARLLLM Model=GPT-4o mini2026.01 | 56.8 | 64.5 | 72.1 | |
| CoTLLM Model=Llama-3.1-8B2026.01 | 55.8 | 55 | 29.5 | |
| PEARLLLM Model=Llama-3.1-8B2026.01 | 55.8 | 56.9 | 76.2 | |
| PSLLM Model=Llama-3.1-8B2026.01 | 48.3 | 42 | 33.1 |