Long-context Question Answering on MFQA En
29.33SubEMLongReward-PO
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LongReward-POBackbone=Qwen-2.5-7B-Instruct2025.08 | 29.33 | 44.89 | |
| Vanilla LLMBackbone=Qwen-2.5-7B-Instruct2025.08 | 28 | 45.12 | |
| LongAlignBackbone=Qwen3-8B2025.08 | 27.33 | 50.29 | |
| SeaLong-POBackbone=Qwen-2.5-7B-Instruct2025.08 | 27.33 | 41.08 | |
| Vanilla LLMBackbone=Qwen2.5-14B-Instruct2025.08 | 26.67 | 47.78 | |
| Logo-POBackbone=Qwen2.5-14B-Instruct2025.08 | 26.67 | 48.19 | |
| LongMabBackbone=Llama-3.1-8B-Instruct2025.08 | 26 | 51.26 | |
| LongAlpacaBackbone=Qwen2.5-14B-Instruct2025.08 | 25.33 | 48.87 | |
| LongMabBackbone=Qwen-2.5-7B-Instruct2025.08 | 25.33 | 48.07 | |
| SeaLong-POBackbone=Qwen2.5-14B-Instruct2025.08 | 24.67 | 46.83 | |
| Logo-POBackbone=Qwen-2.5-7B-Instruct2025.08 | 24.67 | 49.18 | |
| LongFaith-POBackbone=Qwen-2.5-7B-Instruct2025.08 | 24.67 | 38.08 | |
| LongAlpacaBackbone=Qwen-2.5-7B-Instruct2025.08 | 24.66 | 45.88 | |
| LongReward-POBackbone=Qwen3-8B2025.08 | 24 | 45.48 | |
| Vanilla LLMBackbone=Qwen3-8B2025.08 | 23.33 | 47.07 | |
| LongAlpacaBackbone=Qwen3-8B2025.08 | 23.33 | 47.73 | |
| Logo-POBackbone=Qwen3-8B2025.08 | 23.33 | 47.32 | |
| LongMabBackbone=Qwen3-8B2025.08 | 23.33 | 47.57 | |
| LongMab-SFTBackbone=Qwen2.5-14B-Instruct2025.08 | 23.33 | 49.96 | |
| LongMabBackbone=Qwen2.5-14B-Instruct2025.08 | 23.33 | 47.92 | |
| LongAlignBackbone=Qwen-2.5-7B-Instruct2025.08 | 23.33 | 49.76 | |
| LongMab-SFTBackbone=Qwen3-8B2025.08 | 22.67 | 47.99 | |
| SeaLong-POBackbone=Qwen3-8B2025.08 | 22.67 | 48.56 | |
| LongReward-POBackbone=Qwen2.5-14B-Instruct2025.08 | 22.67 | 46.74 | |
| LongAlignBackbone=Llama-3.1-8B-Instruct2025.08 | 22 | 48.49 | |
| LongMab-SFTBackbone=Llama-3.1-8B-Instruct2025.08 | 21.33 | 45.03 | |
| LongMab-SFTBackbone=Qwen-2.5-7B-Instruct2025.08 | 21.33 | 44.06 | |
| LongAlignBackbone=Qwen2.5-14B-Instruct2025.08 | 20.67 | 46.25 | |
| LongFaith-POBackbone=Qwen2.5-14B-Instruct2025.08 | 20.67 | 46.92 | |
| LongFaith-POBackbone=Llama-3.1-8B-Instruct2025.08 | 20.66 | 48.1 | |
| LongReward-POBackbone=Llama-3.1-8B-Instruct2025.08 | 20 | 44.7 | |
| SeaLong-POBackbone=Llama-3.1-8B-Instruct2025.08 | 19.33 | 44.12 | |
| Logo-POBackbone=Llama-3.1-8B-Instruct2025.08 | 19 | 44.39 | |
| Vanilla LLMBackbone=Llama-3.1-8B-Instruct2025.08 | 18.66 | 44.34 | |
| LongFaith-POBackbone=Qwen3-8B2025.08 | 17.33 | 38.01 | |
| LongAlpacaBackbone=Llama-3.1-8B-Instruct2025.08 | 16.66 | 40.67 |