List your company
ResearchFormerly WizWand

Long-context Question Answering on 2WikiMQA

79.5SubEMLongMab
50.958.32565.7573.175Aug 19, 2025
Updated 6mo ago

Evaluation results

MethodLinks
LongMabBackbone=Qwen2.5-14B-Instruct2025.0879.568.83
LongFaith-POBackbone=Qwen2.5-14B-Instruct2025.087867.85
LongMabBackbone=Qwen3-8B2025.0877.574.32
Logo-POBackbone=Qwen2.5-14B-Instruct2025.0877.566.52
Vanilla LLMBackbone=Qwen3-8B2025.087772.4
SeaLong-POBackbone=Qwen3-8B2025.087773.38
LongReward-POBackbone=Qwen3-8B2025.087670.08
LongMabBackbone=Llama-3.1-8B-Instruct2025.087668.6
LongMab-SFTBackbone=Qwen3-8B2025.0875.573.16
Logo-POBackbone=Qwen3-8B2025.0875.571.34
Vanilla LLMBackbone=Qwen2.5-14B-Instruct2025.0875.563.88
LongFaith-POBackbone=Llama-3.1-8B-Instruct2025.0875.572.8
SeaLong-POBackbone=Qwen2.5-14B-Instruct2025.087557.91
LongReward-POBackbone=Qwen2.5-14B-Instruct2025.0873.562.3
LongMab-SFTBackbone=Qwen2.5-14B-Instruct2025.087364.01
LongAlpacaBackbone=Qwen3-8B2025.087168.76
LongAlpacaBackbone=Qwen2.5-14B-Instruct2025.087061.55
Vanilla LLMBackbone=Llama-3.1-8B-Instruct2025.0869.565.45
LongAlpacaBackbone=Llama-3.1-8B-Instruct2025.0869.563.64
LongAlignBackbone=Llama-3.1-8B-Instruct2025.086959.35
LongMab-SFTBackbone=Llama-3.1-8B-Instruct2025.086965.45
LongAlignBackbone=Qwen2.5-14B-Instruct2025.0868.565.26
LongReward-POBackbone=Llama-3.1-8B-Instruct2025.0868.563.23
SeaLong-POBackbone=Llama-3.1-8B-Instruct2025.086867.07
LongMabBackbone=Qwen-2.5-7B-Instruct2025.0867.562.97
SeaLong-POBackbone=Qwen-2.5-7B-Instruct2025.086736.39
LongFaith-POBackbone=Qwen3-8B2025.086666.79
LongFaith-POBackbone=Qwen-2.5-7B-Instruct2025.086653.93
Logo-POBackbone=Llama-3.1-8B-Instruct2025.086361.74
Logo-POBackbone=Qwen-2.5-7B-Instruct2025.086357.2
LongAlignBackbone=Qwen3-8B2025.086254.34
LongReward-POBackbone=Qwen-2.5-7B-Instruct2025.086250.75
LongMab-SFTBackbone=Qwen-2.5-7B-Instruct2025.0859.558.34
Vanilla LLMBackbone=Qwen-2.5-7B-Instruct2025.085850.14
LongAlpacaBackbone=Qwen-2.5-7B-Instruct2025.0855.550.75
LongAlignBackbone=Qwen-2.5-7B-Instruct2025.085252.02