List your company
ResearchFormerly WizWand

Long-context understanding on MuSiQue

51SubEMLogo-PO
27.633.67539.7545.825Aug 19, 2025
Updated 6mo ago

Evaluation results

MethodLinks
Logo-POBackbone=Qwen2.5-14B-Instruct2025.085142.04
LongMabBackbone=Qwen2.5-14B-Instruct2025.085050.34
LongMabBackbone=Llama-3.1-8B-Instruct2025.085052.15
LongFaith-POBackbone=Qwen2.5-14B-Instruct2025.0849.3351
LongReward-POBackbone=Qwen2.5-14B-Instruct2025.0848.543.41
LongFaith-POBackbone=Qwen-2.5-7B-Instruct2025.0848.543.38
Vanilla LLMBackbone=Qwen2.5-14B-Instruct2025.0846.539.18
SeaLong-POBackbone=Qwen2.5-14B-Instruct2025.0846.537.56
LongMab-SFTBackbone=Qwen2.5-14B-Instruct2025.084544
LongFaith-POBackbone=Llama-3.1-8B-Instruct2025.084449.23
LongMabBackbone=Qwen-2.5-7B-Instruct2025.084443.25
LongAlpacaBackbone=Qwen2.5-14B-Instruct2025.0843.541.1
Logo-POBackbone=Llama-3.1-8B-Instruct2025.0843.546.58
SeaLong-POBackbone=Qwen-2.5-7B-Instruct2025.084322.09
Logo-POBackbone=Qwen-2.5-7B-Instruct2025.084136.48
LongReward-POBackbone=Llama-3.1-8B-Instruct2025.0840.541.41
LongAlignBackbone=Qwen2.5-14B-Instruct2025.0837.538.33
SeaLong-POBackbone=Llama-3.1-8B-Instruct2025.0837.540.52
LongReward-POBackbone=Qwen-2.5-7B-Instruct2025.0837.533.37
LongAlignBackbone=Llama-3.1-8B-Instruct2025.0836.537.62
LongMab-SFTBackbone=Qwen-2.5-7B-Instruct2025.0836.539.32
LongMab-SFTBackbone=Llama-3.1-8B-Instruct2025.083539.6
LongAlpacaBackbone=Llama-3.1-8B-Instruct2025.083438.36
Vanilla LLMBackbone=Llama-3.1-8B-Instruct2025.0833.536.56
Vanilla LLMBackbone=Qwen-2.5-7B-Instruct2025.0833.530.52
LongAlpacaBackbone=Qwen-2.5-7B-Instruct2025.0832.533.9
LongAlignBackbone=Qwen-2.5-7B-Instruct2025.0828.531.09