List your company
ResearchFormerly WizWand

Aggregate General Language Modeling on Average 10 Benchmarks

70.04Average ScoreFineRMoE
20.723233.526646.3359.1334Mar 9, 2026
Updated 7mo ago

Evaluation results

MethodLinks
FineRMoEBase Model=Qwen2.5-7B, #P/B=26.65, #AP/B=7.942026.0370.04
C32A2Base Model=Qwen2.5-7B, #P/B=184.42, #AP/B=13.332026.0369.92
PTBase Model=Qwen2.5-7B, #P/B=7.62, #AP/B=7.622026.0368.91
CTBase Model=Qwen2.5-7B, #P/B=7.62, #AP/B=7.622026.0368.62
NVShardBase Model=Qwen2.5-7B, #P/B=47.55, #AP/B=7.632026.0365.18
FineRMoEBase Model=Qwen2.5-1.5B, #P/B=5.64, #AP/B=1.852026.0356.62
C32A2Base Model=Qwen2.5-1.5B, #P/B=37.62, #AP/B=2.942026.0356.5
PTBase Model=Qwen2.5-1.5B, #P/B=1.54, #AP/B=1.542026.0355.39
CTBase Model=Qwen2.5-1.5B, #P/B=1.54, #AP/B=1.542026.0355.18
NVShardBase Model=Qwen2.5-1.5B, #P/B=9.88, #AP/B=1.782026.0352.14
FineRMoEBase Model=Qwen2.5-0.5B, #P/B=1.68, #AP/B=0.652026.0341.39
CTBase Model=Qwen2.5-0.5B, #P/B=0.49, #AP/B=0.492026.0341.31
C32A2Base Model=Qwen2.5-0.5B, #P/B=10.36, #AP/B=0.952026.0341.28
PTBase Model=Qwen2.5-0.5B, #P/B=0.49, #AP/B=0.492026.0341.19
NVShardBase Model=Qwen2.5-0.5B, #P/B=2.83, #AP/B=0.632026.0337.14
S16A4Base Model=Qwen2.5-7B, #P/B=7.62, #AP/B=3.342026.0335.77
S16A4Base Model=Qwen2.5-1.5B, #P/B=1.78, #AP/B=0.912026.0326.32
DUBase Model=Qwen2.5-7B, #P/B=47.54, #AP/B=13.322026.0325.85
S16A4Base Model=Qwen2.5-0.5B, #P/B=0.63, #AP/B=0.402026.0324.18
DUBase Model=Qwen2.5-1.5B, #P/B=9.87, #AP/B=2.932026.0323.5
DUBase Model=Qwen2.5-0.5B, #P/B=2.83, #AP/B=0.942026.0322.62