List your company
ResearchFormerly WizWand

Multi-subject Knowledge on MMLU

79.7AccuracyBaseline
43.8253.13562.4571.765Dec 10, 2025Jan 4, 2026Jan 30, 2026Feb 24, 2026Mar 22, 2026Apr 16, 2026May 12, 2026
Updated 5mo ago

Evaluation results

MethodLinks
BaselineModel=Qwen3-8B2026.0579.7
ScaleSearchModel=Qwen3-8B2026.0579.4
NVFP4Model=Qwen3-8B2026.0577.7
TCA-AttentionBase Model=Qwen2.5-7B-Instruct2025.1274.26
FlexPrefillBase Model=Qwen2.5-7B-Instruct2025.1274.23
Qwen2.5-7B-InstructAttention Method=Full Attention2025.1274.22
XAttentionBase Model=Qwen2.5-7B-Instruct2025.1274.2
MInferenceBase Model=Qwen2.5-7B-Instruct2025.1274.14
LLaMA3.1-8B-InstructAttention Method=Full Attention2025.1269.38
XAttentionBase Model=LLaMA3.1-8B-Instruct2025.1269.21
TCA-AttentionBase Model=LLaMA3.1-8B-Instruct2025.1269.21
FlexPrefillBase Model=LLaMA3.1-8B-Instruct2025.1269.16
MInferenceBase Model=LLaMA3.1-8B-Instruct2025.1269.14
BaselineModel=DeepSeek-R1-Distill-Qwen-1.5B2026.0548
ScaleSearchModel=DeepSeek-R1-Distill-Qwen-1.5B2026.0545.4
NVFP4Model=DeepSeek-R1-Distill-Qwen-1.5B2026.0545.2