List your company
ResearchFormerly WizWand

Science Question Answering on ARC-C (ARC-C Score)

69.71ARC-C ScoreOPTIMER
33.507642.906352.30561.7037Nov 14, 2025Dec 16, 2025Jan 18, 2026Feb 20, 2026Mar 24, 2026Apr 26, 2026May 29, 2026
Updated 5mo ago

Evaluation results

MethodLinks
OPTIMERBase Model=Gemma 3 27B2026.0369.71
OPTIMERBase Model=SEA-LION v42026.0368.94
LLAMA-4-SCOUTPARAMS=109B, Variant=ORIGINAL2025.1164.6
FullBase Model=Llama-3-8B, Training Data Scale=100%2026.0563.55
MADS8BBase Model=Llama-3-8B, Training Data Scale=15%, Instructor Model=Llama-3.1-8B-Instruct2026.0562.54
LLAMA-4-SCOUTPARAMS=109B, Variant=FCSD2025.1162.4
InsTagBase Model=Llama-3-8B, Training Data Scale=15%2026.0562.21
QWEN-3-30B MOEPARAMS=30B, Variant=ORIGINAL2025.1161.9
ClusterClipBase Model=Llama-3-8B, Training Data Scale=15%2026.0561.87
MADS3BBase Model=Llama-3-8B, Training Data Scale=15%, Instructor Model=Llama-3.2-3B-Instruct2026.0561.87
MoDSBase Model=Llama-3-8B, Training Data Scale=15%2026.0561.54
NUGGETSBase Model=Llama-3-8B, Training Data Scale=15%2026.0561.2
IFDBase Model=Llama-3-8B, Training Data Scale=15%2026.0560.87
SelectITBase Model=Llama-3-8B, Training Data Scale=15%2026.0560.54
DEITABase Model=Llama-3-8B, Training Data Scale=15%2026.0559.52
QWEN-3-30B MOEPARAMS=30B, Variant=FCSD2025.1158.5
NUGGETSBase Model=Llama-2-7B, Training Data Scale=15%2026.0558.19
DEITABase Model=Llama-2-7B, Training Data Scale=15%2026.0557.86
Qwen3-4BModel Scale=4B2026.0457.39
IFDBase Model=Llama-2-7B, Training Data Scale=15%2026.0557.19
MADS8BBase Model=Llama-2-7B, Training Data Scale=15%, Instructor Model=Llama-3.1-8B-Instruct2026.0557.19
MADS3BBase Model=Llama-2-7B, Training Data Scale=15%, Instructor Model=Llama-3.2-3B-Instruct2026.0556.86
ClusterClipBase Model=Llama-2-7B, Training Data Scale=15%2026.0556.52
MoDSBase Model=Llama-2-7B, Training Data Scale=15%2026.0555.85
SelectITBase Model=Llama-2-7B, Training Data Scale=15%2026.0555.85
InsTagBase Model=Llama-2-7B, Training Data Scale=15%2026.0555.85
FullBase Model=Llama-2-7B, Training Data Scale=100%2026.0554.18
DEEPSEEK-V2-LITEPARAMS=16B, Variant=ORIGINAL2025.1153.8
SEA-LION v4 27B IT2026.0352.56
LLAMA-4-SCOUTPARAMS=109B, Variant=SFT2025.1152.4
DASH-3Budget=4.875, Search=12.3M / run, Train=700M2026.0551.88
DASH-3Budget=9.0, Search=12.3M / run, Train=700M2026.0551.79
DASH-3Budget=17.75, Search=12.3M / run, Train=700M2026.0551.62
SpB2.0-5BModel Scale=5B, Additional Training Tokens=14B2026.0451.53
Jet-Nemotron-4BSearch=N/R, Train=400B2026.0551.28
Gemma3-4BModel Scale=4B2026.0450.85
Qwen2.5-3BModel Scale=3B2026.0450.51
DEEPSEEK-V2-LITEPARAMS=16B, Variant=FCSD2025.1150
Jet-Nemotron-2BSearch=200B, Train=400B2026.0548.89
Llama3.2-3BModel Scale=3B2026.0445.76
QWEN-3-30B MOEPARAMS=30B, Variant=SFT2025.1144.9
DEEPSEEK-V2-LITEPARAMS=16B, Variant=SFT2025.1143.8
Gemma 3 27B IT2026.0334.9