Science Question Answering on ARC-C (ARC-C Score)
69.71ARC-C ScoreOPTIMER
Evaluation Results
| Method | Links | |
|---|---|---|
| OPTIMERBase Model=Gemma 3 27B2026.03 | 69.71 | |
| OPTIMERBase Model=SEA-LION v42026.03 | 68.94 | |
| LLAMA-4-SCOUTPARAMS=109B, Variant=ORIGINAL2025.11 | 64.6 | |
| FullBase Model=Llama-3-8B, Training Data Scale=100%2026.05 | 63.55 | |
| MADS8BBase Model=Llama-3-8B, Training Data Scale=15%, Instructor Model=Llama-3.1-8B-Instruct2026.05 | 62.54 | |
| LLAMA-4-SCOUTPARAMS=109B, Variant=FCSD2025.11 | 62.4 | |
| InsTagBase Model=Llama-3-8B, Training Data Scale=15%2026.05 | 62.21 | |
| QWEN-3-30B MOEPARAMS=30B, Variant=ORIGINAL2025.11 | 61.9 | |
| ClusterClipBase Model=Llama-3-8B, Training Data Scale=15%2026.05 | 61.87 | |
| MADS3BBase Model=Llama-3-8B, Training Data Scale=15%, Instructor Model=Llama-3.2-3B-Instruct2026.05 | 61.87 | |
| MoDSBase Model=Llama-3-8B, Training Data Scale=15%2026.05 | 61.54 | |
| NUGGETSBase Model=Llama-3-8B, Training Data Scale=15%2026.05 | 61.2 | |
| IFDBase Model=Llama-3-8B, Training Data Scale=15%2026.05 | 60.87 | |
| SelectITBase Model=Llama-3-8B, Training Data Scale=15%2026.05 | 60.54 | |
| DEITABase Model=Llama-3-8B, Training Data Scale=15%2026.05 | 59.52 | |
| QWEN-3-30B MOEPARAMS=30B, Variant=FCSD2025.11 | 58.5 | |
| NUGGETSBase Model=Llama-2-7B, Training Data Scale=15%2026.05 | 58.19 | |
| DEITABase Model=Llama-2-7B, Training Data Scale=15%2026.05 | 57.86 | |
| Qwen3-4BModel Scale=4B2026.04 | 57.39 | |
| IFDBase Model=Llama-2-7B, Training Data Scale=15%2026.05 | 57.19 | |
| MADS8BBase Model=Llama-2-7B, Training Data Scale=15%, Instructor Model=Llama-3.1-8B-Instruct2026.05 | 57.19 | |
| MADS3BBase Model=Llama-2-7B, Training Data Scale=15%, Instructor Model=Llama-3.2-3B-Instruct2026.05 | 56.86 | |
| ClusterClipBase Model=Llama-2-7B, Training Data Scale=15%2026.05 | 56.52 | |
| MoDSBase Model=Llama-2-7B, Training Data Scale=15%2026.05 | 55.85 | |
| SelectITBase Model=Llama-2-7B, Training Data Scale=15%2026.05 | 55.85 | |
| InsTagBase Model=Llama-2-7B, Training Data Scale=15%2026.05 | 55.85 | |
| FullBase Model=Llama-2-7B, Training Data Scale=100%2026.05 | 54.18 | |
| DEEPSEEK-V2-LITEPARAMS=16B, Variant=ORIGINAL2025.11 | 53.8 | |
| SEA-LION v4 27B IT2026.03 | 52.56 | |
| LLAMA-4-SCOUTPARAMS=109B, Variant=SFT2025.11 | 52.4 | |
| DASH-3Budget=4.875, Search=12.3M / run, Train=700M2026.05 | 51.88 | |
| DASH-3Budget=9.0, Search=12.3M / run, Train=700M2026.05 | 51.79 | |
| DASH-3Budget=17.75, Search=12.3M / run, Train=700M2026.05 | 51.62 | |
| SpB2.0-5BModel Scale=5B, Additional Training Tokens=14B2026.04 | 51.53 | |
| Jet-Nemotron-4BSearch=N/R, Train=400B2026.05 | 51.28 | |
| Gemma3-4BModel Scale=4B2026.04 | 50.85 | |
| Qwen2.5-3BModel Scale=3B2026.04 | 50.51 | |
| DEEPSEEK-V2-LITEPARAMS=16B, Variant=FCSD2025.11 | 50 | |
| Jet-Nemotron-2BSearch=200B, Train=400B2026.05 | 48.89 | |
| Llama3.2-3BModel Scale=3B2026.04 | 45.76 | |
| QWEN-3-30B MOEPARAMS=30B, Variant=SFT2025.11 | 44.9 | |
| DEEPSEEK-V2-LITEPARAMS=16B, Variant=SFT2025.11 | 43.8 | |
| Gemma 3 27B IT2026.03 | 34.9 |