List your company
ResearchFormerly WizWand

Answer-position balance evaluation on MCQ

0.061MCQ TVGPT-OSS-20B
0.047520.138510.22950.32049May 12, 2026
Updated 5mo ago

Evaluation results

MethodLinks
GPT-OSS-20BCalibration=Soft2026.050.061
Llama-3.2-3B-itCalibration=Base2026.050.066
GPT-OSS-20BCalibration=Hard2026.050.072
Qwen3-4BCalibration=Soft2026.050.116
Qwen3-4BCalibration=Hard2026.050.156
Llama-3.2-1B-itCalibration=Base2026.050.159
GPT-OSS-20BCalibration=Base2026.050.166
Gemma-3-4B-itCalibration=Soft2026.050.178
Qwen3-14BCalibration=Soft2026.050.184
Llama-3.2-3B-itCalibration=Soft2026.050.187
Llama-3.2-3B-itCalibration=Hard2026.050.189
Qwen3-14BCalibration=Hard2026.050.19
Qwen3-4BCalibration=Base2026.050.192
Llama-3.2-1B-itCalibration=Hard2026.050.199
Gemma-3-1B-itCalibration=Hard2026.050.203
Gemma-3-1B-itCalibration=Soft2026.050.205
Gemma-3-1B-itCalibration=Base2026.050.209
Qwen3-8BCalibration=Hard2026.050.221
Gemma-3-27B-itCalibration=Hard2026.050.238
Qwen3-8BCalibration=Base2026.050.24
Qwen3-8BCalibration=Soft2026.050.24
Gemma-3-4B-itCalibration=Base2026.050.24
Qwen3-1.7BCalibration=Soft2026.050.249
Gemma-3-4B-itCalibration=Hard2026.050.256
Qwen3-14BCalibration=Base2026.050.284
Gemma-3-27B-itCalibration=Base2026.050.284
Qwen3-1.7BCalibration=Hard2026.050.288
Gemma-3-12B-itCalibration=Soft2026.050.289
Qwen3-1.7BCalibration=Base2026.050.313
Gemma-3-12B-itCalibration=Hard2026.050.313
Gemma-3-27B-itCalibration=Soft2026.050.315
Gemma-3-12B-itCalibration=Base2026.050.335
Qwen3-0.6BCalibration=Base2026.050.374
Qwen3-0.6BCalibration=Hard2026.050.398