List your company
ResearchFormerly WizWand

Multiple Choice Question Answering on MMLU continuation (test)

39.65AccuracyTOP
28.022831.041434.0637.0786Aug 26, 2025
Updated 8mo ago

Evaluation results

MethodLinks
TOPSize=7B, Zero-shot=true2025.0839.65
NTPSize=7B, Zero-shot=true2025.0839.47
DS-MTPSize=7B, Zero-shot=true2025.0838.16
MTPSize=7B, Zero-shot=true2025.0838.14
TOPSize=1.8B, Zero-shot=true2025.0836.21
NTPSize=1.8B, Zero-shot=true2025.0835.34
DS-MTPSize=1.8B, Zero-shot=true2025.0835.01
MTPSize=1.8B, Zero-shot=true2025.0834.76
TOPSize=340M, Zero-shot=true2025.0830.09
NTPSize=340M, Zero-shot=true2025.0829.81
MTPSize=340M, Zero-shot=true2025.0829.08
DS-MTPSize=340M, Zero-shot=true2025.0828.47