List your company
ResearchFormerly WizWand

Knowledge and Commonsense Reasoning on MMLU

89.1AccuracyGPT-4o
23.621640.620857.6274.6192Sep 30, 2024Dec 17, 2024Mar 5, 2025May 22, 2025Aug 8, 2025Oct 25, 2025Jan 12, 2026
Updated 8mo ago

Evaluation results

MethodLinks
GPT-4oshots=52024.1089.1
GPT-4Vshots=52024.1086.4
Gemini-1.5 Proshots=52024.1085.9
Gemini-1.5 Flashshots=52024.1078.9
ARIAshots=52024.1073.3
Llama3.2-11Bshots=52024.1069.4
Pixtral-12Bshots=52024.1069.2
Engram-40BShots=5-shot2026.0160.6
Engram-27BShots=5-shot2026.0160.4
IAP-mvBackbone=LLaMA-2-13B-Chat2024.0958.25
Self-discBackbone=LLaMA-2-13B-Chat2024.0958.07
IAP-ssBackbone=LLaMA-2-13B-Chat2024.0957.72
MoE-27BShots=5-shot2026.0157.4
Prompt #8Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.0957.37
Prompt #7Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.0955.61
Dense-4BShots=5-shot2026.0148.6
Prompt #4Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.0947.89
Prompt #2Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.0942.81
Prompt #3Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.0941.23
Prompt #5Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.0939.3
Prompt #1Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.0937.54
Prompt #9Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.0928.77
Prompt #6Backbone=LLaMA-2-13B-Chat, Strategy=Zero-shot CoT2024.0926.14