List your company
ResearchFormerly WizWand

Question Answering on MMLU (test) (Cost and Coverage Evaluation)

0Cost (cents)LLaMA-2 EXIT
-4.18424.05852.380.542Nov 14, 2025
Updated 7mo ago

Evaluation results

MethodLinks
LLaMA-2 EXITBase Model=LLaMA-2-7B, alpha=0.12025.1100.793.143.14
CCPOBase Model=LLaMA-2-7B, alpha=0.1, lambda=02025.117.9490.921.082.14
CCPOBase Model=LLaMA-2-7B, alpha=0.1, lambda=2e-42025.118.0710.9071.111.48
LLaMA-2-7BBase Model=LLaMA-2-7B, alpha=0.12025.118.6820.661.111
CPOBase Model=LLaMA-2-7B, alpha=0.12025.119.1740.71.1951
RandomBase Model=LLaMA-2-7B, alpha=0.12025.1112.990.5451.531
UALABase Model=LLaMA-2-7B, alpha=0.12025.1116.990.9222
CPO onlineBase Model=LLaMA-2-7B, alpha=0.12025.1119.070.9012.483.46
CPO batchBase Model=LLaMA-2-7B, alpha=0.12025.1122.250.9022.864.2
GPT-4oBase Model=LLaMA-2-7B, alpha=0.12025.1125.350.931.081
GPT-4o EXITBase Model=LLaMA-2-7B, alpha=0.12025.11104.60.961.391.39