List your company
ResearchFormerly WizWand

Question Answering on HotpotQA (test) (Cost and Coverage Metrics)

0Cost (cents)LLaMA-2 EXIT
-33.08190.21413.5636.79Nov 14, 2025
Updated 7mo ago

Evaluation results

MethodLinks
LLaMA-2 EXITBase model=LLaMA-2-7B, alpha=0.12025.11065.32.552.55
LLaMA-2-7BBase model=LLaMA-2-7B, alpha=0.12025.114.55167.51.031
CPOBase model=LLaMA-2-7B, alpha=0.12025.114.70483.21.0041
CCPOlambda=0, Base model=LLaMA-2-7B, alpha=0.12025.116.55290.21.342.35
RandomBase model=LLaMA-2-7B, alpha=0.12025.116.81157.81.441
CCPOlambda=2e-4, Base model=LLaMA-2-7B, alpha=0.12025.117.02690.31.482.22
CPO onlineBase model=LLaMA-2-7B, alpha=0.12025.117.48489.71.582.38
CPO batchBase model=LLaMA-2-7B, alpha=0.12025.117.83590.51.72.19
UALABase model=LLaMA-2-7B, alpha=0.12025.119.15392.322
GPT-4oBase model=LLaMA-2-7B, alpha=0.12025.1118.65781.21
GPT-4o EXITBase model=LLaMA-2-7B, alpha=0.12025.1182790.82.392.39