List your company
ResearchFormerly WizWand

Response correctness and completeness evaluation on Math

87F1 ScoreHALT
4.8426.1747.568.83Jun 4, 2025
Updated 8mo ago

Evaluation results

MethodLinks
HALTLLM=Llama-3-70B, n_desired=n_capable2025.0687
HALTLLM=Gemma-2-9B, n_desired=n_capable2025.0679
UnchangedLLM=Llama-3-70B, n_desired=n_capable2025.0675
RandomTrimLLM=Llama-3-70B, n_desired=n_capable2025.0675
HALTLLM=Mistral-7B, n_desired=n_capable2025.0669
UnchangedLLM=Llama-3-70B, n_desired=n_all2025.0668
HALTLLM=Llama-3-70B, n_desired=n_all2025.0668
Abstain (IDK)LLM=Llama-3-70B, n_desired=n_capable2025.0668
HALTLLM=Llama-3-8B, n_desired=n_capable2025.0666
RandomTrimLLM=Llama-3-70B, n_desired=n_all2025.0664
UnchangedLLM=Gemma-2-9B, n_desired=n_capable2025.0664
RandomTrimLLM=Gemma-2-9B, n_desired=n_capable2025.0659
Abstain (IDK)LLM=Llama-3-70B, n_desired=n_all2025.0653
UnchangedLLM=Mistral-7B, n_desired=n_capable2025.0650
UnchangedLLM=Llama-3-8B, n_desired=n_capable2025.0649
RandomTrimLLM=Mistral-7B, n_desired=n_capable2025.0643
Abstain (IDK)LLM=Mistral-7B, n_desired=n_capable2025.0643
UnchangedLLM=Gemma-2-9B, n_desired=n_all2025.0642
HALTLLM=Gemma-2-9B, n_desired=n_all2025.0641
Abstain (IDK)LLM=Llama-3-8B, n_desired=n_capable2025.0638
Abstain (IDK)LLM=Gemma-2-9B, n_desired=n_capable2025.0638
HALTLLM=Llama-3-8B, n_desired=n_all2025.0635
UnchangedLLM=Mistral-7B, n_desired=n_all2025.0631
UnchangedLLM=Llama-3-8B, n_desired=n_all2025.0630
HALTLLM=Mistral-7B, n_desired=n_all2025.0628
RandomTrimLLM=Gemma-2-9B, n_desired=n_all2025.0628
RandomTrimLLM=Llama-3-8B, n_desired=n_capable2025.0626
Abstain (IDK)LLM=Gemma-2-9B, n_desired=n_all2025.0613
Abstain (IDK)LLM=Llama-3-8B, n_desired=n_all2025.0612
RandomTrimLLM=Mistral-7B, n_desired=n_all2025.0612
Abstain (IDK)LLM=Mistral-7B, n_desired=n_all2025.069
RandomTrimLLM=Llama-3-8B, n_desired=n_all2025.068