List your company
ResearchFormerly WizWand

Mathematical Reasoning Accuracy on GSM8K (test)

83.55AccuracyBBoxER
53.826861.543469.2676.9766Jul 2, 2025
Updated 4mo ago

Evaluation results

MethodLinks
BBoxERBase Model=Qwen-2.5-3B-instruct, Budget (b)=300, 8-shot evaluation=true, Optimization Algorithm=D-CMA, Update Type=normalization layers2025.0783.55
BBoxERBase Model=Qwen-2.5-3B-instruct, Budget (b)=150, 8-shot evaluation=true, Optimization Algorithm=D-CMA, Update Type=normalization layers2025.0782.9
Qwen-2.5-3B-instruct8-shot evaluation=true2025.0779.98
BBoxERBase Model=Llama3.1-8B-Instruct, Budget (b)=300, 8-shot evaluation=true, Optimization Algorithm=D-CMA, Update Type=normalization layers2025.0778.57
BBoxERBase Model=Llama3.1-8B-Instruct, Budget (b)=150, 8-shot evaluation=true, Optimization Algorithm=D-CMA, Update Type=normalization layers2025.0777.79
Llama3.1-8B-Instruct8-shot evaluation=true2025.0777.26
BBoxERBase Model=Llama3.1-8B, Budget (b)=300, 8-shot evaluation=true, Optimization Algorithm=D-CMA, Update Type=normalization layers2025.0756.65
BBoxERBase Model=Llama3.1-8B, Budget (b)=150, 8-shot evaluation=true, Optimization Algorithm=D-CMA, Update Type=normalization layers2025.0755.24
Llama3.1-8B8-shot evaluation=true2025.0754.97