List your company
ResearchFormerly WizWand

End-to-End Selection on AlgoSimBench MCQ

75.1AccuracyASM-PL
21.85235.67649.563.324Jul 21, 2025
Updated 4mo ago

Evaluation results

MethodLinks
ASM-PLModel=o3-mini-medium2025.0775.1
ASM-NLModel=o3-mini-medium2025.0774.4
Solution*Model=o3-mini-medium2025.0772.6
Solution*Model=Deepseek-R12025.0770.6
Solution*Model=Claude-3.5-Sonnet2025.0770.5
ASM-PLModel=Deepseek-R12025.0770.4
Solution*Model=Gemini-2.0-Flash2025.0769.7
ASM-NLModel=Deepseek-R12025.0769.2
ASM-NLModel=Qwen3-Coder-480B2025.0768.4
Solution*Model=Qwen3-Coder-480B2025.0766.9
Solution*Model=Deepseek-V32025.0766.7
StatementModel=o3-mini-medium2025.0765.9
ASM-NLModel=Deepseek-V32025.0764.9
StatementModel=Deepseek-R12025.0763.7
Solution*Model=GPT-4o2025.0763.4
SummaryModel=o3-mini-medium2025.0763.4
ASM-PLModel=Deepseek-V32025.0762.7
Solution*Model=Qwen3-8B-thinking2025.0762.4
ASM-PLModel=Qwen3-Coder-480B2025.0762.4
Solution*Model=Qwen3-4B-thinking2025.0759.2
ASM-NLModel=Qwen3-8B-thinking2025.0758.2
ASM-NLModel=Gemini-2.0-Flash2025.0757.9
SummaryModel=Deepseek-R12025.0757.7
ASM-PLModel=Qwen3-8B-thinking2025.0757
ASM-PLModel=Gemini-2.0-Flash2025.0755.5
StatementModel=Deepseek-V32025.0755.2
ASM-NLModel=Claude-3.5-Sonnet2025.0754.7
Solution*Model=GPT-4o-mini2025.0754.4
ASM-PLModel=Qwen3-4B-thinking2025.0753.9
ASM-NLModel=GPT-4o2025.0753.2
SummaryModel=Deepseek-V32025.0753.2
ASM-NLModel=Qwen3-4B-thinking2025.0753
ASM-PLModel=GPT-4o2025.0753
ASM-PLModel=Claude-3.5-Sonnet2025.0753
StatementModel=Gemini-2.0-Flash2025.0751.2
SummaryModel=Qwen3-Coder-480B2025.0751
StatementModel=Qwen3-Coder-480B2025.0750.7
SummaryModel=Gemini-2.0-Flash2025.0748.5
StatementModel=Qwen3-8B-thinking2025.0747.5
SummaryModel=Qwen3-8B-thinking2025.0746.3
SummaryModel=Claude-3.5-Sonnet2025.0745
StatementModel=Claude-3.5-Sonnet2025.0744.2
ASM-NLModel=GPT-4o-mini2025.0743.8
StatementModel=Qwen3-4B-thinking2025.0743.3
ASM-PLModel=GPT-4o-mini2025.0742.5
StatementModel=GPT-4o2025.0741.5
SummaryModel=Qwen3-4B-thinking2025.0741.2
SummaryModel=GPT-4o2025.0738.1
SummaryModel=GPT-4o-mini2025.0735.8
StatementModel=GPT-4o-mini2025.0735.6
ASM-NLModel=Qwen3-0.6B-thinking2025.0733.3
ASM-PLModel=Qwen3-0.6B-thinking2025.0731.3
Solution*Model=Qwen3-0.6B-thinking2025.0730.6
Solution*Model=Llama3.1-8B-Instruct2025.0729.6
ASM-NLModel=Llama3.1-8B-Instruct2025.0726.4
SummaryModel=Qwen3-0.6B-thinking2025.0726.1
StatementModel=Qwen3-0.6B-thinking2025.0725.8
ASM-PLModel=Llama3.1-8B-Instruct2025.0724.4
SummaryModel=Llama3.1-8B-Instruct2025.0724.1
StatementModel=Llama3.1-8B-Instruct2025.0723.9