List your company
ResearchFormerly WizWand

Problem Solving on List Function (test)

203AccuracyHCoT(Split-16+8)
82.36113.68145176.32Apr 14, 2026
Updated 6mo ago

Evaluation results

MethodLinks
HCoT(Split-16+8)Base-model=DeepSeek R1, Problem-solving approach=HCoT(Split-16+8)2026.04203
HCoT(24-solutions)Base-model=DeepSeek R1, Problem-solving approach=HCoT(24-solutions)2026.04198
HCoT(24-solutions-best-of-2)Base-model=DeepSeek R1, Problem-solving approach=HCoT(24-solutions-best-of-2)2026.04197
HCoT(Split-12+12)Base-model=DeepSeek R1, Problem-solving approach=HCoT(Split-12+12)2026.04195
HCoT(16-solutions)Base-model=DeepSeek R1, Problem-solving approach=HCoT(16-solutions)2026.04194
IO-PromptBase-model=DeepSeek R1, Problem-solving approach=IO-Prompt2026.04190
Auto CoT-PromptBase-model=DeepSeek R1, Problem-solving approach=Auto CoT-Prompt2026.04183
HCoT(Split-12+12)Base-model=DeepSeek V3, Problem-solving approach=HCoT(Split-12+12)2026.04178
HCoT(Split-16+8)Base-model=DeepSeek V3, Problem-solving approach=HCoT(Split-16+8)2026.04173
HCoT(24-solutions-best-of-2)Base-model=DeepSeek V3, Problem-solving approach=HCoT(24-solutions-best-of-2)2026.04166
HCoT(24-solutions)Base-model=DeepSeek V3, Problem-solving approach=HCoT(24-solutions)2026.04165
HCoT(16-solutions)Base-model=DeepSeek V3, Problem-solving approach=HCoT(16-solutions)2026.04163
ToT-PromptBase-model=DeepSeek V3, Problem-solving approach=ToT-Prompt2026.04161
IO-PromptBase-model=DeepSeek V3, Problem-solving approach=IO-Prompt2026.04151
Auto CoT-PromptBase-model=DeepSeek V3, Problem-solving approach=Auto CoT-Prompt2026.04151
ToT-PromptBase-model=DeepSeek R1, Problem-solving approach=ToT-Prompt2026.04136
HCoT(Split-16+8)Base-model=GPT-4o-2024-08-06, Problem-solving approach=HCoT(Split-16+8)2026.04108
HCoT(16-solutions)Base-model=GPT-4o-2024-08-06, Problem-solving approach=HCoT(16-solutions)2026.04106
HCoT(Split-12+12)Base-model=GPT-4o-2024-08-06, Problem-solving approach=HCoT(Split-12+12)2026.04102
HCoT(24-solutions)Base-model=GPT-4o-2024-08-06, Problem-solving approach=HCoT(24-solutions)2026.0498
HCoT(24-solutions-best-of-2)Base-model=GPT-4o-2024-08-06, Problem-solving approach=HCoT(24-solutions-best-of-2)2026.0498
Auto CoT-PromptBase-model=GPT-4o-2024-08-06, Problem-solving approach=Auto CoT-Prompt2026.0492
IO-PromptBase-model=GPT-4o-2024-08-06, Problem-solving approach=IO-Prompt2026.0487
ToT-PromptBase-model=GPT-4o-2024-08-06, Problem-solving approach=ToT-Prompt2026.0487