List your company
ResearchFormerly WizWand

Reasoning on GSM8K

1AccuracyGPT-5.2
0.3740240.5365370.699050.861563Sep 22, 2025Nov 3, 2025Dec 15, 2025Jan 26, 2026Mar 9, 2026Apr 20, 2026Jun 1, 2026
Updated 4mo ago

Evaluation results

MethodLinks
GPT-5.2Category=MLLM, Note=direct2026.021——
Claude-Sonnet 4.5Category=MLLM, Note=direct2026.021——
TwC (Ours) - Only ImageCategory=Think with Comic, Note=direct2026.021——
Gemini-3-ProCategory=MLLM, Note=direct2026.020.99——
DeepSeek-R1Category=Reasoning LLM, Note=CoT2026.020.961——
TwC (Ours) - Img & TxtCategory=Think with Comic, Note=G-t-R2026.020.954——
Qwen3-235B-A22BCategory=Reasoning LLM, Note=CoT2026.020.943——
eMoTModels=Qwen-32B2026.060.934——
Qwen3-8BLoss function=base+aux2026.020.9333——
BoTModels=GPT-42026.060.933——
Qwen3-8BLoss function=base2026.020.9242——
Qwen3-4BLoss function=base2026.020.9234——
Qwen3-4BLoss function=base+aux2026.020.9181——
RM-RegenBase Model=Llama 3.1-8B2026.030.872——
ST CoTBase Model=Llama 3.1-8B, Iterations=32026.030.87——
ST CoTBase Model=Llama 3.1-8B, Iterations=22026.030.866——
Persona SwitchModel=LLaMA-3.1 (8B), Zero-shot=true2026.010.8575——
BaselineTopology=Complete2025.110.8541——
Random SelectionModel=LLaMA-3.1 (8B), Zero-shot=true2026.010.8471——
Low-gap SelectionModel=LLaMA-3.1 (8B), Zero-shot=true2026.010.837——
GreedyModel=LLaMA-3.1 (8B), Zero-shot=true2026.010.8362——
RM-RegenBase Model=GPT-3.52026.030.836——
ProCoBase Model=Llama 3.1-8B, Iterations=22026.030.834——
ProCoBase Model=Llama 3.1-8B, Iterations=32026.030.834——
ST CoTBase Model=Llama 3.1-8B, Iterations=52026.030.832——
MultinomialModel=LLaMA-3.1 (8B), Zero-shot=true2026.010.8317——
ST CoTBase Model=Llama 3.1-8B, Iterations=42026.030.83——
ProCoBase Model=Llama 3.1-8B, Iterations=52026.030.826——
ST CoTBase Model=GPT-3.5, Iterations=22026.030.822——
ProCoBase Model=GPT-3.5, Iterations=42026.030.818——
MAS-ShieldTopology=Complete2025.110.817916.71—
BaselineTopology=Chain2025.110.8173——
MAS-ShieldTopology=Chain2025.110.814625.72—
LLaMA3.1-8BLoss function=base+aux2026.020.8118——
s1.1-7B2026.020.81——
ProCoBase Model=GPT-3.5, Iterations=32026.030.808——
ST CoTBase Model=GPT-3.5, Iterations=42026.030.806——
ProCoBase Model=Llama 3.1-8B, Iterations=42026.030.804——
ST CoTBase Model=GPT-3.5, Iterations=32026.030.802——
BaselineTopology=Tree2025.110.8007——
ProCoBase Model=GPT-3.5, Iterations=22026.030.8006——
Top-pModel=LLaMA-3.1 (8B), Zero-shot=true2026.010.7991——
Top-kModel=LLaMA-3.1 (8B), Zero-shot=true2026.010.7983——
LLaMA3.1-8BLoss function=base2026.020.7885——
MAS-ShieldTopology=Tree2025.110.779216.19—
Role-Play PromptingModel=LLaMA-3.1 (8B), Zero-shot=true2026.010.7703——
Persona SwitchModel=LLaMA-3.2 (3B), Zero-shot=true2026.010.7665——
Self-RefineBase Model=Llama 3.1-8B, Iterations=22026.030.758——
Sora 2Category=Think with Video, Note=V-o-T, Citation Source=Tong et al., 20252026.020.757——
Self-RefineBase Model=Llama 3.1-8B, Iterations=32026.030.756——
Self-RefineBase Model=Llama 3.1-8B, Iterations=42026.030.756——
Self-RefineBase Model=Llama 3.1-8B, Iterations=52026.030.754——
Random SelectionModel=LLaMA-3.2 (3B), Zero-shot=true2026.010.7473——
BaselineTopology=Circle2025.110.7386——
Self-RefineBase Model=GPT-3.5, Iterations=22026.030.734——
GreedyModel=LLaMA-3.2 (3B), Zero-shot=true2026.010.7309——
MultinomialModel=LLaMA-3.2 (3B), Zero-shot=true2026.010.7301——
Low-gap SelectionModel=LLaMA-3.2 (3B), Zero-shot=true2026.010.7271——
BaselineTopology=Star2025.110.7267——
MAS-ShieldTopology=Circle2025.110.721710.42—
PaLModels=Codex (175B)2026.060.72——
Top-pModel=LLaMA-3.2 (3B), Zero-shot=true2026.010.7172——
Role-Play PromptingModel=LLaMA-3.2 (3B), Zero-shot=true2026.010.7149——
DGR SFTAlignment Dataset=DirectRefusal, Backbone=s1.1-7B2026.020.711——
Self-RefineBase Model=GPT-3.5, Iterations=42026.030.706——
Self-RefineBase Model=GPT-3.5, Iterations=32026.030.704——
MAS-ShieldTopology=Star2025.110.703111.81—
TASOModel=Qwen2.5 3B, #Param.=2.06 M, Evaluation Protocol=Zero-shot2025.090.7004——
DGR SFTAlignment Dataset=STAR-1, Backbone=s1.1-7B2026.020.697——
TWI-1-Generated PhotoCategory=Think with Image, Note=G-t-R2026.020.694——
LoRA-XSModel=Qwen2.5 3B, #Param.=4.13 M, rank=128, Evaluation Protocol=Zero-shot2025.090.6909——
VERAModel=Qwen2.5 3B, #Param.=1.42 M, rank=1024, Evaluation Protocol=Zero-shot2025.090.689——
LoRAModel=Qwen2.5 3B, #Param.=14.97 M, rank=8, Evaluation Protocol=Zero-shot2025.090.6883——
AdaLoRAModel=Qwen2.5 3B, #Param.=61.32 M, rank=32, Evaluation Protocol=Zero-shot2025.090.6872——
DoRAModel=Qwen2.5 3B, #Param.=65.98 M, rank=32, Evaluation Protocol=Zero-shot2025.090.6853——
LoRAModel=Qwen2.5 3B, #Param.=59.87 M, rank=32, Evaluation Protocol=Zero-shot2025.090.6834——
Top-kModel=LLaMA-3.2 (3B), Zero-shot=true2026.010.6755——
Fine-tuneModel=Qwen2.5 3B, #Param.=3151.91 M, Evaluation Protocol=Zero-shot2025.090.672——
AdapterModel=Qwen2.5 3B, #Param.=67.10 M, Evaluation Protocol=Zero-shot2025.090.6644——
Vanilla SFTAlignment Dataset=STAR-1, Backbone=s1.1-7B2026.020.663——
AttackTopology=Complete2025.110.6508——
IA3Model=Qwen2.5 3B, #Param.=1.35 M, Evaluation Protocol=Zero-shot2025.090.6464——
Persona SwitchModel=Gemma-2 (2B), Zero-shot=true2026.010.6414——
Role-Play PromptingModel=Gemma-2 (2B), Zero-shot=true2026.010.6361——
Random SelectionModel=Gemma-2 (2B), Zero-shot=true2026.010.6325——
GreedyModel=Gemma-2 (2B), Zero-shot=true2026.010.6308——
Low-gap SelectionModel=Gemma-2 (2B), Zero-shot=true2026.010.6186——
AttackTopology=Circle2025.110.6175——
AttackTopology=Tree2025.110.6173——
Top-pModel=Gemma-2 (2B), Zero-shot=true2026.010.6118——
Qwen2.5-7B-Instruct2026.020.604——
DGR SFTAlignment Dataset=R1-ACT, Backbone=s1.1-7B2026.020.6——
Top-kModel=Gemma-2 (2B), Zero-shot=true2026.010.5959——
MultinomialModel=Gemma-2 (2B), Zero-shot=true2026.010.5921——
AttackTopology=Star2025.110.585——
AttackTopology=Chain2025.110.5573——
Fine-tuneModel=LLaMA3.2 3B, #Param.=3266.58 M, Evaluation Protocol=Zero-shot2025.090.4511——
AdaLoRAModel=LLaMA3.2 3B, #Param.=49.51 M, rank=32, Evaluation Protocol=Zero-shot2025.090.4106——
DoRAModel=LLaMA3.2 3B, #Param.=53.73 M, rank=32, Evaluation Protocol=Zero-shot2025.090.4——
TASOModel=LLaMA3.2 3B, #Param.=1.67 M, Evaluation Protocol=Zero-shot2025.090.3981——