List your company
ResearchFormerly WizWand

Question Answering on GSM8K (test)

84.3AccuracyDLR
11.39630.32349.2568.177May 26, 2025Jul 23, 2025Sep 20, 2025Nov 18, 2025Jan 16, 2026Mar 16, 2026May 14, 2026
Updated 5mo ago

Evaluation results

MethodLinks
DLRModel=Qwen3-8B2026.0584.3
DLRModel=Qwen3-4B2026.0582.1
PauseTokenModel=Qwen3-8B2026.0579.4
SFTModel=Qwen3-8B2026.0578.9
DLR (C=1)Model=Qwen3-8B2026.0578.9
PauseTokenModel=Qwen3-4B2026.0578.6
DLR (C=1)Model=Qwen3-4B2026.0578.6
SFTModel=Qwen3-4B2026.0575.4
DLRModel=Qwen3-1.7B2026.0565.7
DLR (C=1)Model=Qwen3-1.7B2026.0563.5
TokenAssortedModel=Qwen3-8B2026.0563
PauseTokenModel=Qwen3-1.7B2026.0560.9
TokenAssortedModel=Qwen3-4B2026.0560.9
SFTModel=Qwen3-1.7B2026.0560.2
DLRModel=Qwen3-0.6B2026.0549.4
DLRModel=Llama3.2-3B2026.0549.1
DLR (C=1)Model=Llama3.2-3B2026.0546.3
PauseTokenModel=Qwen3-0.6B2026.0546.2
SFTModel=Qwen3-0.6B2026.0546
DLR (C=1)Model=Qwen3-0.6B2026.0545.8
PauseTokenModel=Llama3.2-3B2026.0541.5
SFTModel=Llama3.2-3B2026.0541.3
DLRModel=Llama3.2-1B2026.0541.1
DLR (C=1)Model=Llama3.2-1B2026.0538.4
PauseTokenModel=Llama3.2-1B2026.0531.3
SFTModel=Llama3.2-1B2026.0530.9
TokenAssortedModel=Qwen3-1.7B2026.0528.5
TokenAssortedModel=Llama3.2-3B2026.0521.8
LWF-mixedsetting=mixed2025.0521.08
BSSsetting=mixed2025.0520.39
vanilla-FTtraining_strategy=fine-tuning2025.0519.71
SRSsetting=mixed2025.0517.36
F-learningsetting=mixed2025.0517.29
TokenAssortedModel=Qwen3-0.6B2026.0515.7
TokenAssortedModel=Llama3.2-1B2026.0514.2