List your company
ResearchFormerly WizWand

Question Answering on ARC Challenge (ARC-Challenge Score)

37.3ARC-Challenge ScorePre-unlearn
22.94826.67430.434.126Oct 1, 2025Nov 6, 2025Dec 12, 2025Jan 18, 2026Feb 23, 2026Mar 31, 2026May 7, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Pre-unlearn2025.1037.3
NPO w/ ZOAlgorithm=NPO, Optimizer=ZO2025.1035.5
GradDiff w/ signAdamAlgorithm=GradDiff, Optimizer=signAdam2025.1035.3
GradDiff w/ RSAlgorithm=GradDiff, Optimizer=RS2025.1034.9
Echo-180MParams=180M, Tokens=10B, Zero-shot=true2026.0534.2
GradDiffAlgorithm=GradDiff2025.1033.6
GradDiff w/ SAMAlgorithm=GradDiff, Optimizer=SAM2025.1033.5
GradDiff w/ signSGDAlgorithm=GradDiff, Optimizer=signSGD2025.1033
NPO w/ signSGDAlgorithm=NPO, Optimizer=signSGD2025.1031.7
NPO w/ signAdamAlgorithm=NPO, Optimizer=signAdam2025.1028.8
NPO w/ RSAlgorithm=NPO, Optimizer=RS2025.1028.2
GDN-180MParams=180M, Tokens=100B, Zero-shot=true2026.0528.2
Transformer-180MParams=180M, Tokens=100B, Zero-shot=true2026.0527.9
Mamba-3-SISO-180MParams=180M, Tokens=100B, Zero-shot=true2026.0527.9
Mamba-3-MIMO-180MParams=180M, Tokens=100B, Zero-shot=true2026.0527.7
GradDiff w/ ZOAlgorithm=GradDiff, Optimizer=ZO2025.1027.4
NPOAlgorithm=NPO2025.1027.3
Mamba-2-180MParams=180M, Tokens=100B, Zero-shot=true2026.0527.3
NPO w/ SAMAlgorithm=NPO, Optimizer=SAM2025.1026.7
Echo-50MParams=50M, Tokens=3B, Zero-shot=true2026.0524.4
GradDiff w/ HybridAlgorithm=GradDiff, Optimizer=Hybrid2025.1024.2
NPO w/ HybridAlgorithm=NPO, Optimizer=Hybrid2025.1023.5