List your company
ResearchFormerly WizWand

Commonsense Reasoning on Commonsense Reasoning

85AccuracyMultiplex CoT
30.431244.598158.76572.9319Jan 20, 2025Apr 12, 2025Jul 4, 2025Sep 24, 2025Dec 16, 2025Mar 8, 2026May 30, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Multiplex CoTReasoning Method=Multiplex Chain of Thought2025.0185912—
Self-DistillationBackbone=Llama3-8B2026.0581.9———
DASDBackbone=Llama3-8B2026.0581.6———
Hint-decodingBackbone=Llama3-8B2026.0581.4———
Mask-PPLBackbone=Llama3-8B2026.0581———
BaseBackbone=Llama3-8B2026.0579.9———
CoTReasoning Method=Standard Chain of Thought2025.0178———
Baseline (full model)Sparsity=0%, Backbone=Phi-4-14B2025.0574.38———
WINASparsity=25%, Backbone=Phi-4-14B2025.0574.25———
TEALSparsity=25%, Backbone=Phi-4-14B2025.0574.12———
WINASparsity=40%, Backbone=Phi-4-14B2025.0573.76———
WINASparsity=50%, Backbone=Phi-4-14B2025.0573.51———
TEALSparsity=40%, Backbone=Phi-4-14B2025.0573.49———
TEALSparsity=50%, Backbone=Phi-4-14B2025.0572.73———
DensePruning Ratio=0%, Backbone=Phi-4-14B, Zero-shot=true2025.1272.66———
QLoRABit=4, Model=Qwen2.5-7B-Ins, Fine-tuning=true2026.0571.59———
WINASparsity=65%, Backbone=Phi-4-14B2025.0571.58———
DensePruning Ratio=0%, Backbone=Mistral-7B, Zero-shot=true2025.1271.4———
Token FilteringPruning Ratio=20%, Backbone=Phi-4-14B, Zero-shot=true2025.1270.52———
DensePruning Ratio=0%, Backbone=LLaMA-3-8B, Zero-shot=true2025.1270.39———
TEALSparsity=65%, Backbone=Phi-4-14B2025.0569.93———
FP16Bit=16, Model=Qwen2.5-7B-Ins, Fine-tuning=true2026.0569.84———
DenseKV cache budget%=100%, TOPS(token/s)=4.7, Memory(MB)=51531.9, Backbone=LLaMA-2-13B2025.1269.51———
ProjQBit=4, Model=LLaMA2-7B, Fine-tuning=true2026.0568.7———
QLoRABit=4, Model=LLaMA2-7B, Fine-tuning=true2026.0568.63———
FP16Bit=16, Model=LLaMA2-7B, Fine-tuning=true2026.0568.07———
Token FilteringPruning Ratio=20%, Backbone=LLaMA-3-8B, Zero-shot=true2025.1267.94———
LoftQBit=4, Model=LLaMA2-7B, Fine-tuning=true2026.0567.21———
H2OKV cache budget%=50%, TOPS(token/s)=8.2 (+76%), Memory(MB)=38444.1 (-25.4%), Backbone=LLaMA-2-13B2025.1266.99———
DensePruning Ratio=0%, Backbone=LLaMA-2-7B, Zero-shot=true2025.1266.88———
ProjQBit=4, Model=Qwen2.5-7B-Ins, Fine-tuning=true2026.0566.78———
Token FilteringKV cache budget%=50%, TOPS(token/s)=8.8 (+87%), Memory(MB)=38421.3 (-25.5%), Backbone=LLaMA-2-13B2025.1265.9———
Token FilteringPruning Ratio=20%, Backbone=Mistral-7B, Zero-shot=true2025.1265.82———
LoftQBit=4, Model=Qwen2.5-7B-Ins, Fine-tuning=true2026.0564.56———
SlimGPT w/oPruning Ratio=20%, Backbone=LLaMA-2-7B, Zero-shot=true2025.1264.27———
Token FilteringPruning Ratio=20%, Backbone=LLaMA-2-7B, Zero-shot=true2025.1263.61———
PPPruning Ratio=20%, Backbone=LLaMA-2-7B, Zero-shot=true2025.1263.34———
FLAPPruning Ratio=20%, Backbone=LLaMA-2-7B, Zero-shot=true2025.1263.1———
SlimGPT w/oPruning Ratio=20%, Backbone=LLaMA-3-8B, Zero-shot=true2025.1262.76———
Token FilteringPruning Ratio=50%, Backbone=Phi-4-14B, Zero-shot=true2025.1259.87———
Token FilteringPruning Ratio=50%, Backbone=LLaMA-3-8B, Zero-shot=true2025.1259.31———
PPPruning Ratio=20%, Backbone=LLaMA-3-8B, Zero-shot=true2025.1258.66———
FLAPPruning Ratio=20%, Backbone=Mistral-7B, Zero-shot=true2025.1257.72———
FLAPPruning Ratio=20%, Backbone=LLaMA-3-8B, Zero-shot=true2025.1255.75———
SlimGPT w/oPruning Ratio=20%, Backbone=Mistral-7B, Zero-shot=true2025.1255.51———
Token FilteringPruning Ratio=50%, Backbone=LLaMA-2-7B, Zero-shot=true2025.1253.13———
SlimGPT w/oPruning Ratio=50%, Backbone=LLaMA-2-7B, Zero-shot=true2025.1251.45———
PPPruning Ratio=50%, Backbone=LLaMA-2-7B, Zero-shot=true2025.1250.59———
Token FilteringPruning Ratio=50%, Backbone=Mistral-7B, Zero-shot=true2025.1250.37———
SlimGPT w/oPruning Ratio=50%, Backbone=LLaMA-3-8B, Zero-shot=true2025.1247.68———
SlimGPT w/oPruning Ratio=20%, Backbone=Phi-4-14B, Zero-shot=true2025.1247.61———
FLAPPruning Ratio=50%, Backbone=LLaMA-2-7B, Zero-shot=true2025.1246.97———
FLAPPruning Ratio=50%, Backbone=Mistral-7B, Zero-shot=true2025.1244.57———
SlimGPT w/oPruning Ratio=50%, Backbone=Mistral-7B, Zero-shot=true2025.1243.2———
FLAPPruning Ratio=50%, Backbone=LLaMA-3-8B, Zero-shot=true2025.1242.61———
PPPruning Ratio=50%, Backbone=LLaMA-3-8B, Zero-shot=true2025.1241.54———
SlimGPT w/oPruning Ratio=50%, Backbone=Phi-4-14B, Zero-shot=true2025.1232.53———
MyGO Multiplex CoT (MCoT)Reflection Type=Single-reflection2026.01—0.85129
MyGO Poly-Reflective CoT (PR-CoT)Reflection Type=Multi-perspective reflection2026.01—0.871411
Traditional CoT2026.01—0.78——