List your company

Mathematical Reasoning on GSM8K (test) (Latency Breakdown)

15.9Query Prefill Latency (ms)Explicit CoT
15.35619.02822.726.372Jun 30, 2026

Evaluation results

MethodLinks
Explicit CoTBackbone=LLAMA-3.2-3B-INSTRUCT2026.0615.9338.829.5384.2
CODIBackbone=LLAMA-3.2-3B-INSTRUCT2026.0616.588.230.4135.1
LOTUSBackbone=LLAMA-3.2-3B-INSTRUCT2026.0616.713331.5181.2
SIM-CoTBackbone=LLAMA-3.2-3B-INSTRUCT2026.0629.5162.759.2251.4