Mathematical Reasoning on OlympiadBench (Accuracy %, CoT Length)
38.13Accuracy (%)SuperThoughts
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SuperThoughtsBackbone=Qwen2.5-Math-7B-Instruct, Compressor Type=Projection Compressor, Adaptive Inference Mode=w/ adaptive, Adaptive Threshold (τ)=0.999992026.06 | 38.13 | 553 | |
| SuperThoughtsBackbone=Qwen2.5-Math-7B-Instruct, Compressor Type=Transformer Compressor, Adaptive Inference Mode=w/ adaptive, Adaptive Threshold (τ)=0.9992026.06 | 37.24 | 425.6 | |
| SuperThoughtsBackbone=Qwen2.5-Math-7B-Instruct, Compressor Type=Transformer Compressor, Adaptive Inference Mode=w/ adaptive, Adaptive Threshold (τ)=0.999992026.06 | 37.24 | 541.1 | |
| Standard CoTBackbone=Qwen2.5-Math-7B-Instruct2026.06 | 36.35 | 654.6 | |
| SuperThoughtsBackbone=Qwen2.5-Math-7B-Instruct, Compressor Type=Projection Compressor, Adaptive Inference Mode=w/ adaptive, Adaptive Threshold (τ)=0.99992026.06 | 35.46 | 456.8 | |
| SuperThoughtsBackbone=Qwen2.5-Math-7B-Instruct, Compressor Type=Transformer Compressor, Adaptive Inference Mode=w/ adaptive, Adaptive Threshold (τ)=0.99992026.06 | 35.46 | 442.2 | |
| SuperThoughtsBackbone=Qwen2.5-Math-7B-Instruct, Compressor Type=Projection Compressor, Adaptive Inference Mode=w/ adaptive, Adaptive Threshold (τ)=0.9992026.06 | 35.31 | 415.6 | |
| Standard CoTBackbone=Qwen2.5-Math-1.5B-Instruct2026.06 | 34.72 | 620.5 | |
| SuperThoughtsBackbone=Qwen2.5-Math-1.5B-Instruct, Compressor Type=Projection Compressor, Adaptive Inference Mode=w/ adaptive, Adaptive Threshold (τ)=0.999992026.06 | 34.42 | 537.3 | |
| SuperThoughtsBackbone=Qwen2.5-Math-1.5B-Instruct, Compressor Type=Transformer Compressor, Adaptive Inference Mode=w/ adaptive, Adaptive Threshold (τ)=0.999992026.06 | 34.13 | 530.7 | |
| SuperThoughtsBackbone=Qwen2.5-Math-1.5B-Instruct, Compressor Type=Projection Compressor, Adaptive Inference Mode=w/ adaptive, Adaptive Threshold (τ)=0.9992026.06 | 33.83 | 436.3 | |
| SuperThoughtsBackbone=Qwen2.5-Math-1.5B-Instruct, Compressor Type=Transformer Compressor, Adaptive Inference Mode=w/ adaptive, Adaptive Threshold (τ)=0.99992026.06 | 33.68 | 463.6 | |
| SuperThoughtsBackbone=Qwen2.5-Math-1.5B-Instruct, Compressor Type=Projection Compressor, Adaptive Inference Mode=w/ adaptive, Adaptive Threshold (τ)=0.99992026.06 | 33.09 | 463 | |
| SuperThoughtsBackbone=Qwen2.5-Math-1.5B-Instruct, Compressor Type=Transformer Compressor, Adaptive Inference Mode=w/ adaptive, Adaptive Threshold (τ)=0.9992026.06 | 32.49 | 423.7 | |
| SuperThoughtsBackbone=Qwen2.5-Math-7B-Instruct, Compressor Type=Projection Compressor, Adaptive Inference Mode=w/o adaptive2026.06 | 30.71 | 339.5 | |
| SuperThoughtsBackbone=Qwen2.5-Math-7B-Instruct, Compressor Type=Transformer Compressor, Adaptive Inference Mode=w/o adaptive2026.06 | 27.89 | 336.5 | |
| SuperThoughtsBackbone=Qwen2.5-Math-1.5B-Instruct, Compressor Type=Transformer Compressor, Adaptive Inference Mode=w/o adaptive2026.06 | 21.01 | 289.4 | |
| SuperThoughtsBackbone=Qwen2.5-Math-1.5B-Instruct, Compressor Type=Projection Compressor, Adaptive Inference Mode=w/o adaptive2026.06 | 20.03 | 286.9 |