Reasoning on BBH (pass@1)
83.69BBH Pass@1Learned
Evaluation Results
| Method | Links | |
|---|---|---|
| LearnedBackbone Model=DS-R1-Llama-8B, Cmax=3, Bmax=92162025.06 | 83.69 | |
| WaitBackbone Model=DS-R1-Llama-8B, Cmax=3, Bmax=92162025.06 | 81.97 | |
| HmmBackbone Model=DS-R1-Llama-8B, Cmax=3, Bmax=92162025.06 | 81.79 | |
| AlternativelyBackbone Model=DS-R1-Llama-8B, Cmax=3, Bmax=92162025.06 | 81.32 | |
| CritiqueBackbone Model=DS-R1-Llama-8B, Cmax=3, Bmax=92162025.06 | 80.26 | |
| Baseline (w/o BF)Backbone Model=DS-R1-Llama-8B, Cmax=3, Bmax=92162025.06 | 79.73 | |
| LearnedBackbone Model=DS-R1-Qwen-7B, Cmax=3, Bmax=92162025.06 | 74.75 | |
| WaitBackbone Model=DS-R1-Qwen-7B, Cmax=3, Bmax=92162025.06 | 73.85 | |
| HmmBackbone Model=DS-R1-Qwen-7B, Cmax=3, Bmax=92162025.06 | 72.91 | |
| AlternativelyBackbone Model=DS-R1-Qwen-7B, Cmax=3, Bmax=92162025.06 | 72.53 | |
| Baseline (w/o BF)Backbone Model=DS-R1-Qwen-7B, Cmax=3, Bmax=92162025.06 | 71.05 | |
| CritiqueBackbone Model=DS-R1-Qwen-7B, Cmax=3, Bmax=92162025.06 | 71.01 | |
| SCF-RKLModels=Fuse2026.02 | 69.92 | |
| w/o MergingModels=Code2026.02 | 69.29 | |
| Dare Task ArithmeticModels=Fuse2026.02 | 66.17 | |
| Task ArithmeticModels=Fuse2026.02 | 66.15 | |
| w/o MergingModel=Meta-Llama-3-8B-Instruct (base0)2026.02 | 65.78 | |
| Dare Ties MergingModels=Fuse2026.02 | 64.75 | |
| Dare Ties MergingModel=Fused2026.02 | 63.82 | |
| Task ArithmeticModel=Fused2026.02 | 63.63 | |
| Ties MergingModels=Fuse2026.02 | 60.7 | |
| SCEModels=Fuse2026.02 | 60.53 | |
| Ties MergingModel=Fused2026.02 | 57.89 | |
| w/o MergingModel=MAmmoTH2-8B-Plus (base1)2026.02 | 53.92 | |
| TeacherModel=Gemma3-4B2026.05 | 52.57 | |
| SCF-RKLModel=Fused2026.02 | 51.64 | |
| w/o MergingModels=Math2026.02 | 48.15 | |
| LearnedBackbone Model=DS-R1-Qwen-1.5B, Cmax=3, Bmax=92162025.06 | 47.7 | |
| WaitBackbone Model=DS-R1-Qwen-1.5B, Cmax=3, Bmax=92162025.06 | 47.58 | |
| HmmBackbone Model=DS-R1-Qwen-1.5B, Cmax=3, Bmax=92162025.06 | 47.06 | |
| AlternativelyBackbone Model=DS-R1-Qwen-1.5B, Cmax=3, Bmax=92162025.06 | 46.75 | |
| CritiqueBackbone Model=DS-R1-Qwen-1.5B, Cmax=3, Bmax=92162025.06 | 46 | |
| Baseline (w/o BF)Backbone Model=DS-R1-Qwen-1.5B, Cmax=3, Bmax=92162025.06 | 45.71 | |
| Dare Task ArithmeticModel=Fused2026.02 | 26.98 | |
| SCEModel=Fused2026.02 | 24.48 | |
| Reverse KLDistillation Family=KL Divergence Family2026.05 | 9.52 | |
| Bridge-Garden (Skew FKL)Distillation Family=Distance & Skewed Family2026.05 | 7.78 | |
| Bridge-Garden (α-β divergence)Distillation Family=Unified Divergence Family2026.05 | 7.56 | |
| α-β divergenceDistillation Family=Unified Divergence Family2026.05 | 7.26 | |
| Bridge-Garden (Reverse KL)Distillation Family=KL Divergence Family2026.05 | 7.14 | |
| Skew FKLDistillation Family=Distance & Skewed Family2026.05 | 7.01 | |
| Student (No Distill)Model=Gemma3-1B2026.05 | 6.47 | |
| Total VariationDistillation Family=Distance & Skewed Family2026.05 | 6.29 | |
| Bridge-Garden (Forward KL)Distillation Family=KL Divergence Family2026.05 | 6.23 | |
| Forward KLDistillation Family=KL Divergence Family2026.05 | 5.91 | |
| Skew RKLDistillation Family=Distance & Skewed Family2026.05 | 5.83 | |
| Bridge-Garden (Skew RKL)Distillation Family=Distance & Skewed Family2026.05 | 5.72 | |
| Hard KDTeacher Model=Gemma3-4B, Student Model=Gemma3-1B2026.05 | 5.28 | |
| Bridge-Garden (Total Variation)Distillation Family=Distance & Skewed Family2026.05 | 5.02 |