Chat on MT-Bench
8.91MT-Bench ScoreTeacher
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| TeacherTeacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT42025.09 | 8.91 | — | — | — | — | |
| TeacherTeacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT42025.09 | 8.59 | — | — | — | — | |
| DPOBackbone=LLaMA-3-8B-Instruct, Training Dataset=UltraFeedback2025.06 | 8.32 | — | — | — | — | |
| PMLEBackbone=LLaMA-3-8B-Instruct, Training Dataset=UltraFeedback2025.06 | 8.3 | — | — | — | — | |
| Pref. Distill.Backbone=LLaMA-3-8B-Instruct, Training Dataset=UltraFeedback2025.06 | 8.18 | — | — | — | — | |
| REBELBackbone=LLaMA-3-8B-Instruct, Training Dataset=UltraFeedback2025.06 | 8.17 | — | — | — | — | |
| Base modelBackbone=Llama3-8B-Instruct2026.01 | 8.1 | — | — | — | — | |
| Base (LLaMA-3-8B-Instruct)Model Type=Instruct-only Base2025.06 | 8.1 | — | — | — | — | |
| Circuit BreakBackbone=Llama3-8B-Instruct2026.01 | 8.06 | — | — | — | — | |
| JPUBackbone=Llama3-8B-Instruct2026.01 | 7.98 | — | — | — | — | |
| CKUBackbone=Llama3-8B-Instruct2026.01 | 7.96 | — | — | — | — | |
| EraserBackbone=Llama3-8B-Instruct2026.01 | 7.86 | — | — | — | — | |
| CSD (T, S)Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT42025.09 | 7.85 | — | — | — | — | |
| Safe UnlearningBackbone=Llama3-8B-Instruct2026.01 | 7.82 | — | — | — | — | |
| DistiLLM-2Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT42025.09 | 7.81 | — | — | — | — | |
| CSD (S, S)Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT42025.09 | 7.77 | — | — | — | — | |
| CSD (S, S)Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT42025.09 | 7.69 | — | — | — | — | |
| TeacherTeacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT4-Turbo2025.09 | 7.66 | — | — | — | — | |
| DLD (S)Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT42025.09 | 7.58 | — | — | — | — | |
| TeacherTeacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT4-Turbo2025.09 | 7.52 | — | — | — | — | |
| RSFTBackbone=Llama3-8B-Instruct2026.01 | 7.51 | — | — | — | — | |
| CSD (T, S)Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT42025.09 | 7.42 | — | — | — | — | |
| DistiLLM-2Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT42025.09 | 7.28 | — | — | — | — | |
| DLD (S)Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT42025.09 | 7.28 | — | — | — | — | |
| DLD (T)Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT42025.09 | 7.25 | — | — | — | — | |
| CSD (T, S)Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT4-Turbo2025.09 | 6.55 | — | — | — | — | |
| DLD (S)Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT4-Turbo2025.09 | 6.53 | — | — | — | — | |
| DistiLLM-2Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT4-Turbo2025.09 | 6.45 | — | — | — | — | |
| CSD (S, S)Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT4-Turbo2025.09 | 6.43 | — | — | — | — | |
| Base modelBackbone=Llama2-7B-Chat2026.01 | 6.31 | — | — | — | — | |
| DPKDTeacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT42025.09 | 6.3 | — | — | — | — | |
| Circuit BreakBackbone=Llama2-7B-Chat2026.01 | 6.25 | — | — | — | — | |
| CKUBackbone=Llama2-7B-Chat2026.01 | 6.24 | — | — | — | — | |
| JPUBackbone=Llama2-7B-Chat2026.01 | 6.24 | — | — | — | — | |
| Safe UnlearningBackbone=Llama2-7B-Chat2026.01 | 6.22 | — | — | — | — | |
| RSFTBackbone=Llama2-7B-Chat2026.01 | 5.97 | — | — | — | — | |
| CSD (S, S)Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT4-Turbo2025.09 | 5.95 | — | — | — | — | |
| CSD (T, S)Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT4-Turbo2025.09 | 5.9 | — | — | — | — | |
| DLD (T)Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT42025.09 | 5.85 | — | — | — | — | |
| EraserBackbone=Llama2-7B-Chat2026.01 | 5.84 | — | — | — | — | |
| DistiLLM-2Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT4-Turbo2025.09 | 5.75 | — | — | — | — | |
| DLD (S)Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT4-Turbo2025.09 | 5.74 | — | — | — | — | |
| DLD (T)Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT4-Turbo2025.09 | 5.56 | — | — | — | — | |
| TLoRATrainable Parameters=171.71M2026.04 | 5.17 | — | — | — | — | |
| CorDATrainable Parameters=319.81M2026.04 | 5.09 | — | — | — | — | |
| PISSATrainable Parameters=319.81M2026.04 | 5 | — | — | — | — | |
| OLoRATrainable Parameters=319.81M2026.04 | 4.99 | — | — | — | — | |
| LoRA-GATrainable Parameters=319.81M2026.04 | 4.97 | — | — | — | — | |
| DPKDTeacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT4-Turbo2025.09 | 4.89 | — | — | — | — | |
| LoRATrainable Parameters=319.81M2026.04 | 4.76 | — | — | — | — | |
| FULLTrainable Parameters=6738M2026.04 | 4.75 | — | — | — | — | |
| DoRATrainable Parameters=321.17M2026.04 | 4.7 | — | — | — | — | |
| LoRA+Trainable Parameters=319.81M2026.04 | 4.69 | — | — | — | — | |
| AdaLoRATrainable Parameters=319.84M2026.04 | 4.5 | — | — | — | — | |
| DLD (T)Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT4-Turbo2025.09 | 4.45 | — | — | — | — | |
| SourceModel Scale=13B2025.12 | 4.06 | — | — | — | — | |
| AdaLoRAModel Scale=13B2025.12 | 4.05 | — | — | — | — | |
| SSU-WandaModel Scale=13B2025.12 | 4.05 | — | — | — | — | |
| SourceModel Scale=7B2025.12 | 3.98 | — | — | — | — | |
| SSU-WandaModel Scale=7B2025.12 | 3.96 | — | — | — | — | |
| AdaLoRAModel Scale=7B2025.12 | 3.92 | — | — | — | — | |
| HFTModel Scale=13B2025.12 | 3.92 | — | — | — | — | |
| SSU-RandModel Scale=13B2025.12 | 3.89 | — | — | — | — | |
| HFTModel Scale=7B2025.12 | 3.83 | — | — | — | — | |
| SSU-RandModel Scale=7B2025.12 | 3.81 | — | — | — | — | |
| SSU-MagModel Scale=13B2025.12 | 3.8 | — | — | — | — | |
| SSU-MagModel Scale=7B2025.12 | 3.78 | — | — | — | — | |
| GMTModel Scale=7B2025.12 | 3.67 | — | — | — | — | |
| GMTModel Scale=13B2025.12 | 3.64 | — | — | — | — | |
| FFTModel Scale=13B2025.12 | 3.52 | — | — | — | — | |
| FFTModel Scale=7B2025.12 | 3.48 | — | — | — | — | |
| DPKDTeacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT4-Turbo2025.09 | 1.09 | — | — | — | — | |
| DPKDTeacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT42025.09 | 1.04 | — | — | — | — | |
| Accept-rateDepth=3L, Temperature=0, Model=Qwen3-4B2026.05 | — | 0.76 | 1.04 | — | — | |
| Accept-rateDepth=5L, Temperature=0, Model=Qwen3-4B2026.05 | — | 0.71 | 1.01 | — | — | |
| Accept-rateDepth=3L, Temperature=1, Model=Qwen3-4B2026.05 | — | 0.75 | 1.04 | — | — | |
| Accept-rateDepth=5L, Temperature=1, Model=Qwen3-4B2026.05 | — | 0.7 | 1.01 | — | — | |
| BASTIONModel=Qwen3-4B, Temperature=0, Hardware=H1002026.05 | — | — | 6.34 | 4.47 | — | |
| BASTIONModel=Qwen3-8B, Temperature=0, Hardware=H1002026.05 | — | — | 6.16 | 4.12 | — | |
| BASTIONModel=Qwen3-4B, Temperature=1, Hardware=H1002026.05 | — | — | 6.21 | 4.48 | — | |
| BASTIONModel=Qwen3-8B, Temperature=1, Hardware=H1002026.05 | — | — | 6.18 | 4.08 | — | |
| D-PACEDepth=3L, Temperature=0, Model=Qwen3-4B2026.05 | — | 2.16 | 3.54 | — | — | |
| D-PACEDepth=5L, Temperature=0, Model=Qwen3-4B2026.05 | — | 2.18 | 3.79 | — | — | |
| D-PACEDepth=3L, Temperature=1, Model=Qwen3-4B2026.05 | — | 2.04 | 3.3 | — | — | |
| D-PACEDepth=5L, Temperature=1, Model=Qwen3-4B2026.05 | — | 2.03 | 3.49 | — | — | |
| DDTreeTemperature=0.0, Reasoning Mode=No Reasoning, Path=Tree, Budget=642026.07 | — | — | 6.32 | 2.69 | — | |
| DDTreeTemperature=0.0, Reasoning Mode=Reasoning, Path=Tree, Budget=642026.07 | — | — | 6.63 | 3.17 | — | |
| DDTreeTemperature=1.0, Reasoning Mode=No Reasoning, Path=Tree, Budget=642026.07 | — | — | 5.96 | 2.47 | — | |
| DDTreeTemperature=1.0, Reasoning Mode=Reasoning, Path=Tree, Budget=642026.07 | — | — | 6.08 | 2.88 | — | |
| DFlashDepth=3L, Temperature=0, Model=Qwen3-4B2026.05 | — | 2.03 | 3.22 | — | — | |
| DFlashDepth=5L, Temperature=0, Model=Qwen3-4B2026.05 | — | 2.01 | 3.43 | — | — | |
| DFlashDepth=3L, Temperature=1, Model=Qwen3-4B2026.05 | — | 1.93 | 3.05 | — | — | |
| DFlashDepth=5L, Temperature=1, Model=Qwen3-4B2026.05 | — | 1.92 | 3.23 | — | — | |
| DFlashModel=Qwen3-4B, Temperature=0, Hardware=H100, Block size=162026.05 | — | — | 4.38 | 3.21 | — | |
| DFlashModel=Qwen3-8B, Temperature=0, Hardware=H100, Block size=162026.05 | — | — | 4.23 | 3.03 | — | |
| DFlashModel=Qwen3-4B, Temperature=1, Hardware=H100, Block size=162026.05 | — | — | 4.01 | 3 | — | |
| DFlashModel=Qwen3-8B, Temperature=1, Hardware=H100, Block size=162026.05 | — | — | 3.84 | 2.72 | — | |
| DFlashBudget=16, Temperature=02026.06 | — | — | 4.03 | 2.72 | — | |
| DFlashBudget=32, Temperature=02026.06 | — | — | 3.61 | 2.48 | — | |
| DFlashBudget=16, Temperature=12026.06 | — | — | 3.52 | 2.41 | — |