List your company
ResearchFormerly WizWand

Chat on MT-Bench

8.91MT-Bench ScoreTeacher
0.72522.85014.9757.0999Jun 2, 2025Jul 25, 2025Sep 17, 2025Nov 10, 2025Jan 2, 2026Feb 25, 2026Apr 20, 2026
Updated 3mo ago

Evaluation results

MethodLinks
TeacherTeacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT42025.098.91————
TeacherTeacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT42025.098.59————
DPOBackbone=LLaMA-3-8B-Instruct, Training Dataset=UltraFeedback2025.068.32————
PMLEBackbone=LLaMA-3-8B-Instruct, Training Dataset=UltraFeedback2025.068.3————
Pref. Distill.Backbone=LLaMA-3-8B-Instruct, Training Dataset=UltraFeedback2025.068.18————
REBELBackbone=LLaMA-3-8B-Instruct, Training Dataset=UltraFeedback2025.068.17————
Base modelBackbone=Llama3-8B-Instruct2026.018.1————
Base (LLaMA-3-8B-Instruct)Model Type=Instruct-only Base2025.068.1————
Circuit BreakBackbone=Llama3-8B-Instruct2026.018.06————
JPUBackbone=Llama3-8B-Instruct2026.017.98————
CKUBackbone=Llama3-8B-Instruct2026.017.96————
EraserBackbone=Llama3-8B-Instruct2026.017.86————
CSD (T, S)Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT42025.097.85————
Safe UnlearningBackbone=Llama3-8B-Instruct2026.017.82————
DistiLLM-2Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT42025.097.81————
CSD (S, S)Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT42025.097.77————
CSD (S, S)Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT42025.097.69————
TeacherTeacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT4-Turbo2025.097.66————
DLD (S)Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT42025.097.58————
TeacherTeacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT4-Turbo2025.097.52————
RSFTBackbone=Llama3-8B-Instruct2026.017.51————
CSD (T, S)Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT42025.097.42————
DistiLLM-2Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT42025.097.28————
DLD (S)Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT42025.097.28————
DLD (T)Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT42025.097.25————
CSD (T, S)Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT4-Turbo2025.096.55————
DLD (S)Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT4-Turbo2025.096.53————
DistiLLM-2Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT4-Turbo2025.096.45————
CSD (S, S)Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT4-Turbo2025.096.43————
Base modelBackbone=Llama2-7B-Chat2026.016.31————
DPKDTeacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT42025.096.3————
Circuit BreakBackbone=Llama2-7B-Chat2026.016.25————
CKUBackbone=Llama2-7B-Chat2026.016.24————
JPUBackbone=Llama2-7B-Chat2026.016.24————
Safe UnlearningBackbone=Llama2-7B-Chat2026.016.22————
RSFTBackbone=Llama2-7B-Chat2026.015.97————
CSD (S, S)Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT4-Turbo2025.095.95————
CSD (T, S)Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT4-Turbo2025.095.9————
DLD (T)Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT42025.095.85————
EraserBackbone=Llama2-7B-Chat2026.015.84————
DistiLLM-2Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT4-Turbo2025.095.75————
DLD (S)Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT4-Turbo2025.095.74————
DLD (T)Teacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT4-Turbo2025.095.56————
TLoRATrainable Parameters=171.71M2026.045.17————
CorDATrainable Parameters=319.81M2026.045.09————
PISSATrainable Parameters=319.81M2026.045————
OLoRATrainable Parameters=319.81M2026.044.99————
LoRA-GATrainable Parameters=319.81M2026.044.97————
DPKDTeacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT4-Turbo2025.094.89————
LoRATrainable Parameters=319.81M2026.044.76————
FULLTrainable Parameters=6738M2026.044.75————
DoRATrainable Parameters=321.17M2026.044.7————
LoRA+Trainable Parameters=319.81M2026.044.69————
AdaLoRATrainable Parameters=319.84M2026.044.5————
DLD (T)Teacher-Student Model Pair=Gemma2-9B-IT -> Gemma2-2B-IT, Judge=GPT4-Turbo2025.094.45————
SourceModel Scale=13B2025.124.06————
AdaLoRAModel Scale=13B2025.124.05————
SSU-WandaModel Scale=13B2025.124.05————
SourceModel Scale=7B2025.123.98————
SSU-WandaModel Scale=7B2025.123.96————
AdaLoRAModel Scale=7B2025.123.92————
HFTModel Scale=13B2025.123.92————
SSU-RandModel Scale=13B2025.123.89————
HFTModel Scale=7B2025.123.83————
SSU-RandModel Scale=7B2025.123.81————
SSU-MagModel Scale=13B2025.123.8————
SSU-MagModel Scale=7B2025.123.78————
GMTModel Scale=7B2025.123.67————
GMTModel Scale=13B2025.123.64————
FFTModel Scale=13B2025.123.52————
FFTModel Scale=7B2025.123.48————
DPKDTeacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT4-Turbo2025.091.09————
DPKDTeacher-Student Model Pair=Qwen2.5-7B-IT -> Qwen2.5-1.5B-IT, Judge=GPT42025.091.04————
Accept-rateDepth=3L, Temperature=0, Model=Qwen3-4B2026.05—0.761.04——
Accept-rateDepth=5L, Temperature=0, Model=Qwen3-4B2026.05—0.711.01——
Accept-rateDepth=3L, Temperature=1, Model=Qwen3-4B2026.05—0.751.04——
Accept-rateDepth=5L, Temperature=1, Model=Qwen3-4B2026.05—0.71.01——
BASTIONModel=Qwen3-4B, Temperature=0, Hardware=H1002026.05——6.344.47—
BASTIONModel=Qwen3-8B, Temperature=0, Hardware=H1002026.05——6.164.12—
BASTIONModel=Qwen3-4B, Temperature=1, Hardware=H1002026.05——6.214.48—
BASTIONModel=Qwen3-8B, Temperature=1, Hardware=H1002026.05——6.184.08—
D-PACEDepth=3L, Temperature=0, Model=Qwen3-4B2026.05—2.163.54——
D-PACEDepth=5L, Temperature=0, Model=Qwen3-4B2026.05—2.183.79——
D-PACEDepth=3L, Temperature=1, Model=Qwen3-4B2026.05—2.043.3——
D-PACEDepth=5L, Temperature=1, Model=Qwen3-4B2026.05—2.033.49——
DDTreeTemperature=0.0, Reasoning Mode=No Reasoning, Path=Tree, Budget=642026.07——6.322.69—
DDTreeTemperature=0.0, Reasoning Mode=Reasoning, Path=Tree, Budget=642026.07——6.633.17—
DDTreeTemperature=1.0, Reasoning Mode=No Reasoning, Path=Tree, Budget=642026.07——5.962.47—
DDTreeTemperature=1.0, Reasoning Mode=Reasoning, Path=Tree, Budget=642026.07——6.082.88—
DFlashDepth=3L, Temperature=0, Model=Qwen3-4B2026.05—2.033.22——
DFlashDepth=5L, Temperature=0, Model=Qwen3-4B2026.05—2.013.43——
DFlashDepth=3L, Temperature=1, Model=Qwen3-4B2026.05—1.933.05——
DFlashDepth=5L, Temperature=1, Model=Qwen3-4B2026.05—1.923.23——
DFlashModel=Qwen3-4B, Temperature=0, Hardware=H100, Block size=162026.05——4.383.21—
DFlashModel=Qwen3-8B, Temperature=0, Hardware=H100, Block size=162026.05——4.233.03—
DFlashModel=Qwen3-4B, Temperature=1, Hardware=H100, Block size=162026.05——4.013—
DFlashModel=Qwen3-8B, Temperature=1, Hardware=H100, Block size=162026.05——3.842.72—
DFlashBudget=16, Temperature=02026.06——4.032.72—
DFlashBudget=32, Temperature=02026.06——3.612.48—
DFlashBudget=16, Temperature=12026.06——3.522.41—