Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Knowledge Distillation Robustness research benchmarks · SOTA2 Research

Knowledge Distillation Robustness

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Llama-2-7B teacher vs. llama-2-7b-logit-watermark-distill-kgw-k1-gamma0.25-delta2 student (test)

99.98Similarity Score

7

Apr 8, 2026

Llama-3.1-8B teacher vs. Llama-3.1-8B-Instruct-Open-R1-Distill student (test)

99.88Similarity Score

7

Apr 8, 2026

Qwen2.5-14B teacher vs. DeepSeek-R1-Distill-Qwen-14B student (test)

98.75Similarity Score

7

Apr 8, 2026

Qwen2.5-7B teacher vs. Qwen2.5-7B-Open-R1-Distill student (test)

1Similarity Score

7

Apr 8, 2026

Popular datasets

Llama Llama 2 Qwen teacher vs. Qwen-Open-Distill student Qwen2.5-14B teacher vs. DeepSeek-R1-Distill-Qwen-14B student

Follow for updates

Join SOTA2 Contact