ResearchTasksKnowledge Distillation RobustnessKnowledge Distillation RobustnessFollowBenchmarksDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyDatasetSOTA methodMetricTrendResultsLast updatedLlama-2-7B teacher vs. llama-2-7b-logit-watermark-distill-kgw-k1-gamma0.25-delta2 student (test)AttnDiff99.98Similarity Score7Apr 8, 2026Llama-3.1-8B teacher vs. Llama-3.1-8B-Instruct-Open-R1-Distill student (test)PCS99.88Similarity Score7Apr 8, 2026Qwen2.5-14B teacher vs. DeepSeek-R1-Distill-Qwen-14B student (test)AttnDiff98.75Similarity Score7Apr 8, 2026Qwen2.5-7B teacher vs. Qwen2.5-7B-Open-R1-Distill student (test)PCS1Similarity Score7Apr 8, 2026
Llama-2-7B teacher vs. llama-2-7b-logit-watermark-distill-kgw-k1-gamma0.25-delta2 student (test)AttnDiff99.98Similarity Score7Apr 8, 2026
Llama-3.1-8B teacher vs. Llama-3.1-8B-Instruct-Open-R1-Distill student (test)PCS99.88Similarity Score7Apr 8, 2026
Qwen2.5-14B teacher vs. DeepSeek-R1-Distill-Qwen-14B student (test)AttnDiff98.75Similarity Score7Apr 8, 2026