# Knowledge Distillation Robustness on Qwen2.5-7B teacher vs. Qwen2.5-7B-Open-R1-Distill student (test)

Source: [Knowledge Distillation Robustness on Qwen2.5-7B teacher vs. Qwen2.5-7B-Open-R1-Distill student (test)](<https://www.sota2.com/research/sota/knowledge-distillation-robustness-on-qwen2-5-7b-teacher-vs-qwen2-5-7b-open-r1-distill-student-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-08T08:28:42.152Z

Evaluation of the robustness of knowledge distillation, comparing the performance of the Qwen2.5-7B teacher model against the Qwen2.5-7B-Open-R1-Distill student model on the test split, measured by Similarity Score.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Knowledge Distillation Robustness |
| Dataset (including any stated split) | Qwen2.5-7B teacher vs. Qwen2.5-7B-Open-R1-Distill student (test) |
| Metric | Similarity Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 7 of 7 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Similarity Score](<https://www.sota2.com/research/sota/knowledge-distillation-robustness-on-qwen2-5-7b-teacher-vs-qwen2-5-7b-open-r1-distill-student-test.md?metric=Similarity%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Similarity Score | Result date | Report paper |
| --- | --- | --- | --- |
| PCS | 0.9998 | Not recorded | 69d5e0f67d0172140ec75979 |
| ICS | 0.9992 | Not recorded | 69d5e0f67d0172140ec75979 |
| REEF | 0.9926 | Not recorded | 69d5e0f67d0172140ec75979 |
| AttnDiff | 0.9873 | Not recorded | 69d5e0f67d0172140ec75979 |
| Logits | 0.699 | Not recorded | 69d5e0f67d0172140ec75979 |
| LLMmap | 0.6744 | Not recorded | 69d5e0f67d0172140ec75979 |
| ProFlingo | 0.56 | Not recorded | 69d5e0f67d0172140ec75979 |

### PCS

Similarity Score: 0.9998. Result ID: 69d611b147f34ce924be9db8.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f67d0172140ec75979.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76771e209131cea6d29b.md>)

[Implementation](<https://github.com/LUMIA-Group/HuRef>)

Recorded evaluation configuration: {"Deployable distilled model":"Qwen2.5-7B-Open-R1-Distill"}. This record does not assert independent reproduction.

### ICS

Similarity Score: 0.9992. Result ID: 69d611b147f34ce924be9db9.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f67d0172140ec75979.md>)

Recorded evaluation configuration: {"Deployable distilled model":"Qwen2.5-7B-Open-R1-Distill"}. This record does not assert independent reproduction.

### REEF

Similarity Score: 0.9926. Result ID: 69d611b147f34ce924be9dbb.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f67d0172140ec75979.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa753d1e209131cea66b35.md>)

Recorded evaluation configuration: {"Deployable distilled model":"Qwen2.5-7B-Open-R1-Distill"}. This record does not assert independent reproduction.

### AttnDiff

Similarity Score: 0.9873. Result ID: 69d611b147f34ce924be9dbe.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f67d0172140ec75979.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e0f67d0172140ec75979.md>)

Recorded evaluation configuration: {"Deployable distilled model":"Qwen2.5-7B-Open-R1-Distill"}. This record does not assert independent reproduction.

### Logits

Similarity Score: 0.699. Result ID: 69d611b147f34ce924be9dba.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f67d0172140ec75979.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73ef1e209131cea5ef80.md>)

Recorded evaluation configuration: {"Deployable distilled model":"Qwen2.5-7B-Open-R1-Distill"}. This record does not assert independent reproduction.

### LLMmap

Similarity Score: 0.6744. Result ID: 69d611b147f34ce924be9dbd.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f67d0172140ec75979.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76e51e209131cea6fbac.md>)

Recorded evaluation configuration: {"Deployable distilled model":"Qwen2.5-7B-Open-R1-Distill"}. This record does not assert independent reproduction.

### ProFlingo

Similarity Score: 0.56. Result ID: 69d611b147f34ce924be9dbc.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e0f67d0172140ec75979.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74cb1e209131cea63e4f.md>)

Recorded evaluation configuration: {"Deployable distilled model":"Qwen2.5-7B-Open-R1-Distill"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
