Trajectory quality correlation analysis on Teacher-generated Reasoning Datasets Qwen-3-4B student
0.82Spearman Correlation (Absolute)Rank-Surprisal Ratio
Evaluation results
| Method | Links | |
|---|---|---|
| Rank-Surprisal RatioMetric Category=Student-Specific2026.01 | 0.82 | |
| GRACEMetric Category=Student-Specific2026.01 | 0.75 | |
| Rule-based QualityMetric Category=Student-Agnostic2026.01 | 0.65 | |
| LLM-judged QualityMetric Category=Student-Agnostic2026.01 | 0.61 | |
| Avg-RankMetric Category=Student-Specific2026.01 | 0.61 | |
| Avg-Surpr_localMetric Category=Student-Specific2026.01 | 0.59 | |
| Avg-Token LengthMetric Category=Student-Agnostic2026.01 | 0.57 | |
| G-NormMetric Category=Student-Specific2026.01 | 0.57 | |
| Avg-SurprisalMetric Category=Student-Specific2026.01 | 0.55 | |
| Influence ScoreMetric Category=Student-Specific2026.01 | 0.47 | |
| Verified AccuracyMetric Category=Student-Agnostic2026.01 | 0.35 | |
| Teacher PerformanceMetric Category=Student-Agnostic2026.01 | 0.23 | |
| Teacher ParamsMetric Category=Student-Agnostic2026.01 | 0.02 |