Trajectory quality correlation analysis on Teacher-generated Reasoning Datasets LLaMA-3.1-8B student
0.85Spearman Correlation (Abs)Rank-Surprisal Ratio
Evaluation results
| Method | Links | |
|---|---|---|
| Rank-Surprisal RatioMetric Category=Student-Specific2026.01 | 0.85 | |
| Avg-Token LengthMetric Category=Student-Agnostic2026.01 | 0.68 | |
| Avg-RankMetric Category=Student-Specific2026.01 | 0.64 | |
| GRACEMetric Category=Student-Specific2026.01 | 0.58 | |
| Rule-based QualityMetric Category=Student-Agnostic2026.01 | 0.56 | |
| G-NormMetric Category=Student-Specific2026.01 | 0.54 | |
| LLM-judged QualityMetric Category=Student-Agnostic2026.01 | 0.52 | |
| Verified AccuracyMetric Category=Student-Agnostic2026.01 | 0.43 | |
| Avg-SurprisalMetric Category=Student-Specific2026.01 | 0.42 | |
| Avg-Surpr_localMetric Category=Student-Specific2026.01 | 0.4 | |
| Teacher ParamsMetric Category=Student-Agnostic2026.01 | 0.34 | |
| Teacher PerformanceMetric Category=Student-Agnostic2026.01 | 0.34 | |
| Influence ScoreMetric Category=Student-Specific2026.01 | 0.19 |