Personalized Scholarly Refinement on LaMP-5
40.5Rouge-LAttn-GS
Evaluation results
| Method | Links | |
|---|---|---|
| Attn-GSToken Count=200, Evaluation Protocol=Fine-tuning2026.02 | 40.5 | |
| Attn-GSToken Count=150, Evaluation Protocol=Fine-tuning2026.02 | 40.4 | |
| Attn-GSToken Count=100, Evaluation Protocol=Fine-tuning2026.02 | 40.2 | |
| Attn-GSToken Count=50, Evaluation Protocol=Fine-tuning2026.02 | 39.6 | |
| PromptToken Count=200, Evaluation Protocol=Fine-tuning2026.02 | 39 | |
| Simple SummaryToken Count=200, Evaluation Protocol=Fine-tuning2026.02 | 38.9 | |
| Mark ALLToken Count=200, Evaluation Protocol=Fine-tuning2026.02 | 38.9 | |
| Self-ReflectionToken Count=200, Evaluation Protocol=Fine-tuning2026.02 | 38.9 | |
| CoTToken Count=200, Evaluation Protocol=Fine-tuning2026.02 | 38.8 | |
| Random MarkToken Count=200, Evaluation Protocol=Fine-tuning2026.02 | 38.7 | |
| Truncated ContToken Count=200, Evaluation Protocol=Fine-tuning2026.02 | 38.6 | |
| Simple SummaryToken Count=150, Evaluation Protocol=Fine-tuning2026.02 | 38.6 | |
| Mark ALLToken Count=150, Evaluation Protocol=Fine-tuning2026.02 | 38.6 | |
| PromptToken Count=150, Evaluation Protocol=Fine-tuning2026.02 | 38.6 | |
| CoTToken Count=150, Evaluation Protocol=Fine-tuning2026.02 | 38.6 | |
| Truncated ContToken Count=150, Evaluation Protocol=Fine-tuning2026.02 | 38.5 | |
| Mark ALLToken Count=50, Evaluation Protocol=Fine-tuning2026.02 | 38.5 | |
| Self-ReflectionToken Count=150, Evaluation Protocol=Fine-tuning2026.02 | 38.5 | |
| Truncated ContToken Count=100, Evaluation Protocol=Fine-tuning2026.02 | 38.4 | |
| Simple SummaryToken Count=50, Evaluation Protocol=Fine-tuning2026.02 | 38.4 | |
| Simple SummaryToken Count=100, Evaluation Protocol=Fine-tuning2026.02 | 38.4 | |
| Random MarkToken Count=150, Evaluation Protocol=Fine-tuning2026.02 | 38.4 | |
| Mark ALLToken Count=100, Evaluation Protocol=Fine-tuning2026.02 | 38.4 | |
| PromptToken Count=50, Evaluation Protocol=Fine-tuning2026.02 | 38.4 | |
| PromptToken Count=100, Evaluation Protocol=Fine-tuning2026.02 | 38.4 | |
| CoTToken Count=50, Evaluation Protocol=Fine-tuning2026.02 | 38.3 | |
| CoTToken Count=100, Evaluation Protocol=Fine-tuning2026.02 | 38.3 | |
| Self-ReflectionToken Count=50, Evaluation Protocol=Fine-tuning2026.02 | 38.3 | |
| Self-ReflectionToken Count=100, Evaluation Protocol=Fine-tuning2026.02 | 38.3 | |
| Truncated ContToken Count=50, Evaluation Protocol=Fine-tuning2026.02 | 38.2 | |
| Random MarkToken Count=100, Evaluation Protocol=Fine-tuning2026.02 | 38.1 | |
| Random MarkToken Count=50, Evaluation Protocol=Fine-tuning2026.02 | 38 |