View-change prediction on View-change prediction dataset
0.4661F1 ScoreContext-Aware User Profiling framework
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Context-Aware User Profiling frameworkPredictor Model=Llama-3.3-70B-Instruct2026.01 | 0.4661 | 0.6828 | |
| Retrieval-onlyPredictor Model=Llama-3.3-70B-Instruct2026.01 | 0.4177 | 0.6635 | |
| RecursummPredictor Model=Llama-3.3-70B-Instruct2026.01 | 0.4139 | 0.6571 | |
| HsummPredictor Model=Llama-3.3-70B-Instruct2026.01 | 0.4063 | 0.6615 | |
| Context-Aware User Profiling frameworkPredictor Model=Llama-3.1-8B-Instruct2026.01 | 0.4 | 0.6158 | |
| No PersonalizationPredictor Model=Llama-3.1-8B-Instruct2026.01 | 0.3457 | 0.5677 | |
| No PersonalizationPredictor Model=Llama-3.3-70B-Instruct2026.01 | 0.3284 | 0.6538 | |
| HsummPredictor Model=Llama-3.1-8B-Instruct2026.01 | 0.3244 | 0.5965 | |
| PAGPredictor Model=Llama-3.3-70B-Instruct2026.01 | 0.3141 | 0.6346 | |
| RecursummPredictor Model=Llama-3.1-8B-Instruct2026.01 | 0.3133 | 0.5869 | |
| Retrieval-onlyPredictor Model=Llama-3.1-8B-Instruct2026.01 | 0.2952 | 0.5424 | |
| Context-Aware User Profiling frameworkPredictor Model=GPT-4o mini2026.01 | 0.2787 | 0.6299 | |
| PAGPredictor Model=Llama-3.1-8B-Instruct2026.01 | 0.2571 | 0.5775 | |
| No PersonalizationPredictor Model=GPT-4o mini2026.01 | 0.2525 | 0.6415 | |
| Retrieval-onlyPredictor Model=GPT-4o mini2026.01 | 0.1323 | 0.6306 | |
| HsummPredictor Model=GPT-4o mini2026.01 | 0.1128 | 0.6214 | |
| RecursummPredictor Model=GPT-4o mini2026.01 | 0.105 | 0.6318 | |
| PAGPredictor Model=GPT-4o mini2026.01 | 0.0833 | 0.6165 |