Future Interaction Prediction on MerRec (test)
58.65Hit Rate@10pi_theta (Ours)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| pi_theta (Ours)Backbone=Gemma3-27B2026.04 | 58.65 | 71.35 | 76.92 | 10.65 | 14.32 | 15.57 | |
| PersonaXsBackbone=Gemma3-27B2026.04 | 53.34 | 69.35 | 75.23 | 4.4 | 7.52 | 8.77 | |
| Claude-4.5Evaluation protocol=prompt-only2026.04 | 42.75 | 56.93 | 63.07 | 4.87 | 7.17 | 8.08 | |
| Qwen-80bEvaluation protocol=prompt-only2026.04 | 42.59 | 57.23 | 64.24 | 4.92 | 7.12 | 7.9 | |
| GPT-5.1Evaluation protocol=prompt-only2026.04 | 39.84 | 55.81 | 63.15 | 4.55 | 6.42 | 7.18 | |
| GPT-oss-120bEvaluation protocol=prompt-only2026.04 | 35.25 | 50.04 | 59.16 | 3.91 | 5.54 | 6.18 | |
| PersonaXrBackbone=Gemma3-27B2026.04 | 29.38 | 49.31 | 59.33 | 1.15 | 2.07 | 2.5 |