Future Interaction Prediction on Srv (test)
31.39Hit Rate @ 10pi_theta (Ours)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| pi_theta (Ours)Backbone=Gemma3-27B2026.04 | 31.39 | 60.71 | 73.7 | 0.25 | 0.56 | 0.75 | |
| Claude-4.5Evaluation protocol=prompt-only2026.04 | 27.65 | 50.58 | 62.66 | 0.21 | 0.43 | 0.55 | |
| Qwen3-80bEvaluation protocol=prompt-only2026.04 | 25.66 | 50.91 | 64.31 | 0.17 | 0.36 | 0.47 | |
| GPT-5.1Evaluation protocol=prompt-only2026.04 | 25.19 | 50.67 | 63.87 | 0.16 | 0.32 | 0.41 | |
| GPT-oss-120bEvaluation protocol=prompt-only2026.04 | 21.51 | 41.51 | 55.04 | 0.13 | 0.28 | 0.36 | |
| PersonaXsBackbone=Gemma3-27B2026.04 | 20.44 | 43.62 | 58.06 | 0.12 | 0.24 | 0.31 | |
| PersonaXrBackbone=Gemma3-27B2026.04 | 13.46 | 35.46 | 49.29 | 0.04 | 0.08 | 0.11 |