Conversational Recommendation on SafeMovie
8.27Recall@5GPT-5.2
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| GPT-5.2Zero-shot=true2026.03 | 8.27 | 13.79 | 6.27 | 8.15 | 0.3508 | 0.3369 | 1.03 | 1.55 | |
| CRAG (GPT-4o)Collaborative Retrieval=true2026.03 | 8.26 | 12.17 | 5.81 | 7.15 | 0.4007 | 0.3894 | 1.2 | 1.8 | |
| SafeCRS (Llama-3.1-8B)Backbone=Llama-3.1-8B2026.03 | 7.74 | 11.11 | 6.25 | 7.37 | 0.0122 | 0.0087 | 0.039 | 0.048 | |
| CRAG (Gemini2.0)Collaborative Retrieval=true2026.03 | 7.59 | 12.3 | 5.63 | 7.2 | 0.3695 | 0.369 | 1.09 | 1.68 | |
| SafeCRS (Qwen3-8B)Backbone=Qwen3-8B2026.03 | 7.43 | 9.51 | 5.97 | 6.14 | 0.0013 | 0.0022 | 0.039 | 0.043 | |
| SafeCRS (Qwen2.5-0.5B)Backbone=Qwen2.5-0.5B2026.03 | 7.32 | 9.22 | 5.47 | 5.97 | 0.0011 | 0.0006 | 0.32 | 0.35 | |
| SafeCRS (Llama-3.2-3B)Backbone=Llama-3.2-3B2026.03 | 7.11 | 9.96 | 6.05 | 5.92 | 0.0178 | 0.0101 | 0.07 | 0.12 | |
| GPT-4Zero-shot=true2026.03 | 7.05 | 11.28 | 5.17 | 6.64 | 0.4454 | 0.4359 | 1.31 | 2 | |
| Gemma3-27BZero-shot=true2026.03 | 6.76 | 9.73 | 5.34 | 6.36 | 0.3548 | 0.3684 | 0.99 | 1.61 | |
| CRAG (Haiku4.5)Collaborative Retrieval=true2026.03 | 6.68 | 9.72 | 4.76 | 5.77 | 0.3587 | 0.3524 | 1.06 | 1.61 | |
| Llama3-SDSC-70BZero-shot=true2026.03 | 6.5 | 8.79 | 4.83 | 5.64 | 0.3642 | 0.3443 | 1.09 | 1.61 | |
| NBCRSType=Traditional CRS2026.03 | 4.51 | 7.66 | 3.12 | 4.2 | 0.538 | 0.5083 | 1.64 | 2.4 | |
| KBRDType=Traditional CRS2026.03 | 1.15 | 1.35 | 0.9 | 0.97 | 0.3752 | 0.3756 | 1.11 | 1.62 |