Conversational Recommendation on SafeGame
27.02Recall@5SafeCRS (Llama-3.1-8B)
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| SafeCRS (Llama-3.1-8B)Backbone=Llama-3.1-8B2026.03 | 27.02 | 29.07 | 34.04 | 36.14 | 1.89 | 1.32 | 4 | 4 | |
| SafeCRS (Qwen3-8B)Backbone=Qwen3-8B2026.03 | 23.45 | 29.96 | 31.08 | 32.69 | 2.32 | 1.76 | 3 | 4 | |
| SafeCRS (Llama-3.2-3B)Backbone=Llama-3.2-3B2026.03 | 22.76 | 24.52 | 29.39 | 30.02 | 5.47 | 5.83 | 7 | 9 | |
| SafeCRS (Qwen2.5-0.5B)Backbone=Qwen2.5-0.5B2026.03 | 15.42 | 17.89 | 18.84 | 19.02 | 7.74 | 7.92 | 11 | 12 | |
| Llama3-SDSC-70BZero-shot=true2026.03 | 7.35 | 7.4 | 10.31 | 10.34 | 5.15 | 5.21 | 14 | 20 | |
| CRAG (GPT-4o)Collaborative Retrieval=true2026.03 | 4.22 | 4.22 | 8.33 | 8.33 | 6.64 | 6.55 | 20 | 26 | |
| GPT-5.2Zero-shot=true2026.03 | 4.22 | 4.26 | 8.33 | 8.27 | 4 | 3.8 | 12 | 17 | |
| GPT-4Zero-shot=true2026.03 | 3.63 | 3.63 | 7.54 | 7.54 | 6.3 | 6.79 | 17 | 27 | |
| CRAG (Haiku4.5)Collaborative Retrieval=true2026.03 | 1.62 | 1.64 | 3.54 | 3.61 | 3.67 | 3.65 | 9 | 11 | |
| Gemma3-27BZero-shot=true2026.03 | 0.81 | 0.81 | 1.17 | 1.17 | 0.18 | 0.14 | 0 | 1 | |
| CRAG (Gemini2.0)Collaborative Retrieval=true2026.03 | 0.36 | 0.36 | 0.22 | 0.22 | 0.17 | 0.17 | 2 | 2 |