Conversational Recommendation on Amazon Book Reviews 2023 (test)
63SRMACRS
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| MACRSBackbone=GPT-4o mini, #Calls=O(M + 4N)2025.06 | 63 | 71 | 1 | |
| ActCRS+ECPOBackbone=Llama-3.1-8B-Instruct, #Calls=O(M + N)2025.06 | 56 | 58 | 57 | |
| ActCRS+SGPTBackbone=Llama-3.1-8B-Instruct, #Calls=O(M + N)2025.06 | 54 | 57 | 48 | |
| ActCRSBackbone=GPT-4o mini, #Calls=O(M + N)2025.06 | 53 | 56 | 50 | |
| ReActBackbone=GPT-4o mini, #Calls=O(M + N)2025.06 | 52 | 56 | 33 | |
| ChatRecBackbone=GPT-4o mini, #Calls=O(N)2025.06 | 46 | 47 | 13 | |
| ChatRecBackbone=Llama-3.1-8B-Instruct, #Calls=O(N)2025.06 | 42 | 47 | 3 | |
| ReActBackbone=Llama-3.1-8B-Instruct, #Calls=O(M + N)2025.06 | 36 | 54 | 19 | |
| MACRSBackbone=Llama-3.1-8B-Instruct, #Calls=O(M + 4N)2025.06 | 36 | 39 | 1 | |
| ActCRSBackbone=Llama-3.1-8B-Instruct, #Calls=O(M + N)2025.06 | 34 | 55 | 28 |