Conversational Recommendation on Amazon Reviews Game 2023 (test)
43SRActCRS
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ActCRSBackbone=GPT-4o mini, #Calls=O(M + N)2025.06 | 43 | 68 | 50 | |
| ActCRS+SGPTBackbone=Llama-3.1-8B-Instruct, #Calls=O(M + N)2025.06 | 41 | 61 | 42 | |
| ActCRS+ECPOBackbone=Llama-3.1-8B-Instruct, #Calls=O(M + N)2025.06 | 41 | 61 | 56 | |
| ReActBackbone=GPT-4o mini, #Calls=O(M + N)2025.06 | 39 | 65 | 34 | |
| ChatRecBackbone=GPT-4o mini, #Calls=O(N)2025.06 | 37 | 45 | 9 | |
| MACRSBackbone=GPT-4o mini, #Calls=O(M + 4N)2025.06 | 36 | 65 | 15 | |
| ChatRecBackbone=Llama-3.1-8B-Instruct, #Calls=O(N)2025.06 | 36 | 39 | 1 | |
| MACRSBackbone=Llama-3.1-8B-Instruct, #Calls=O(M + 4N)2025.06 | 24 | 34 | 0 | |
| ActCRSBackbone=Llama-3.1-8B-Instruct, #Calls=O(M + N)2025.06 | 7 | 50 | 46 | |
| ReActBackbone=Llama-3.1-8B-Instruct, #Calls=O(M + N)2025.06 | 4 | 43 | 8 |