Conversational Recommendation on Yelp (test)
57Success RateReAct
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ReActBackbone=GPT-4o mini, #Calls=O(M + N)2025.06 | 57 | 62 | 42 | |
| ActCRS+ECPOBackbone=Llama-3.1-8B-Instruct, #Calls=O(M + N)2025.06 | 45 | 47 | 63 | |
| ActCRS+SGPTBackbone=Llama-3.1-8B-Instruct, #Calls=O(M + N)2025.06 | 44 | 48 | 47 | |
| MACRSBackbone=GPT-4o mini, #Calls=O(M + 4N)2025.06 | 40 | 41 | 2 | |
| ActCRSBackbone=GPT-4o mini, #Calls=O(M + N)2025.06 | 37 | 43 | 50 | |
| ReActBackbone=Llama-3.1-8B-Instruct, #Calls=O(M + N)2025.06 | 31 | 40 | 16 | |
| ChatRecBackbone=Llama-3.1-8B-Instruct, #Calls=O(N)2025.06 | 30 | 32 | 5 | |
| ChatRecBackbone=GPT-4o mini, #Calls=O(N)2025.06 | 24 | 30 | 12 | |
| MACRSBackbone=Llama-3.1-8B-Instruct, #Calls=O(M + 4N)2025.06 | 22 | 24 | 1 | |
| ActCRSBackbone=Llama-3.1-8B-Instruct, #Calls=O(M + N)2025.06 | 22 | 35 | 38 |