Conversational Shopping Fulfillment on Taobao-derived fulfillment dataset
72.2Intent FulfillmentChat-REC
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Chat-RECFulfillment Path=Retrieval & ranking tools, Model=Qwen3-8B2026.06 | 72.2 | 94 | 93.9 | 82.8 | 66.6 | 74.8 | 59.8 | 47.5 | |
| ShopXFulfillment Path=Model-native item-space ops., Model=ShopX-8B2026.06 | 69.2 | 95 | 95.5 | 83.9 | 65.9 | 76.4 | 71.5 | 68.3 | |
| ShopXFulfillment Path=Model-native item-space ops., Model=ShopX-4B2026.06 | 65.6 | 91.1 | 92 | 84.7 | 65.7 | 74.7 | 66.5 | 60.9 | |
| RecMindFulfillment Path=Retrieval & ranking tools, Model=Qwen3-8B2026.06 | 63.6 | 91.2 | 90.7 | 80 | 65 | 75.6 | 62.9 | 42.1 | |
| InteRecAgentFulfillment Path=Retrieval & ranking tools, Model=Qwen3-8B2026.06 | 59.5 | 89.8 | 90 | 77.1 | 63.4 | 71.8 | 55.9 | 41.8 |