Conversational Recommendation on Electronics
50Success RateD2D
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| D2DModel=o4-mini2026.06 | 50 | 17.92 | 51.36 | 47 | 1 | 3.54 | 410 | 51,390 | 1,456 | 181,921 | |
| D2DModel=gpt-4.1-mini2026.06 | 42 | 15.32 | 41.98 | 52 | 4 | 4.96 | 364 | 50,745 | 1,808 | 251,903 | |
| Full-LLMModel=gpt-4.1-mini2026.06 | 38.5 | 11.73 | 31.65 | 56 | 3.5 | 1.8 | 814 | 89,464 | 1,465 | 161,483 | |
| Full-LLMModel=o4-mini2026.06 | 24 | 5.93 | 15.85 | 73.5 | 0.5 | 3.04 | 1,386 | 90,113 | 4,180 | 271,692 | |
| ZS RecommenderModel=gpt-4.1-mini2026.06 | 21 | 5.03 | 12.84 | 83.5 | 6.5 | 1.67 | 490 | 89,167 | 816 | 148,463 | |
| ZS RecommenderModel=o4-mini2026.06 | 13 | 3.19 | 6.81 | 84.5 | 0.5 | 2 | 674 | 89,188 | 1,348 | 178,398 | |
| Embedding RetrievalModel=N/A2026.06 | 2.5 | 0.79 | 24.88 | — | — | — | — | — | — | — | |
| BM25 RetrievalModel=N/A2026.06 | 0.5 | 0.12 | 23.76 | — | — | — | — | — | — | — |