Multi-turn information acquisition on Fashion
83.77Success Rate (SR)CUP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CUPModel=Mistral-7B-v0.32026.04 | 83.77 | 4.11 | |
| CUPModel=Qwen3-4B2026.04 | 83.41 | 4.16 | |
| CUPModel=Llama-3.1-8B2026.04 | 82.2 | 4.01 | |
| MISQ-HFModel=Llama-3.1-8B2026.04 | 63.44 | 4.18 | |
| MISQ-HFModel=Mistral-7B-v0.32026.04 | 59.32 | 4.16 | |
| BED-LLMModel=Llama-3.1-8B2026.04 | 59.32 | 4.4 | |
| MISQ-HFModel=Qwen3-4B2026.04 | 56.41 | 4.2 | |
| ATDModel=Llama-3.1-8B2026.04 | 52.3 | 4.6 | |
| UoTModel=Llama-3.1-8B2026.04 | 52.06 | 4.73 | |
| BED-LLMModel=Qwen3-4B2026.04 | 51.82 | 4.38 | |
| UoTModel=Mistral-7B-v0.32026.04 | 50.85 | 4.77 | |
| BED-LLMModel=Mistral-7B-v0.32026.04 | 50.24 | 4.45 | |
| UoTModel=Qwen3-4B2026.04 | 49.52 | 4.8 | |
| ATDModel=Mistral-7B-v0.32026.04 | 48.67 | 4.62 | |
| ATDModel=Qwen3-4B2026.04 | 48.43 | 4.62 | |
| LLM-planningModel=Mistral-7B-v0.32026.04 | 41.65 | 4.69 | |
| LLM-planningModel=Qwen3-4B2026.04 | 41.53 | 4.7 | |
| LLM-planningModel=Llama-3.1-8B2026.04 | 40.68 | 4.73 | |
| CoTModel=Qwen3-4B2026.04 | 39.23 | 4.05 | |
| CoTModel=Llama-3.1-8B2026.04 | 38.62 | 4.13 | |
| CoTModel=Mistral-7B-v0.32026.04 | 38.14 | 4.01 | |
| Direct PromptingModel=Qwen3-4B2026.04 | 37.65 | 4.13 | |
| Direct PromptingModel=Llama-3.1-8B2026.04 | 35.23 | 4.21 | |
| Direct PromptingModel=Mistral-7B-v0.32026.04 | 33.9 | 4.18 | |
| SBERT2026.04 | 15.86 | 4.79 |