Assortment optimization on SUSHI Preference Data Set (test)
80Worst CR30 real data
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| 30 real dataAssortment Size (B)=52026.02 | 80 | 0.19 | 99 | 99 | 99 | |
| DescriptionModel=GPT-4o, Few-shot=false, Assortment Size (B)=22026.02 | 71 | 0.2 | 95 | 96 | 95 | |
| DescriptionModel=GPT-4o, Few-shot=false, Assortment Size (B)=52026.02 | 71 | 0.2 | 99 | 99 | 98 | |
| 15 real dataAssortment Size (B)=52026.02 | 71 | 0.24 | 98 | 98 | 99 | |
| Popularity scoreAssortment Size (B)=52026.02 | 70 | — | 100 | 100 | 98 | |
| SamplingModel=GPT-4o, Few-shot=false, Assortment Size (B)=22026.02 | 69 | 0.23 | 97 | 97 | 89 | |
| SamplingModel=GPT-4o, Few-shot=false, Assortment Size (B)=52026.02 | 69 | 0.23 | 99 | 98 | 98 | |
| PersonaModel=GPT-4o, Few-shot=false, Assortment Size (B)=22026.02 | 69 | 0.24 | 97 | 98 | 88 | |
| PersonaModel=GPT-4o, Few-shot=false, Assortment Size (B)=52026.02 | 69 | 0.24 | 100 | 100 | 99 | |
| DescriptionModel=GPT-5-mini, Few-shot=false, Assortment Size (B)=52026.02 | 69 | 0.19 | 100 | 99 | 99 | |
| DescriptionModel=Mistral Large 3, Few-shot=false, Assortment Size (B)=52026.02 | 67 | 0.19 | 99 | 99 | 98 | |
| PersonaModel=GPT-4o, Few-shot=true, Assortment Size (B)=22026.02 | 66 | 0.22 | 97 | 96 | 93 | |
| PersonaModel=GPT-4o, Few-shot=true, Assortment Size (B)=52026.02 | 66 | 0.22 | 100 | 99 | 99 | |
| SamplingModel=GPT-4o, Few-shot=true, Assortment Size (B)=22026.02 | 65 | 0.23 | 97 | 96 | 92 | |
| SamplingModel=GPT-4o, Few-shot=true, Assortment Size (B)=52026.02 | 65 | 0.23 | 98 | 98 | 99 | |
| 30 real dataModel=Baseline, Assortment size (B)=22026.02 | 65 | 0.19 | 96 | 97 | 90 | |
| 30 real dataModel=Baseline, Assortment size (B)=52026.02 | 65 | 0.19 | 98 | 97 | 97 | |
| DescriptionModel=Gemini 3 Flash, Few-shot=true, Assortment Size (B)=52026.02 | 62 | 0.21 | 98 | 98 | 98 | |
| DescriptionModel=GPT-4o-mini, Few-shot prompting=false, Assortment size (B)=22026.02 | 62 | 0.19 | 97 | 95 | 89 | |
| DescriptionModel=GPT-4o-mini, Few-shot prompting=false, Assortment size (B)=52026.02 | 62 | 0.19 | 99 | 99 | 96 | |
| 5 real dataAssortment Size (B)=22026.02 | 61 | 0.29 | 94 | 95 | 93 | |
| DescriptionModel=GPT-4o-mini, Few-shot prompting=true, Assortment size (B)=22026.02 | 61 | 0.19 | 95 | 94 | 88 | |
| DescriptionModel=GPT-4o-mini, Few-shot prompting=true, Assortment size (B)=52026.02 | 61 | 0.19 | 97 | 97 | 96 | |
| SamplingModel=GPT-5-mini, Few-shot=false, Assortment Size (B)=22026.02 | 60 | 0.3 | 97 | 98 | 100 | |
| SamplingModel=Gemini 3 Flash, Few-shot=false, Assortment Size (B)=22026.02 | 60 | 0.31 | 97 | 97 | 100 | |
| DescriptionModel=GPT-4o, Few-shot prompting=false, Assortment size (B)=22026.02 | 58 | 0.2 | 95 | 93 | 76 | |
| DescriptionModel=GPT-4o, Few-shot prompting=false, Assortment size (B)=52026.02 | 58 | 0.2 | 96 | 96 | 95 | |
| BatchModel=GPT-4o, Few-shot=false, Assortment Size (B)=22026.02 | 57 | 0.34 | 92 | 91 | 87 | |
| BatchModel=GPT-4o, Few-shot=false, Assortment Size (B)=52026.02 | 57 | 0.34 | 97 | 97 | 98 | |
| DescriptionModel=Mistral Large 2, Few-shot prompting=false, Assortment size (B)=22026.02 | 57 | 0.19 | 93 | 91 | 79 | |
| DescriptionModel=Mistral Large 2, Few-shot prompting=false, Assortment size (B)=52026.02 | 57 | 0.19 | 95 | 96 | 92 | |
| BatchModel=GPT-4o-mini, Few-shot prompting=false, Assortment size (B)=22026.02 | 54 | 0.26 | 91 | 89 | 76 | |
| BatchModel=GPT-4o-mini, Few-shot prompting=false, Assortment size (B)=52026.02 | 54 | 0.26 | 92 | 94 | 85 | |
| BatchModel=Gemini 1.5 Flash, Few-shot prompting=true, Assortment size (B)=22026.02 | 54 | 0.25 | 97 | 92 | 81 | |
| BatchModel=Gemini 1.5 Flash, Few-shot prompting=true, Assortment size (B)=52026.02 | 54 | 0.25 | 98 | 97 | 91 | |
| Popularity scoreModel=Baseline, Assortment size (B)=22026.02 | 53 | — | 96 | 100 | 56 | |
| Popularity scoreModel=Baseline, Assortment size (B)=52026.02 | 53 | — | 99 | 100 | 89 | |
| 15 real dataModel=Baseline, Assortment size (B)=22026.02 | 53 | 0.24 | 98 | 95 | 91 | |
| 15 real dataModel=Baseline, Assortment size (B)=52026.02 | 53 | 0.24 | 94 | 95 | 97 | |
| DescriptionModel=GPT-4o, Few-shot prompting=true, Assortment size (B)=22026.02 | 52 | 0.19 | 94 | 92 | 84 | |
| DescriptionModel=GPT-4o, Few-shot prompting=true, Assortment size (B)=52026.02 | 52 | 0.19 | 95 | 94 | 90 | |
| PersonaModel=Gemini 1.5 Flash, Few-shot prompting=false, Assortment size (B)=22026.02 | 51 | 0.24 | 93 | 92 | 80 | |
| PersonaModel=Gemini 1.5 Flash, Few-shot prompting=false, Assortment size (B)=52026.02 | 51 | 0.24 | 96 | 97 | 97 | |
| BatchModel=Gemini 1.5 Flash, Few-shot prompting=false, Assortment size (B)=22026.02 | 51 | 0.25 | 95 | 88 | 75 | |
| BatchModel=Gemini 1.5 Flash, Few-shot prompting=false, Assortment size (B)=52026.02 | 51 | 0.25 | 99 | 98 | 95 | |
| DescriptionModel=Gemini 1.5 Flash, Few-shot prompting=false, Assortment size (B)=22026.02 | 51 | 0.2 | 90 | 88 | 75 | |
| DescriptionModel=Gemini 1.5 Flash, Few-shot prompting=false, Assortment size (B)=52026.02 | 51 | 0.2 | 99 | 98 | 94 | |
| BatchModel=GPT-4o-mini, Few-shot prompting=true, Assortment size (B)=22026.02 | 50 | 0.25 | 90 | 85 | 73 | |
| BatchModel=GPT-4o-mini, Few-shot prompting=true, Assortment size (B)=52026.02 | 50 | 0.25 | 92 | 93 | 80 | |
| SamplingModel=Mistral Large 3, Few-shot=false, Assortment Size (B)=22026.02 | 47 | 0.28 | 97 | 93 | 88 | |
| SamplingModel=GPT-4o-mini, Few-shot prompting=true, Assortment size (B)=22026.02 | 47 | 0.26 | 92 | 95 | 95 | |
| SamplingModel=GPT-4o-mini, Few-shot prompting=true, Assortment size (B)=52026.02 | 47 | 0.26 | 97 | 96 | 96 | |
| PersonaModel=Mistral Large 2, Few-shot prompting=false, Assortment size (B)=22026.02 | 47 | 0.23 | 90 | 87 | 65 | |
| PersonaModel=Mistral Large 2, Few-shot prompting=false, Assortment size (B)=52026.02 | 47 | 0.23 | 97 | 97 | 92 | |
| RandomAssortment Size (B)=22026.02 | 46 | 0.23 | 85 | 85 | 83 | |
| PersonaModel=Mistral Large 2, Few-shot prompting=true, Assortment size (B)=22026.02 | 45 | 0.24 | 87 | 86 | 76 | |
| PersonaModel=Mistral Large 2, Few-shot prompting=true, Assortment size (B)=52026.02 | 45 | 0.24 | 97 | 97 | 93 | |
| DescriptionModel=Mistral Large 2, Few-shot prompting=true, Assortment size (B)=22026.02 | 45 | 0.24 | 82 | 81 | 72 | |
| DescriptionModel=Mistral Large 2, Few-shot prompting=true, Assortment size (B)=52026.02 | 45 | 0.24 | 88 | 88 | 87 | |
| PersonaModel=GPT-4o, Few-shot prompting=false, Assortment size (B)=22026.02 | 44 | 0.24 | 96 | 98 | 100 | |
| PersonaModel=GPT-4o, Few-shot prompting=false, Assortment size (B)=52026.02 | 44 | 0.24 | 99 | 98 | 96 | |
| SamplingModel=GPT-4o-mini, Few-shot prompting=false, Assortment size (B)=22026.02 | 44 | 0.3 | 96 | 97 | 100 | |
| SamplingModel=GPT-4o-mini, Few-shot prompting=false, Assortment size (B)=52026.02 | 44 | 0.3 | 86 | 89 | 93 | |
| PersonaModel=GPT-4o, Few-shot prompting=true, Assortment size (B)=22026.02 | 43 | 0.22 | 97 | 91 | 82 | |
| PersonaModel=GPT-4o, Few-shot prompting=true, Assortment size (B)=52026.02 | 43 | 0.22 | 98 | 97 | 94 | |
| SamplingModel=Gemini 1.5 Flash, Few-shot prompting=false, Assortment size (B)=22026.02 | 43 | 0.31 | 96 | 94 | 87 | |
| SamplingModel=Gemini 1.5 Flash, Few-shot prompting=false, Assortment size (B)=52026.02 | 43 | 0.31 | 86 | 89 | 95 | |
| SamplingModel=GPT-4o, Few-shot prompting=false, Assortment size (B)=22026.02 | 42 | 0.23 | 96 | 91 | 74 | |
| SamplingModel=GPT-4o, Few-shot prompting=false, Assortment size (B)=52026.02 | 42 | 0.23 | 93 | 92 | 95 | |
| PersonaModel=GPT-4o-mini, Few-shot prompting=true, Assortment size (B)=22026.02 | 41 | 0.22 | 86 | 83 | 78 | |
| PersonaModel=GPT-4o-mini, Few-shot prompting=true, Assortment size (B)=52026.02 | 41 | 0.22 | 98 | 96 | 96 | |
| DescriptionModel=Gemini 1.5 Flash, Few-shot prompting=true, Assortment size (B)=22026.02 | 40 | 0.21 | 78 | 78 | 73 | |
| DescriptionModel=Gemini 1.5 Flash, Few-shot prompting=true, Assortment size (B)=52026.02 | 40 | 0.21 | 94 | 94 | 90 | |
| 5 real dataModel=Baseline, Assortment size (B)=22026.02 | 40 | 0.29 | 91 | 91 | 83 | |
| 5 real dataModel=Baseline, Assortment size (B)=52026.02 | 40 | 0.29 | 86 | 90 | 90 | |
| SamplingModel=GPT-4o, Few-shot prompting=true, Assortment size (B)=22026.02 | 39 | 0.23 | 97 | 90 | 82 | |
| SamplingModel=GPT-4o, Few-shot prompting=true, Assortment size (B)=52026.02 | 39 | 0.23 | 94 | 94 | 95 | |
| PersonaModel=GPT-4o-mini, Few-shot prompting=false, Assortment size (B)=22026.02 | 38 | 0.22 | 69 | 76 | 73 | |
| PersonaModel=GPT-4o-mini, Few-shot prompting=false, Assortment size (B)=52026.02 | 38 | 0.22 | 96 | 95 | 97 | |
| BatchModel=GPT-4o, Few-shot prompting=false, Assortment size (B)=22026.02 | 37 | 0.34 | 83 | 78 | 71 | |
| BatchModel=GPT-4o, Few-shot prompting=false, Assortment size (B)=52026.02 | 37 | 0.34 | 89 | 91 | 91 | |
| PersonaModel=Gemini 1.5 Flash, Few-shot prompting=true, Assortment size (B)=22026.02 | 37 | 0.24 | 71 | 76 | 73 | |
| PersonaModel=Gemini 1.5 Flash, Few-shot prompting=true, Assortment size (B)=52026.02 | 37 | 0.24 | 85 | 85 | 86 | |
| BatchModel=GPT-4o, Few-shot prompting=true, Assortment size (B)=22026.02 | 35 | 0.34 | 75 | 77 | 69 | |
| BatchModel=GPT-4o, Few-shot prompting=true, Assortment size (B)=52026.02 | 35 | 0.34 | 84 | 87 | 82 | |
| SamplingModel=Mistral Large 2, Few-shot prompting=true, Assortment size (B)=22026.02 | 35 | 0.27 | 76 | 77 | 72 | |
| SamplingModel=Mistral Large 2, Few-shot prompting=true, Assortment size (B)=52026.02 | 35 | 0.27 | 92 | 91 | 88 | |
| BatchModel=Mistral Large 2, Few-shot prompting=false, Assortment size (B)=22026.02 | 35 | 0.34 | 81 | 79 | 68 | |
| BatchModel=Mistral Large 2, Few-shot prompting=false, Assortment size (B)=52026.02 | 35 | 0.34 | 87 | 88 | 83 | |
| SamplingModel=Gemini 1.5 Flash, Few-shot prompting=true, Assortment size (B)=22026.02 | 34 | 0.28 | 70 | 74 | 71 | |
| SamplingModel=Gemini 1.5 Flash, Few-shot prompting=true, Assortment size (B)=52026.02 | 34 | 0.28 | 82 | 80 | 78 | |
| SamplingModel=Mistral Large 2, Few-shot prompting=false, Assortment size (B)=22026.02 | 34 | 0.28 | 96 | 83 | 71 | |
| SamplingModel=Mistral Large 2, Few-shot prompting=false, Assortment size (B)=52026.02 | 34 | 0.28 | 97 | 97 | 97 | |
| RandomModel=Baseline, Assortment size (B)=22026.02 | 31 | 0.23 | 71 | 65 | 55 | |
| RandomModel=Baseline, Assortment size (B)=52026.02 | 31 | 0.23 | 83 | 82 | 76 | |
| BatchModel=Mistral Large 2, Few-shot prompting=true, Assortment size (B)=22026.02 | 30 | 0.35 | 69 | 73 | 67 | |
| BatchModel=Mistral Large 2, Few-shot prompting=true, Assortment size (B)=52026.02 | 30 | 0.35 | 79 | 85 | 80 |