Semantic Search on Amazon ESCI
32Precision@1Fine-tuned Sentence Transformer & Fine-tuned Flan-T5-Small (ours)
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Fine-tuned Sentence Transformer & Fine-tuned Flan-T5-Small (ours)Sentence Transformer=Fine-tuned, Filters=No filters prepended, LLM Component=Fine-tuned Flan-T5-Small, Structured Filtering=Included2026.01 | 32 | 16 | 29 | 28 | 25 | 36 | 20 | 44 | 13 | 57 | |
| Fine-tuned Sentence Transformer & Fine-tuned Flan-T5-SmallSentence Transformer=Fine-tuned, Filters=prepended, LLM Component=Fine-tuned Flan-T5-Small, Structured Filtering=Included2026.01 | 30 | 16 | 29 | 30 | 25 | 37 | 20 | 47 | 13 | 57 | |
| Pre-trained Sentence Transformer & Fine-tuned Flan-T5-SmallSentence Transformer=Pre-trained, Filters=prepended, LLM Component=Fine-tuned Flan-T5-Small, Structured Filtering=Included2026.01 | 22 | 11 | 19 | 18 | 17 | 23 | 14 | 32 | 9 | 39 |