Retrieval on HotelMatch Text-driven (test)
0.863MRR@10HotelMatch-LLM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HotelMatch-LLMModality Setting=Multimodal2025.06 | 0.863 | 0.884 | |
| HotelMatch-LLM w/o visionModality Setting=Text-only ablation2025.06 | 0.829 | 0.863 | |
| GTR-largeModality Setting=Text-only, Evaluation Protocol=Zero-Shot2025.06 | 0.824 | 0.857 | |
| GTR-baseModality Setting=Text-only, Evaluation Protocol=Zero-Shot2025.06 | 0.812 | 0.843 | |
| MARVELModality Setting=Multimodal, Evaluation Protocol=Fine-tuned2025.06 | 0.81 | 0.833 | |
| VISTAModality Setting=Multimodal, Evaluation Protocol=Fine-tuned2025.06 | 0.802 | 0.839 | |
| BM25Modality Setting=Text-only2025.06 | 0.798 | 0.825 | |
| CLIPModality Setting=Multimodal, Evaluation Protocol=Zero-Shot2025.06 | 0.545 | 0.609 | |
| CLIP-TextModality Setting=Text-only, Evaluation Protocol=Zero-Shot2025.06 | 0.541 | 0.6 |