Conversational Image Retrieval on ChatSearch (test)
37.9Recall@1ChatSearcher
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ChatSearcher2024.10 | 37.9 | 64.22 | 74.06 | |
| ChatSearcher2024.10 | 35.54 | 61.16 | 71.57 | |
| ChatSearcher2024.10 | 27.38 | 52.48 | 63.5 | |
| FROMAGe2024.10 | 15.94 | 36.76 | 48.6 | |
| CLIP-tType=Text-only2024.10 | 15.84 | 34.46 | 45.1 | |
| FROMAGe2024.10 | 14.36 | 32.58 | 42.8 | |
| CLIP-tType=Text-only2024.10 | 14.15 | 30.6 | 39.56 | |
| CLIP-tiType=Text and Image2024.10 | 13.18 | 28.56 | 37.07 | |
| CLIP-tType=Text-only2024.10 | 12.69 | 27.19 | 35.8 | |
| FROMAGe2024.10 | 12.56 | 29.65 | 39.65 | |
| CLIP-tiType=Text and Image2024.10 | 12.33 | 26.81 | 35.15 | |
| CLIP-iType=Image-only2024.10 | 9.65 | 20.96 | 28.05 | |
| CLIP-iType=Image-only2024.10 | 9.65 | 20.96 | 28.05 | |
| random choice2024.10 | 0.02 | 0.1 | 0.2 | |
| random choice2024.10 | 0.01 | 0.05 | 0.1 | |
| random choice2024.10 | 0.01 | 0.05 | 0.1 |