Retrieval on MMDialog 1,000 sampled instances (test)
31.3R@1Desc - Guessing
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Desc - Guessingshot=zero-shot, backbone=LLaMA-2-13B-Chat, decoding=greedy decoding2024.07 | 31.3 | 37.3 | 42.2 | 36.93 | |
| Desc - Queries (all)shot=zero-shot, backbone=LLaMA-2-13B-Chat, decoding=greedy decoding, queries=original five plus actions, atmosphere, and lighting2024.07 | 31.1 | 40.6 | 43.1 | 38.27 | |
| Desc - Queriesshot=zero-shot, backbone=LLaMA-2-13B-Chat, decoding=greedy decoding2024.07 | 30.9 | 37.5 | 40.8 | 36.4 | |
| Desc - Diagshot=zero-shot, backbone=LLaMA-2-13B-Chat, decoding=greedy decoding2024.07 | 22.1 | 34.3 | 41 | 32.47 | |
| Desc - Summaryshot=zero-shot, backbone=LLaMA-2-13B-Chat, decoding=greedy decoding2024.07 | 14.6 | 20 | 22.5 | 19.03 |