Multimodal Retrieval-Augmented Generation on WebQA
59.3ROrigLPA-BB
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LPA-BBGenerator=LLaVA, Retriever=CLIP-ViT-L, Retriever config (Rt.)=N = 5, Reranker config (Rr.)=K = m, Captions=✓2025.02 | 59.3 | 20.8 | 68.3 | 20.2 | |
| LPA-BBGenerator=Qwen-VL-Chat, Retriever=CLIP-ViT-L, Retriever config (Rt.)=N = 5, Reranker config (Rr.)=K = m, Captions=✓2025.02 | 56.8 | 21 | 69 | 15.3 | |
| LPA-BBGenerator=LLaVA, Retriever=CLIP-ViT-L, Retriever config (Rt.)=N = m, Reranker config (Rr.)=✗, Captions=-2025.02 | 50.5 | 21.2 | 58.1 | 19.4 | |
| LPA-BBGenerator=Qwen-VL-Chat, Retriever=CLIP-ViT-L, Retriever config (Rt.)=N = m, Reranker config (Rr.)=✗, Captions=-2025.02 | 50.5 | 19.4 | 58.1 | 18.3 | |
| LPA-BBGenerator=Qwen-VL-Chat, Retriever=CLIP-ViT-L, Retriever config (Rt.)=N = 5, Reranker config (Rr.)=K = m, Captions=✗2025.02 | 49.9 | 20.2 | 63.3 | 16.6 | |
| LPA-BBGenerator=LLaVA, Retriever=CLIP-ViT-L, Retriever config (Rt.)=N = 5, Reranker config (Rr.)=K = m, Captions=✗2025.02 | 48.5 | 20.5 | 60.4 | 19.6 | |
| LPA-RtGenerator=LLaVA, Retriever=CLIP-ViT-L, Retriever config (Rt.)=N = 5, Reranker config (Rr.)=K = m, Captions=✓2025.02 | 27.7 | 17.3 | 95.9 | 22.8 | |
| LPA-RtGenerator=Qwen-VL-Chat, Retriever=CLIP-ViT-L, Retriever config (Rt.)=N = 5, Reranker config (Rr.)=K = m, Captions=✓2025.02 | 27 | 18.5 | 93.9 | 19 | |
| LPA-RtGenerator=Qwen-VL-Chat, Retriever=CLIP-ViT-L, Retriever config (Rt.)=N = 5, Reranker config (Rr.)=K = m, Captions=✗2025.02 | 25.2 | 17.2 | 90.2 | 19.7 | |
| LPA-RtGenerator=LLaVA, Retriever=CLIP-ViT-L, Retriever config (Rt.)=N = 5, Reranker config (Rr.)=K = m, Captions=✗2025.02 | 23.1 | 17.2 | 90.4 | 22.2 | |
| LPA-RtGenerator=LLaVA, Retriever=CLIP-ViT-L, Retriever config (Rt.)=N = m, Reranker config (Rr.)=✗, Captions=-2025.02 | 10.9 | 16 | 99.8 | 23 | |
| LPA-RtGenerator=Qwen-VL-Chat, Retriever=CLIP-ViT-L, Retriever config (Rt.)=N = m, Reranker config (Rr.)=✗, Captions=-2025.02 | 10.9 | 17.6 | 99.8 | 19.1 |