Knowledge-based Visual Question Answering on OKVQA (test)
64.3AccuracyLamRA
Evaluation results
| Method | Links | |
|---|---|---|
| LamRATraining=Simultaneous retrieval and VQA using LoRA2024.12 | 64.3 | |
| RA-VQAv2 w/ PreFLMR2024.12 | 61.9 | |
| LLaVA-1.5-7BTokens Retained=576, Retention Ratio=100%2026.06 | 53.42 | |
| PDropTokens Retained=192, Reduction Ratio=67%2026.06 | 52.37 | |
| ALVTSTokens Retained=128, Reduction Ratio=78%2026.06 | 52.13 | |
| ALVTSTokens Retained=192, Reduction Ratio=67%2026.06 | 52.12 | |
| FastVTokens Retained=192, Reduction Ratio=67%2026.06 | 51.77 | |
| DARTTokens Retained=192, Reduction Ratio=67%2026.06 | 51.5 | |
| DARTTokens Retained=128, Reduction Ratio=78%2026.06 | 51.17 | |
| PDropTokens Retained=128, Reduction Ratio=78%2026.06 | 50.27 | |
| FastVTokens Retained=128, Reduction Ratio=78%2026.06 | 49.9 | |
| ALVTSTokens Retained=64, Reduction Ratio=89%2026.06 | 49.66 | |
| DARTTokens Retained=64, Reduction Ratio=89%2026.06 | 47.99 | |
| FastVTokens Retained=64, Reduction Ratio=89%2026.06 | 45.14 | |
| PDropTokens Retained=64, Reduction Ratio=89%2026.06 | 45.1 | |
| VTWTokens Retained=192, Reduction Ratio=67%2026.06 | 30.6 | |
| VTWTokens Retained=128, Reduction Ratio=78%2026.06 | 22.87 | |
| VTWTokens Retained=64, Reduction Ratio=89%2026.06 | 19.96 |