Generation on DVisRAG Synthetic
57.87AccuracyRobustVisRAG
Evaluation results
| Method | Links | |
|---|---|---|
| RobustVisRAGRetrieval Setting=Oracle2026.02 | 57.87 | |
| VisRAG-Gen-FM (FARE)Fine-tuning Strategy=FARE, Retrieval Setting=Oracle2026.02 | 54.69 | |
| GPT-4oInput Modality=Vision, Retrieval Setting=Oracle2026.02 | 54.52 | |
| RobustVisRAGRetrieval Setting=top-32026.02 | 54.01 | |
| VisRAG-Gen-FM (FFT)Fine-tuning Strategy=FFT, Retrieval Setting=Oracle2026.02 | 53.2 | |
| RobustVisRAGRetrieval Setting=top-22026.02 | 53.18 | |
| VisRAG-Gen-FM (PEFT)Fine-tuning Strategy=PEFT, Retrieval Setting=Oracle2026.02 | 53.16 | |
| VisRAG-GenInput Modality=Vision, Retrieval Setting=Oracle2026.02 | 51.52 | |
| VisRAG-Gen-FM (FARE)Fine-tuning Strategy=FARE, Retrieval Setting=top-32026.02 | 48.18 | |
| RobustVisRAGRetrieval Setting=top-12026.02 | 48.02 | |
| VisRAG-Gen-FM (FARE)Fine-tuning Strategy=FARE, Retrieval Setting=top-22026.02 | 47.75 | |
| VisRAG-Gen-FM (FFT)Fine-tuning Strategy=FFT, Retrieval Setting=top-32026.02 | 46.17 | |
| VisRAG-Gen-FM (FFT)Fine-tuning Strategy=FFT, Retrieval Setting=top-22026.02 | 45.92 | |
| GPT-4oInput Modality=Vision, Retrieval Setting=top-32026.02 | 45.74 | |
| VisRAG-Gen-FM (FARE)Fine-tuning Strategy=FARE, Retrieval Setting=top-12026.02 | 45.68 | |
| GPT-4oInput Modality=Vision, Retrieval Setting=top-22026.02 | 45.29 | |
| VisRAG-Gen-FM (PEFT)Fine-tuning Strategy=PEFT, Retrieval Setting=top-32026.02 | 45.18 | |
| VisRAG-GenInput Modality=Vision, Retrieval Setting=top-32026.02 | 44.53 | |
| VisRAG-Gen-FM (PEFT)Fine-tuning Strategy=PEFT, Retrieval Setting=top-22026.02 | 44.51 | |
| VisRAG-Gen-FM (FFT)Fine-tuning Strategy=FFT, Retrieval Setting=top-12026.02 | 44.44 | |
| VisRAG-Gen-FM (PEFT)Fine-tuning Strategy=PEFT, Retrieval Setting=top-12026.02 | 43.64 | |
| VisRAG-GenInput Modality=Vision, Retrieval Setting=top-22026.02 | 43.35 | |
| GPT-4oInput Modality=Vision, Retrieval Setting=top-12026.02 | 43.31 | |
| VisRAG-GenInput Modality=Vision, Retrieval Setting=top-12026.02 | 42.16 | |
| GPT-4o (T)Input Modality=Text, Retrieval Setting=Oracle2026.02 | 37.9 | |
| GPT-4o (T)Input Modality=Text, Retrieval Setting=top-32026.02 | 30.63 | |
| GPT-4o (T)Input Modality=Text, Retrieval Setting=top-22026.02 | 29.51 | |
| GPT-4o (T)Input Modality=Text, Retrieval Setting=top-12026.02 | 26.26 | |
| MiniCPM (T)Input Modality=Text, Retrieval Setting=Oracle2026.02 | 24.23 | |
| MiniCPM (T)Input Modality=Text, Retrieval Setting=top-12026.02 | 18.58 | |
| MiniCPM (T)Input Modality=Text, Retrieval Setting=top-32026.02 | 18.18 | |
| MiniCPM (T)Input Modality=Text, Retrieval Setting=top-22026.02 | 18.06 |