Generation on VisRAG Clean
67.33AccuracyRobustVisRAG
Evaluation results
| Method | Links | |
|---|---|---|
| RobustVisRAGRetrieval Setting=Oracle2026.02 | 67.33 | |
| VisRAG-Gen-FM (FARE)Fine-tuning Strategy=FARE, Retrieval Setting=Oracle2026.02 | 66.13 | |
| VisRAG-Gen-FM (FFT)Fine-tuning Strategy=FFT, Retrieval Setting=Oracle2026.02 | 65.91 | |
| VisRAG-Gen-FM (PEFT)Fine-tuning Strategy=PEFT, Retrieval Setting=Oracle2026.02 | 64.88 | |
| GPT-4oInput Modality=Vision, Retrieval Setting=Oracle2026.02 | 63.5 | |
| VisRAG-GenInput Modality=Vision, Retrieval Setting=Oracle2026.02 | 63.36 | |
| RobustVisRAGRetrieval Setting=top-32026.02 | 61.99 | |
| RobustVisRAGRetrieval Setting=top-22026.02 | 60.98 | |
| RobustVisRAGRetrieval Setting=top-12026.02 | 58.22 | |
| VisRAG-Gen-FM (FARE)Fine-tuning Strategy=FARE, Retrieval Setting=top-32026.02 | 57.02 | |
| VisRAG-Gen-FM (FARE)Fine-tuning Strategy=FARE, Retrieval Setting=top-22026.02 | 56.87 | |
| VisRAG-Gen-FM (FFT)Fine-tuning Strategy=FFT, Retrieval Setting=top-22026.02 | 56.32 | |
| VisRAG-Gen-FM (FFT)Fine-tuning Strategy=FFT, Retrieval Setting=top-32026.02 | 55.68 | |
| VisRAG-Gen-FM (FFT)Fine-tuning Strategy=FFT, Retrieval Setting=top-12026.02 | 55.5 | |
| VisRAG-Gen-FM (FARE)Fine-tuning Strategy=FARE, Retrieval Setting=top-12026.02 | 55.49 | |
| VisRAG-Gen-FM (PEFT)Fine-tuning Strategy=PEFT, Retrieval Setting=top-22026.02 | 55.44 | |
| VisRAG-Gen-FM (PEFT)Fine-tuning Strategy=PEFT, Retrieval Setting=top-32026.02 | 55.22 | |
| GPT-4oInput Modality=Vision, Retrieval Setting=top-32026.02 | 54.98 | |
| VisRAG-GenInput Modality=Vision, Retrieval Setting=top-32026.02 | 54.11 | |
| VisRAG-Gen-FM (PEFT)Fine-tuning Strategy=PEFT, Retrieval Setting=top-12026.02 | 53.92 | |
| VisRAG-GenInput Modality=Vision, Retrieval Setting=top-22026.02 | 53.82 | |
| GPT-4oInput Modality=Vision, Retrieval Setting=top-22026.02 | 53.69 | |
| GPT-4o (T)Input Modality=Text, Retrieval Setting=Oracle2026.02 | 53.06 | |
| GPT-4oInput Modality=Vision, Retrieval Setting=top-12026.02 | 52.44 | |
| VisRAG-GenInput Modality=Vision, Retrieval Setting=top-12026.02 | 51.51 | |
| GPT-4o (T)Input Modality=Text, Retrieval Setting=top-22026.02 | 47.44 | |
| GPT-4o (T)Input Modality=Text, Retrieval Setting=top-32026.02 | 47.03 | |
| GPT-4o (T)Input Modality=Text, Retrieval Setting=top-12026.02 | 44.05 | |
| MiniCPM (T)Input Modality=Text, Retrieval Setting=Oracle2026.02 | 31.92 | |
| MiniCPM (T)Input Modality=Text, Retrieval Setting=top-12026.02 | 28.44 | |
| MiniCPM (T)Input Modality=Text, Retrieval Setting=top-22026.02 | 28.43 | |
| MiniCPM (T)Input Modality=Text, Retrieval Setting=top-32026.02 | 27.79 |