Question Answering on AIRQA-REAL
37.7SGL ScoreIterative Neu-RAG
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Iterative Neu-RAGNeural=true, Symbolic=false, Multi-view=true, # Interaction(s)=≥ 22025.05 | 37.7 | 18.7 | 48.4 | 32.7 | 38.3 | 37.3 | |
| Iterative Sym-RAGNeural=false, Symbolic=true, Multi-view=true, # Interaction(s)=≥ 22025.05 | 32.1 | 14.7 | 33.6 | 27.1 | 28.3 | 28 | |
| Full-text w/. cutoff# Interaction(s)=12025.05 | 28.3 | 10.7 | 0.1 | 26.2 | 7.6 | 11.2 | |
| NeuSym-RAGNeural=true, Symbolic=true, Multi-view=true, # Interaction(s)=≥ 22025.05 | 28.3 | 32.3 | 58.2 | 27.1 | 42.6 | 39.6 | |
| Hybrid-RAGNeural=true, Symbolic=true, Multi-view=true, # Interaction(s)=22025.05 | 23.3 | 9.3 | 5.7 | 16.8 | 10.5 | 11.8 | |
| Graph-RAGNeural=true, Symbolic=false, Multi-view=true, # Interaction(s)=22025.05 | 22.2 | 11.1 | 0 | 21.1 | 11.5 | 15.6 | |
| Two-stage Neu-RAGNeural=true, Symbolic=false, Multi-view=true, # Interaction(s)=22025.05 | 19.5 | 10 | 5.3 | 15.9 | 9.4 | 10.7 | |
| Classic RAGNeural=true, Symbolic=false, Multi-view=false, # Interaction(s)=12025.05 | 18.2 | 4 | 9.4 | 8.4 | 11 | 10.5 | |
| Two-stage Sym-RAGNeural=false, Symbolic=true, Multi-view=true, # Interaction(s)=22025.05 | 12.2 | 5.4 | 9.4 | 10.6 | 8.7 | 9.1 | |
| Iterative Classic RAGNeural=true, Symbolic=false, Multi-view=false, # Interaction(s)=≥ 22025.05 | 8.2 | 10 | 15.2 | 5.6 | 13.2 | 11.8 | |
| Question only# Interaction(s)=12025.05 | 5.7 | 8 | 0.4 | 9.4 | 2.7 | 4 | |
| Title + AbstractNeural=false, Symbolic=false, Multi-view=false, # Interaction(s)=12025.05 | 5.7 | 14 | 0 | 13.1 | 3.6 | 5.7 |