Question Answering on NQ (EM, Avg, Sel. Lat. (ms))
54.8EM (Exact Match)GeoRAG
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GeoRAGRetriever Type=Dense Retriever, Candidate Pool Size=200, Selection Count (k)=52026.06 | 54.8 | 54.7 | 1,222 | |
| BGE-RerankerRetriever Type=Dense Retriever, Candidate Pool Size=200, Selection Count (k)=52026.06 | 52.8 | 52.1 | 1,890 | |
| AdaGReSRetriever Type=Dense Retriever, Candidate Pool Size=200, Selection Count (k)=52026.06 | 51.9 | 52.8 | 96.3 | |
| SMART-RAGRetriever Type=Dense Retriever, Candidate Pool Size=200, Selection Count (k)=52026.06 | 50.1 | 51.7 | 118.5 | |
| DPPRetriever Type=Dense Retriever, Candidate Pool Size=200, Selection Count (k)=52026.06 | 48.3 | 50.2 | 41.8 | |
| MMRRetriever Type=Dense Retriever, Candidate Pool Size=200, Selection Count (k)=52026.06 | 47.5 | 49.6 | 14.6 | |
| Cosine top-5 (truncation)Retriever Type=Dense Retriever, Candidate Pool Size=200, Selection Count (k)=52026.06 | 44.1 | 47.2 | 0.4 |