Question Answering on HotpotQA (GPT-Acc, Contain-Acc.)
76.2GPT AccuracyGAM-RAG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GAM-RAGMemorization turns=22026.03 | 76.2 | 74.3 | |
| GAM-RAGMemorization turns=02026.03 | 74.9 | 72.5 | |
| GAM-RAGMemorization turns=12026.03 | 74.9 | 71.9 | |
| REMINDRAGMemorization turns=02026.03 | 74.2 | 71.3 | |
| LinearRAGMemorization turns=02026.03 | 66.1 | 63.3 | |
| GFM-RAGMemorization turns=02026.03 | 65.6 | 61.8 | |
| HippoRAG2Memorization turns=02026.03 | 64.3 | 62.9 | |
| nvidia/NV-Embed-v2Memorization turns=02026.03 | 58.9 | 56.8 | |
| all-mpnet-base-v2Memorization turns=02026.03 | 58.4 | 56.2 | |
| PoGMemorization turns=02026.03 | 58.1 | 60.9 | |
| GritLM / GritLM-7BMemorization turns=02026.03 | 55.2 | 51.3 | |
| DyG-RAGMemorization turns=02026.03 | 51.2 | 48.3 | |
| Direct AnsweringMemorization turns=02026.03 | 40 | 37.6 | |
| Chain-of-Thought (CoT)Memorization turns=02026.03 | 39.8 | 38.2 |