Question Answering on TimeQA
51.26GPT AccuracyDyG-RAG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DyG-RAGMemorization turns=02026.03 | 51.26 | 52.38 | |
| GAM-RAGMemorization turns=22026.03 | 50.32 | 52.36 | |
| GAM-RAGMemorization turns=02026.03 | 49.45 | 51.35 | |
| GAM-RAGMemorization turns=12026.03 | 49.12 | 51.12 | |
| LinearRAGMemorization turns=02026.03 | 44.62 | 47.82 | |
| nvidia/NV-Embed-v2Memorization turns=02026.03 | 43.89 | 44.35 | |
| REMINDRAGMemorization turns=02026.03 | 43.89 | 45.72 | |
| GFM-RAGMemorization turns=02026.03 | 42.83 | 44.79 | |
| HippoRAG2Memorization turns=02026.03 | 41.96 | 43.89 | |
| GritLM / GritLM-7BMemorization turns=02026.03 | 41.81 | 42.68 | |
| PoGMemorization turns=02026.03 | 41.72 | 43.06 | |
| all-mpnet-base-v2Memorization turns=02026.03 | 41.29 | 44.14 | |
| Chain-of-Thought (CoT)Memorization turns=02026.03 | 30.62 | 33.67 | |
| Direct AnsweringMemorization turns=02026.03 | 30.18 | 31.85 |