Graph Question Answering on GRBENCH Literature 1.0 (test)
41.59R-L ScoreGRAPH-COT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GRAPH-COTBackbone=GPT-3.5-turbo-16k2024.04 | 41.59 | 46.25 | |
| Mixtral-8x7bCategory=Graph RAG2024.04 | 20.08 | 33.33 | |
| GPT-3.5-turboCategory=Graph RAG2024.04 | 14.94 | 24.17 | |
| Mixtral-8x7bCategory=Text RAG2024.04 | 13.35 | 27.92 | |
| GPT-3.5-turboCategory=Base2024.04 | 10.43 | 26.67 | |
| GPT-3.5-turboCategory=Text RAG2024.04 | 10.04 | 20.83 | |
| LLaMA-2-13bCategory=Graph RAG2024.04 | 9.25 | 20 | |
| LLaMA-2-13b-chatCategory=Text RAG2024.04 | 7.61 | 20 | |
| Mixtral-8x7bCategory=Base2024.04 | 7.5 | 22.5 | |
| LLaMA-2-13b-chatCategory=Base2024.04 | 5.32 | 20.83 |