Graph Question Answering on GRBENCH Academic 1.0 (test)
31.89R-LGRAPH-COT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GRAPH-COTBackbone=GPT-3.5-turbo-16k2024.04 | 31.89 | 33.48 | |
| Mixtral-8x7bCategory=Graph RAG, Retriever=Mpnet-v2, Backbone=Mixtral-8x7b2024.04 | 27.77 | 31.2 | |
| LLaMA-2-13bCategory=Graph RAG, Retriever=Mpnet-v2, Backbone=LLaMA-2-13b2024.04 | 22.01 | 22.97 | |
| GPT-3.5-turboCategory=Graph RAG, Retriever=Mpnet-v2, Backbone=GPT-3.5-turbo2024.04 | 18.45 | 26.98 | |
| Mixtral-8x7bCategory=Base, Backbone=Mixtral-8x7b2024.04 | 9.02 | 8.14 | |
| LLaMA-2-13b-chatCategory=Text RAG, Retriever=Mpnet-v2, Backbone=LLaMA-2-13b-chat2024.04 | 8.69 | 8.52 | |
| Mixtral-8x7bCategory=Text RAG, Retriever=Mpnet-v2, Backbone=Mixtral-8x7b2024.04 | 8.44 | 8.02 | |
| LLaMA-2-13b-chatCategory=Base, Backbone=LLaMA-2-13b-chat2024.04 | 8.13 | 8.03 | |
| GPT-3.5-turboCategory=Base, Backbone=GPT-3.5-turbo2024.04 | 6.05 | 12.8 | |
| GPT-3.5-turboCategory=Text RAG, Retriever=Mpnet-v2, Backbone=GPT-3.5-turbo2024.04 | 5.83 | 9.91 |