Graph Question Answering on GRBENCH E-commerce 1.0 (test)
42.4R-LGRAPH-COT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GRAPH-COTBackbone=GPT-3.5-turbo-16k2024.04 | 42.4 | 44.5 | |
| Mixtral-8x7bCategory=Graph RAG2024.04 | 32.87 | 37 | |
| Mixtral-8x7bCategory=Text RAG2024.04 | 23.14 | 29.5 | |
| GPT-3.5-turboCategory=Graph RAG2024.04 | 17.52 | 28 | |
| GPT-3.5-turboCategory=Text RAG2024.04 | 14.06 | 20 | |
| Mixtral-8x7bCategory=Base2024.04 | 12.54 | 18 | |
| LLaMA-2-13bCategory=Graph RAG2024.04 | 12.48 | 20 | |
| LLaMA-2-13b-chatCategory=Text RAG2024.04 | 9.23 | 12.5 | |
| GPT-3.5-turboCategory=Base2024.04 | 9.18 | 23.5 | |
| LLaMA-2-13b-chatCategory=Base2024.04 | 7.01 | 12 |