Graph Question Answering on GRBENCH Healthcare 1.0 (test)
22.33R-L ScoreGRAPH-COT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GRAPH-COTBackbone=GPT-3.5-turbo-16k2024.04 | 22.33 | 28.89 | |
| GPT-3.5-turboCategory=Graph RAG2024.04 | 8.69 | 14.07 | |
| Mixtral-8x7bCategory=Graph RAG2024.04 | 8.66 | 15.19 | |
| GPT-3.5-turboCategory=Base2024.04 | 5.83 | 14.44 | |
| LLaMA-2-13b-chatCategory=Base2024.04 | 5.25 | 13.7 | |
| GPT-3.5-turboCategory=Text RAG2024.04 | 4.57 | 8.52 | |
| Mixtral-8x7bCategory=Base2024.04 | 3.88 | 20 | |
| Mixtral-8x7bCategory=Text RAG2024.04 | 3.22 | 16.67 | |
| LLaMA-2-13bCategory=Graph RAG2024.04 | 2.97 | 4.81 | |
| LLaMA-2-13b-chatCategory=Text RAG2024.04 | 1.44 | 5.93 |