Graph Question Answering on GRBENCH Legal 1.0 (test)
30.52R-L ScoreGRAPH-COT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GRAPH-COTBackbone=GPT-3.5-turbo-16k2024.04 | 30.52 | 28.33 | |
| Mixtral-8x7bCategory=Graph RAG2024.04 | 23.48 | 25.56 | |
| Mixtral-8x7bCategory=Text RAG2024.04 | 19.69 | 25 | |
| GPT-3.5-turboCategory=Graph RAG2024.04 | 18.66 | 22.22 | |
| GPT-3.5-turboCategory=Text RAG2024.04 | 18.14 | 23.89 | |
| LLaMA-2-13bCategory=Graph RAG2024.04 | 17.98 | 17.22 | |
| LLaMA-2-13b-chatCategory=Base2024.04 | 15.97 | 16.11 | |
| LLaMA-2-13b-chatCategory=Text RAG2024.04 | 15.37 | 16.67 | |
| Mixtral-8x7bCategory=Base2024.04 | 12.74 | 16.11 | |
| GPT-3.5-turboCategory=Base2024.04 | 10.51 | 20 |