Graph Reasoning on GraphSQA 1.0 (overall)
1RankGraphInsight
Evaluation Results
| Method | Links | |
|---|---|---|
| GraphInsightModel=Llama-3-8B-Instruct-262k, Method Category=Proposed2024.09 | 1 | |
| GraphInsightModel=Meta-Llama-3-8B-Instruct, Method Category=Proposed2024.09 | 1 | |
| GraphInsightModel=Mistral-7B-Instruct-v0.2, Method Category=Proposed2024.09 | 1 | |
| GraphInsightModel=Qwen2-7B-Instruct, Method Category=Proposed2024.09 | 1 | |
| GraphInsightModel=vicuna-7b-v1.1, Method Category=Proposed2024.09 | 1 | |
| DFSModel=Llama-3-8B-Instruct-262k, Method Category=Reordering Methods2024.09 | 2 | |
| DFSModel=Meta-Llama-3-8B-Instruct, Method Category=Reordering Methods2024.09 | 2 | |
| BAGModel=Mistral-7B-Instruct-v0.2, Method Category=Prompting Methods2024.09 | 2 | |
| SPModel=Mistral-7B-Instruct-v0.2, Method Category=Reordering Methods2024.09 | 2 | |
| ALModel=Qwen2-7B-Instruct, Method Category=Structural Methods2024.09 | 2 | |
| SPModel=vicuna-7b-v1.1, Method Category=Reordering Methods2024.09 | 2 | |
| Raw Seq.Model=Llama-3-8B-Instruct-262k, Method Category=Baseline2024.09 | 3 | |
| BFSModel=Meta-Llama-3-8B-Instruct, Method Category=Reordering Methods2024.09 | 3 | |
| BFSModel=Qwen2-7B-Instruct, Method Category=Reordering Methods2024.09 | 3 | |
| DFSModel=vicuna-7b-v1.1, Method Category=Reordering Methods2024.09 | 3 | |
| BAGModel=Llama-3-8B-Instruct-262k, Method Category=Prompting Methods2024.09 | 4 | |
| SPModel=Meta-Llama-3-8B-Instruct, Method Category=Reordering Methods2024.09 | 4 | |
| ALModel=Mistral-7B-Instruct-v0.2, Method Category=Structural Methods2024.09 | 4 | |
| COTModel=Qwen2-7B-Instruct, Method Category=Prompting Methods2024.09 | 4 | |
| BFSModel=vicuna-7b-v1.1, Method Category=Reordering Methods2024.09 | 4 | |
| BFSModel=Llama-3-8B-Instruct-262k, Method Category=Reordering Methods2024.09 | 5 | |
| SPModel=Llama-3-8B-Instruct-262k, Method Category=Reordering Methods2024.09 | 5 | |
| FSModel=Meta-Llama-3-8B-Instruct, Method Category=Prompting Methods2024.09 | 5 | |
| COTModel=Mistral-7B-Instruct-v0.2, Method Category=Prompting Methods2024.09 | 5 | |
| Raw Seq.Model=Qwen2-7B-Instruct, Method Category=Baseline2024.09 | 5 | |
| Raw Seq.Model=vicuna-7b-v1.1, Method Category=Baseline2024.09 | 5 | |
| COTModel=vicuna-7b-v1.1, Method Category=Prompting Methods2024.09 | 5 | |
| Raw Seq.Model=Meta-Llama-3-8B-Instruct, Method Category=Baseline2024.09 | 6 | |
| DFSModel=Mistral-7B-Instruct-v0.2, Method Category=Reordering Methods2024.09 | 6 | |
| SPModel=Qwen2-7B-Instruct, Method Category=Reordering Methods2024.09 | 6 | |
| FSModel=Llama-3-8B-Instruct-262k, Method Category=Prompting Methods2024.09 | 7 | |
| ALModel=Meta-Llama-3-8B-Instruct, Method Category=Structural Methods2024.09 | 7 | |
| Raw Seq.Model=Mistral-7B-Instruct-v0.2, Method Category=Baseline2024.09 | 7 | |
| BAGModel=Qwen2-7B-Instruct, Method Category=Prompting Methods2024.09 | 7 | |
| BAGModel=vicuna-7b-v1.1, Method Category=Prompting Methods2024.09 | 7 | |
| ALModel=Llama-3-8B-Instruct-262k, Method Category=Structural Methods2024.09 | 8 | |
| BAGModel=Meta-Llama-3-8B-Instruct, Method Category=Prompting Methods2024.09 | 8 | |
| BFSModel=Mistral-7B-Instruct-v0.2, Method Category=Reordering Methods2024.09 | 8 | |
| DFSModel=Qwen2-7B-Instruct, Method Category=Reordering Methods2024.09 | 8 | |
| FSModel=vicuna-7b-v1.1, Method Category=Prompting Methods2024.09 | 8 | |
| COTModel=Llama-3-8B-Instruct-262k, Method Category=Prompting Methods2024.09 | 9 | |
| COTModel=Meta-Llama-3-8B-Instruct, Method Category=Prompting Methods2024.09 | 9 | |
| FSModel=Mistral-7B-Instruct-v0.2, Method Category=Prompting Methods2024.09 | 9 | |
| FSModel=Qwen2-7B-Instruct, Method Category=Prompting Methods2024.09 | 9 | |
| ALModel=vicuna-7b-v1.1, Method Category=Structural Methods2024.09 | 9 | |
| AMModel=Llama-3-8B-Instruct-262k, Method Category=Structural Methods2024.09 | 10 | |
| AMModel=Meta-Llama-3-8B-Instruct, Method Category=Structural Methods2024.09 | 10 | |
| AMModel=Mistral-7B-Instruct-v0.2, Method Category=Structural Methods2024.09 | 10 | |
| AMModel=Qwen2-7B-Instruct, Method Category=Structural Methods2024.09 | 10 | |
| AMModel=vicuna-7b-v1.1, Method Category=Structural Methods2024.09 | 10 |