Macro-level Graph Reasoning on GraphSQA Macro 1.0
1RankGraphInsight
Evaluation Results
| Method | Links | |
|---|---|---|
| GraphInsightModel=Llama-3-8B-Instruct-262k2024.09 | 1 | |
| SPModel=Meta-Llama-3-8B-Instruct2024.09 | 1 | |
| SPModel=Mistral-7B-Instruct-v0.22024.09 | 1 | |
| GraphInsightModel=Mistral-7B-Instruct-v0.22024.09 | 1 | |
| BFSModel=Qwen2-7B-Instruct2024.09 | 1 | |
| GraphInsightModel=Qwen2-7B-Instruct2024.09 | 1 | |
| GraphInsightModel=vicuna-7b-v1.12024.09 | 1 | |
| DFSModel=Llama-3-8B-Instruct-262k2024.09 | 2 | |
| BFSModel=Meta-Llama-3-8B-Instruct2024.09 | 2 | |
| FSModel=Mistral-7B-Instruct-v0.22024.09 | 2 | |
| Raw Seq.Model=vicuna-7b-v1.12024.09 | 2 | |
| Raw Seq.Model=Llama-3-8B-Instruct-262k2024.09 | 3 | |
| DFSModel=Meta-Llama-3-8B-Instruct2024.09 | 3 | |
| ALModel=Mistral-7B-Instruct-v0.22024.09 | 3 | |
| SPModel=Qwen2-7B-Instruct2024.09 | 3 | |
| COTModel=vicuna-7b-v1.12024.09 | 3 | |
| FSModel=Llama-3-8B-Instruct-262k2024.09 | 4 | |
| GraphInsightModel=Meta-Llama-3-8B-Instruct2024.09 | 4 | |
| DFSModel=Mistral-7B-Instruct-v0.22024.09 | 4 | |
| ALModel=Qwen2-7B-Instruct2024.09 | 4 | |
| DFSModel=vicuna-7b-v1.12024.09 | 4 | |
| BFSModel=Llama-3-8B-Instruct-262k2024.09 | 5 | |
| Raw Seq.Model=Meta-Llama-3-8B-Instruct2024.09 | 5 | |
| Raw Seq.Model=Mistral-7B-Instruct-v0.22024.09 | 5 | |
| DFSModel=Qwen2-7B-Instruct2024.09 | 5 | |
| BFSModel=vicuna-7b-v1.12024.09 | 5 | |
| SPModel=Llama-3-8B-Instruct-262k2024.09 | 6 | |
| FSModel=Meta-Llama-3-8B-Instruct2024.09 | 6 | |
| BAGModel=Mistral-7B-Instruct-v0.22024.09 | 6 | |
| BAGModel=Qwen2-7B-Instruct2024.09 | 6 | |
| SPModel=vicuna-7b-v1.12024.09 | 6 | |
| COTModel=Llama-3-8B-Instruct-262k2024.09 | 7 | |
| ALModel=Meta-Llama-3-8B-Instruct2024.09 | 7 | |
| BFSModel=Mistral-7B-Instruct-v0.22024.09 | 7 | |
| Raw Seq.Model=Qwen2-7B-Instruct2024.09 | 7 | |
| BAGModel=vicuna-7b-v1.12024.09 | 7 | |
| BAGModel=Llama-3-8B-Instruct-262k2024.09 | 8 | |
| COTModel=Meta-Llama-3-8B-Instruct2024.09 | 8 | |
| COTModel=Qwen2-7B-Instruct2024.09 | 8 | |
| FSModel=vicuna-7b-v1.12024.09 | 8 | |
| ALModel=Llama-3-8B-Instruct-262k2024.09 | 9 | |
| BAGModel=Meta-Llama-3-8B-Instruct2024.09 | 9 | |
| COTModel=Mistral-7B-Instruct-v0.22024.09 | 9 | |
| FSModel=Qwen2-7B-Instruct2024.09 | 9 | |
| ALModel=vicuna-7b-v1.12024.09 | 9 | |
| AMModel=Llama-3-8B-Instruct-262k2024.09 | 10 | |
| AMModel=Meta-Llama-3-8B-Instruct2024.09 | 10 | |
| AMModel=Mistral-7B-Instruct-v0.22024.09 | 10 | |
| AMModel=Qwen2-7B-Instruct2024.09 | 10 | |
| AMModel=vicuna-7b-v1.12024.09 | 10 |