List your company
ResearchFormerly WizWand

Macro-level Graph Reasoning on GraphSQA Macro 1.0

1RankGraphInsight
0.643.075.57.93Sep 5, 2024
Updated 8mo ago

Evaluation results

MethodLinks
GraphInsightModel=Llama-3-8B-Instruct-262k2024.091
SPModel=Meta-Llama-3-8B-Instruct2024.091
SPModel=Mistral-7B-Instruct-v0.22024.091
GraphInsightModel=Mistral-7B-Instruct-v0.22024.091
BFSModel=Qwen2-7B-Instruct2024.091
GraphInsightModel=Qwen2-7B-Instruct2024.091
GraphInsightModel=vicuna-7b-v1.12024.091
DFSModel=Llama-3-8B-Instruct-262k2024.092
BFSModel=Meta-Llama-3-8B-Instruct2024.092
FSModel=Mistral-7B-Instruct-v0.22024.092
Raw Seq.Model=vicuna-7b-v1.12024.092
Raw Seq.Model=Llama-3-8B-Instruct-262k2024.093
DFSModel=Meta-Llama-3-8B-Instruct2024.093
ALModel=Mistral-7B-Instruct-v0.22024.093
SPModel=Qwen2-7B-Instruct2024.093
COTModel=vicuna-7b-v1.12024.093
FSModel=Llama-3-8B-Instruct-262k2024.094
GraphInsightModel=Meta-Llama-3-8B-Instruct2024.094
DFSModel=Mistral-7B-Instruct-v0.22024.094
ALModel=Qwen2-7B-Instruct2024.094
DFSModel=vicuna-7b-v1.12024.094
BFSModel=Llama-3-8B-Instruct-262k2024.095
Raw Seq.Model=Meta-Llama-3-8B-Instruct2024.095
Raw Seq.Model=Mistral-7B-Instruct-v0.22024.095
DFSModel=Qwen2-7B-Instruct2024.095
BFSModel=vicuna-7b-v1.12024.095
SPModel=Llama-3-8B-Instruct-262k2024.096
FSModel=Meta-Llama-3-8B-Instruct2024.096
BAGModel=Mistral-7B-Instruct-v0.22024.096
BAGModel=Qwen2-7B-Instruct2024.096
SPModel=vicuna-7b-v1.12024.096
COTModel=Llama-3-8B-Instruct-262k2024.097
ALModel=Meta-Llama-3-8B-Instruct2024.097
BFSModel=Mistral-7B-Instruct-v0.22024.097
Raw Seq.Model=Qwen2-7B-Instruct2024.097
BAGModel=vicuna-7b-v1.12024.097
BAGModel=Llama-3-8B-Instruct-262k2024.098
COTModel=Meta-Llama-3-8B-Instruct2024.098
COTModel=Qwen2-7B-Instruct2024.098
FSModel=vicuna-7b-v1.12024.098
ALModel=Llama-3-8B-Instruct-262k2024.099
BAGModel=Meta-Llama-3-8B-Instruct2024.099
COTModel=Mistral-7B-Instruct-v0.22024.099
FSModel=Qwen2-7B-Instruct2024.099
ALModel=vicuna-7b-v1.12024.099
AMModel=Llama-3-8B-Instruct-262k2024.0910
AMModel=Meta-Llama-3-8B-Instruct2024.0910
AMModel=Mistral-7B-Instruct-v0.22024.0910
AMModel=Qwen2-7B-Instruct2024.0910
AMModel=vicuna-7b-v1.12024.0910