List your company
ResearchFormerly WizWand

Graph Understanding on GraphSQA Overall 1.0 (test)

82.85ScoreGraphInsight
0.27421.71243.1564.588Sep 5, 2024
Updated 8mo ago

Evaluation results

MethodLinks
GraphInsightModel=Llama-3-8B-262k, Method Category=Proposed2024.0982.85
GraphInsightModel=Qwen2-7B, Method Category=Proposed2024.0976.95
Raw Seq.Model=Llama-3-8B-262k, Method Category=Baseline2024.0971.83
DFSModel=Llama-3-8B-262k, Method Category=Reordering Methods2024.0971.66
BFSModel=Llama-3-8B-262k, Method Category=Reordering Methods2024.0971.5
SPModel=Llama-3-8B-262k, Method Category=Reordering Methods2024.0971.47
GraphInsightModel=Mistral-7B, Method Category=Proposed2024.0968.11
GraphInsightModel=Llama-3-8B, Method Category=Proposed2024.0967.65
ALModel=Llama-3-8B-262k, Method Category=Structural Methods2024.0966.03
BAGModel=Llama-3-8B-262k, Method Category=Prompting Methods2024.0962.31
FSModel=Llama-3-8B-262k, Method Category=Prompting Methods2024.0958.25
BAGModel=Qwen2-7B, Method Category=Prompting Methods2024.0956.77
COTModel=Qwen2-7B, Method Category=Prompting Methods2024.0956.63
Raw Seq.Model=Qwen2-7B, Method Category=Baseline2024.0956.4
ALModel=Qwen2-7B, Method Category=Structural Methods2024.0955.95
SPModel=Mistral-7B, Method Category=Reordering Methods2024.0954.86
DFSModel=Mistral-7B, Method Category=Reordering Methods2024.0954.82
BFSModel=Mistral-7B, Method Category=Reordering Methods2024.0954.81
Raw Seq.Model=Mistral-7B, Method Category=Baseline2024.0954.76
FSModel=Qwen2-7B, Method Category=Prompting Methods2024.0954
BFSModel=Qwen2-7B, Method Category=Reordering Methods2024.0953.81
ALModel=Mistral-7B, Method Category=Structural Methods2024.0953.2
COTModel=Mistral-7B, Method Category=Prompting Methods2024.0953.15
SPModel=Qwen2-7B, Method Category=Reordering Methods2024.0952.92
DFSModel=Qwen2-7B, Method Category=Reordering Methods2024.0952.9
COTModel=Llama-3-8B-262k, Method Category=Prompting Methods2024.0952.79
BAGModel=Mistral-7B, Method Category=Prompting Methods2024.0951.45
AMModel=Llama-3-8B-262k, Method Category=Structural Methods2024.0950.38
FSModel=Mistral-7B, Method Category=Prompting Methods2024.0946.71
DFSModel=Llama-3-8B, Method Category=Reordering Methods2024.0945.91
SPModel=Llama-3-8B, Method Category=Reordering Methods2024.0945.59
BFSModel=Llama-3-8B, Method Category=Reordering Methods2024.0945.51
Raw Seq.Model=Llama-3-8B, Method Category=Baseline2024.0945.13
COTModel=Llama-3-8B, Method Category=Prompting Methods2024.0945.04
BAGModel=Llama-3-8B, Method Category=Prompting Methods2024.0943.58
FSModel=Llama-3-8B, Method Category=Prompting Methods2024.0941.73
ALModel=Llama-3-8B, Method Category=Structural Methods2024.0940.48
GraphInsightModel=Vicuna-7B, Method Category=Proposed2024.0935.57
GraphTokenModel=Qwen2-7B, Method Category=Baseline2024.0935.5
GraphTokenModel=Llama-3-8B, Method Category=Baseline2024.0934.8
GraphTokenModel=Llama-3-8B-262k, Method Category=Baseline2024.0927.03
GraphTokenModel=Mistral-7B, Method Category=Baseline2024.0926.44
AMModel=Qwen2-7B, Method Category=Structural Methods2024.0921.29
AMModel=Mistral-7B, Method Category=Structural Methods2024.0919.22
GraphTokenModel=Vicuna-7B, Method Category=Baseline2024.0917.94
AMModel=Llama-3-8B, Method Category=Structural Methods2024.0914.34
DFSModel=Vicuna-7B, Method Category=Reordering Methods2024.0912.77
SPModel=Vicuna-7B, Method Category=Reordering Methods2024.0912.77
BFSModel=Vicuna-7B, Method Category=Reordering Methods2024.0912.76
Raw Seq.Model=Vicuna-7B, Method Category=Baseline2024.0912.73
COTModel=Vicuna-7B, Method Category=Prompting Methods2024.0911.47
BAGModel=Vicuna-7B, Method Category=Prompting Methods2024.0910.66
FSModel=Vicuna-7B, Method Category=Prompting Methods2024.0910.41
ALModel=Vicuna-7B, Method Category=Structural Methods2024.098.62
AMModel=Vicuna-7B, Method Category=Structural Methods2024.093.45