List your company
ResearchFormerly WizWand

Graph Understanding on GraphSQA Macro-level Tasks 1.0 (test)

69.28ScoreGraphInsight
1.482419.083736.68554.2863Sep 5, 2024
Updated 8mo ago

Evaluation results

MethodLinks
GraphInsightModel=Llama-3-8B-262k, Method Category=Proposed2024.0969.28
GraphInsightModel=Qwen2-7B, Method Category=Proposed2024.0965.87
BAGModel=Qwen2-7B, Method Category=Prompting Methods2024.0964.47
DFSModel=Llama-3-8B-262k, Method Category=Reordering Methods2024.0962.21
Raw Seq.Model=Llama-3-8B-262k, Method Category=Baseline2024.0962.18
BFSModel=Llama-3-8B-262k, Method Category=Reordering Methods2024.0961.89
SPModel=Llama-3-8B-262k, Method Category=Reordering Methods2024.0961.83
BFSModel=Qwen2-7B, Method Category=Reordering Methods2024.0960.17
SPModel=Qwen2-7B, Method Category=Reordering Methods2024.0959.58
DFSModel=Qwen2-7B, Method Category=Reordering Methods2024.0959.13
GraphInsightModel=Mistral-7B, Method Category=Proposed2024.0958.46
COTModel=Llama-3-8B-262k, Method Category=Prompting Methods2024.0957.51
Raw Seq.Model=Qwen2-7B, Method Category=Baseline2024.0956.44
FSModel=Mistral-7B, Method Category=Prompting Methods2024.0954.39
COTModel=Qwen2-7B, Method Category=Prompting Methods2024.0954.23
GraphInsightModel=Llama-3-8B, Method Category=Proposed2024.0954.22
FSModel=Qwen2-7B, Method Category=Prompting Methods2024.0953.66
ALModel=Llama-3-8B-262k, Method Category=Structural Methods2024.0952.92
ALModel=Qwen2-7B, Method Category=Structural Methods2024.0952.23
Raw Seq.Model=Mistral-7B, Method Category=Baseline2024.0952.22
SPModel=Mistral-7B, Method Category=Reordering Methods2024.0952.22
BFSModel=Mistral-7B, Method Category=Reordering Methods2024.0952.12
DFSModel=Mistral-7B, Method Category=Reordering Methods2024.0952.05
BAGModel=Llama-3-8B-262k, Method Category=Prompting Methods2024.0951.15
ALModel=Mistral-7B, Method Category=Structural Methods2024.0950.01
FSModel=Llama-3-8B-262k, Method Category=Prompting Methods2024.0946.52
GraphTokenModel=Qwen2-7B, Method Category=Baseline2024.0944.93
SPModel=Llama-3-8B, Method Category=Reordering Methods2024.0944.04
BFSModel=Llama-3-8B, Method Category=Reordering Methods2024.0943.81
Raw Seq.Model=Llama-3-8B, Method Category=Baseline2024.0943.79
DFSModel=Llama-3-8B, Method Category=Reordering Methods2024.0943.76
ALModel=Llama-3-8B, Method Category=Structural Methods2024.0943.36
COTModel=Mistral-7B, Method Category=Prompting Methods2024.0943.23
BAGModel=Mistral-7B, Method Category=Prompting Methods2024.0942.49
GraphTokenModel=Llama-3-8B-262k, Method Category=Baseline2024.0941.98
COTModel=Llama-3-8B, Method Category=Prompting Methods2024.0941.87
BAGModel=Llama-3-8B, Method Category=Prompting Methods2024.0940.6
GraphTokenModel=Llama-3-8B, Method Category=Baseline2024.0939.89
FSModel=Llama-3-8B, Method Category=Prompting Methods2024.0937.02
AMModel=Llama-3-8B-262k, Method Category=Structural Methods2024.0935.29
GraphTokenModel=Mistral-7B, Method Category=Baseline2024.0933.42
GraphInsightModel=Vicuna-7B, Method Category=Proposed2024.0922.96
AMModel=Qwen2-7B, Method Category=Structural Methods2024.0919.15
AMModel=Mistral-7B, Method Category=Structural Methods2024.0918.08
GraphTokenModel=Vicuna-7B, Method Category=Baseline2024.0915.75
Raw Seq.Model=Vicuna-7B, Method Category=Baseline2024.0912.67
BFSModel=Vicuna-7B, Method Category=Reordering Methods2024.0912.66
SPModel=Vicuna-7B, Method Category=Reordering Methods2024.0912.63
DFSModel=Vicuna-7B, Method Category=Reordering Methods2024.0912.59
AMModel=Llama-3-8B, Method Category=Structural Methods2024.0911.98
COTModel=Vicuna-7B, Method Category=Prompting Methods2024.0911.64
BAGModel=Vicuna-7B, Method Category=Prompting Methods2024.099.95
FSModel=Vicuna-7B, Method Category=Prompting Methods2024.098.77
ALModel=Vicuna-7B, Method Category=Structural Methods2024.095.67
AMModel=Vicuna-7B, Method Category=Structural Methods2024.094.09