List your company
ResearchFormerly WizWand

Graph Understanding on GraphSQA Micro-level Tasks 1.0 (test)

94.01ScoreGraphInsight
-0.57823.978548.53573.0915Sep 5, 2024
Updated 8mo ago

Evaluation results

MethodLinks
GraphInsightModel=Llama-3-8B-262k, Method Category=Proposed2024.0994.01
GraphInsightModel=Qwen2-7B, Method Category=Proposed2024.0983.87
Raw Seq.Model=Llama-3-8B-262k, Method Category=Baseline2024.0977.86
DFSModel=Llama-3-8B-262k, Method Category=Reordering Methods2024.0977.57
BFSModel=Llama-3-8B-262k, Method Category=Reordering Methods2024.0977.52
SPModel=Llama-3-8B-262k, Method Category=Reordering Methods2024.0977.5
GraphInsightModel=Llama-3-8B, Method Category=Proposed2024.0976.05
GraphInsightModel=Mistral-7B, Method Category=Proposed2024.0974.25
ALModel=Llama-3-8B-262k, Method Category=Structural Methods2024.0974.22
BAGModel=Llama-3-8B-262k, Method Category=Prompting Methods2024.0969.28
FSModel=Llama-3-8B-262k, Method Category=Prompting Methods2024.0965.59
AMModel=Llama-3-8B-262k, Method Category=Structural Methods2024.0959.82
COTModel=Mistral-7B, Method Category=Prompting Methods2024.0959.35
ALModel=Qwen2-7B, Method Category=Structural Methods2024.0958.28
COTModel=Qwen2-7B, Method Category=Prompting Methods2024.0958.13
BAGModel=Mistral-7B, Method Category=Prompting Methods2024.0957.05
DFSModel=Mistral-7B, Method Category=Reordering Methods2024.0956.55
SPModel=Mistral-7B, Method Category=Reordering Methods2024.0956.51
BFSModel=Mistral-7B, Method Category=Reordering Methods2024.0956.5
Raw Seq.Model=Qwen2-7B, Method Category=Baseline2024.0956.37
Raw Seq.Model=Mistral-7B, Method Category=Baseline2024.0956.35
ALModel=Mistral-7B, Method Category=Structural Methods2024.0955.19
FSModel=Qwen2-7B, Method Category=Prompting Methods2024.0954.21
BAGModel=Qwen2-7B, Method Category=Prompting Methods2024.0951.96
COTModel=Llama-3-8B-262k, Method Category=Prompting Methods2024.0949.85
BFSModel=Qwen2-7B, Method Category=Reordering Methods2024.0949.84
DFSModel=Qwen2-7B, Method Category=Reordering Methods2024.0949.01
SPModel=Qwen2-7B, Method Category=Reordering Methods2024.0948.76
DFSModel=Llama-3-8B, Method Category=Reordering Methods2024.0947.26
COTModel=Llama-3-8B, Method Category=Prompting Methods2024.0947.02
BFSModel=Llama-3-8B, Method Category=Reordering Methods2024.0946.58
SPModel=Llama-3-8B, Method Category=Reordering Methods2024.0946.56
Raw Seq.Model=Llama-3-8B, Method Category=Baseline2024.0945.97
BAGModel=Llama-3-8B, Method Category=Prompting Methods2024.0945.45
FSModel=Llama-3-8B, Method Category=Prompting Methods2024.0944.68
GraphInsightModel=Vicuna-7B, Method Category=Proposed2024.0943.46
FSModel=Mistral-7B, Method Category=Prompting Methods2024.0941.92
ALModel=Llama-3-8B, Method Category=Structural Methods2024.0938.69
GraphTokenModel=Llama-3-8B, Method Category=Baseline2024.0931.61
GraphTokenModel=Qwen2-7B, Method Category=Baseline2024.0929.6
AMModel=Qwen2-7B, Method Category=Structural Methods2024.0922.62
GraphTokenModel=Mistral-7B, Method Category=Baseline2024.0922.08
GraphTokenModel=Vicuna-7B, Method Category=Baseline2024.0920.16
AMModel=Mistral-7B, Method Category=Structural Methods2024.0919.94
GraphTokenModel=Llama-3-8B-262k, Method Category=Baseline2024.0917.7
AMModel=Llama-3-8B, Method Category=Structural Methods2024.0915.81
DFSModel=Vicuna-7B, Method Category=Reordering Methods2024.0912.89
SPModel=Vicuna-7B, Method Category=Reordering Methods2024.0912.85
BFSModel=Vicuna-7B, Method Category=Reordering Methods2024.0912.82
Raw Seq.Model=Vicuna-7B, Method Category=Baseline2024.0912.76
FSModel=Vicuna-7B, Method Category=Prompting Methods2024.0911.44
COTModel=Vicuna-7B, Method Category=Prompting Methods2024.0911.37
BAGModel=Vicuna-7B, Method Category=Prompting Methods2024.0911.11
ALModel=Vicuna-7B, Method Category=Structural Methods2024.0910.46
AMModel=Vicuna-7B, Method Category=Structural Methods2024.093.06