Graph Question Answering Suite (ExplaGraphs, SceneGraphs, WebQSP)
90.07Expla Graphs ScoreOurs
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| OursEvaluation Protocol=Frozen LLM w/ PT, # of Prompt Tokens=82025.01 | 90.07 | 84.5 | 72.17 | 82.25 | |
| G-RetrieverEvaluation Protocol=Frozen LLM w/ PT, # of Prompt Tokens=12025.01 | 85.16 | 81.31 | 70.49 | 78.99 | |
| Graph TokenEvaluation Protocol=Frozen LLM w/ PT, # of Prompt Tokens=12025.01 | 85.08 | 49.03 | 57.05 | 63.72 | |
| KAPINGEvaluation Protocol=Inference Only, # of Prompt Tokens=-2025.01 | 62.27 | 43.75 | 52.64 | 52.89 | |
| CoT-BAGEvaluation Protocol=Inference Only, # of Prompt Tokens=-2025.01 | 57.94 | 56.8 | 39.6 | 51.45 | |
| Prompt TuningEvaluation Protocol=Frozen LLM w/ PT, # of Prompt Tokens=102025.01 | 57.63 | 63.41 | 48.34 | 56.46 | |
| Zero-CoTEvaluation Protocol=Inference Only, # of Prompt Tokens=-2025.01 | 57.04 | 52.6 | 51.3 | 53.65 | |
| Zero-ShotEvaluation Protocol=Inference Only, # of Prompt Tokens=-2025.01 | 56.5 | 39.74 | 41.06 | 45.77 |