Question Answering on ExplaGraphs
87.05AccuracyG-Retriever w/ LoRA
Evaluation results
| Method | Links | |
|---|---|---|
| G-Retriever w/ LoRASetting=Tuned LLM2024.02 | 87.05 | |
| LoRASetting=Tuned LLM2024.02 | 85.38 | |
| G-RetrieverSetting=Frozen LLM w/ PT2024.02 | 85.16 | |
| GraphTokenSetting=Frozen LLM w/ PT2024.02 | 85.08 | |
| KAPINGSetting=Inference-only2024.02 | 62.27 | |
| COT-BAGSetting=Inference-only2024.02 | 57.94 | |
| Prompt tuningSetting=Frozen LLM w/ PT2024.02 | 57.63 | |
| Zero-CoTSetting=Inference-only2024.02 | 57.04 | |
| Zero-shotSetting=Inference-only2024.02 | 56.5 |