Question Answering on SceneGraphs
86.83AccuracyG-Retriever w/ LoRA
Evaluation results
| Method | Links | |
|---|---|---|
| G-Retriever w/ LoRASetting=Tuned LLM2024.02 | 86.83 | |
| G-RetrieverSetting=Frozen LLM w/ PT2024.02 | 81.31 | |
| LoRASetting=Tuned LLM2024.02 | 78.62 | |
| Prompt tuningSetting=Frozen LLM w/ PT2024.02 | 63.41 | |
| COT-BAGSetting=Inference-only2024.02 | 56.8 | |
| Zero-CoTSetting=Inference-only2024.02 | 52.6 | |
| GraphTokenSetting=Frozen LLM w/ PT2024.02 | 49.03 | |
| KAPINGSetting=Inference-only2024.02 | 43.75 | |
| Zero-shotSetting=Inference-only2024.02 | 39.74 |