Knowledge Base Question Answering on GrailQA (Hits@1, F1)
80.4Hits@1STAR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| STARSetting=Lightweight Retriever, RT=1.12026.04 | 80.4 | 76.3 | |
| Graph CoTSetting=LLM-centric Retriever, RT=168.42026.04 | 78.3 | 73.1 | |
| RoGSetting=LLM-centric Retriever, RT=2.32026.04 | 73.1 | 63.8 | |
| RD-PSetting=Lightweight Retriever, RT=1.12026.04 | 71.3 | 67.9 | |
| ToGSetting=LLM-centric Retriever, RT=622026.04 | 69.8 | 60.4 | |
| DALKSetting=Lightweight Retriever, RT=49.52026.04 | 56.7 | 49.1 | |
| GRAGSetting=Lightweight Retriever, RT=7.52026.04 | 49.5 | 53.2 | |
| G-RetrieverSetting=Lightweight Retriever, RT=7.72026.04 | 48.5 | 49.8 | |
| DeepSeek-R1-70BSetting=LLM without KG, RT=17.82026.04 | 41.9 | 34.2 | |
| Llama3.3-70BSetting=LLM without KG, RT=4.02026.04 | 26.3 | 20.3 | |
| Qwen2.5-72BSetting=LLM without KG, RT=4.52026.04 | 24.3 | 18.3 |