Knowledge Base Question Answering on GrailQA i.i.d. (dev)
93.8F1GAPD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GAPDLLM=Llama-3.1-8B, Method Category=Fine-tune-based Methods2026.05 | 93.8 | 92.8 | |
| DecAFLLM=T5-large, Method Category=Fine-tune-based Methods2026.05 | 92.4 | 88.7 | |
| KBQA-R1LLM=Llama-3.1-8B, Method Category=Fine-tune-based Methods2026.05 | 91.5 | 90 | |
| TIARALLM=T5-large, Method Category=Fine-tune-based Methods2026.05 | 91.2 | 88.4 | |
| RnG-KBQALLM=T5-large, Method Category=Fine-tune-based Methods2026.05 | 89 | 86.7 | |
| KBQA-o1LLM=Llama-3.1-8B, Method Category=Fine-tune-based Methods2026.05 | 85.5 | 77.8 | |
| KnowCoder-A1LLM=Qwen2.5-Coder-7B, Method Category=Fine-tune-based Methods2026.05 | 81.1 | — | |
| KBQA-R1 HarnessLLM=Kimi-K2.5, Method Category=Prompting Methods2026.05 | 70.1 | 64 | |
| KBQA-R1 HarnessLLM=Claude 4.6 Sonnet, Method Category=Prompting Methods2026.05 | 68.6 | 62 | |
| KBQA-R1 HarnessLLM=gpt-5.3-codex, Method Category=Prompting Methods2026.05 | 64.3 | 55.6 | |
| KBQA-R1 HarnessLLM=GLM-5, Method Category=Prompting Methods2026.05 | 62.1 | 46 | |
| ARG-KBQALLM=GPT-3.5-turbo, Method Category=Prompting Methods2026.05 | 51.5 | 46.6 | |
| KB-CoderLLM=GPT-3.5-turbo, Method Category=Prompting Methods2026.05 | 45.5 | 40.6 | |
| KB-BINDERLLM=Codex-davinci-002, Method Category=Prompting Methods2026.05 | 43.3 | 40 |