Knowledge Base Question Answering on SPICE (test)
89.61m-F1 (Logical Reasoning)LLM_GT
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| LLM_GTLearning Setting=Unsupervised2025.12 | 89.61 | 21.01 | 5.87 | 85.73 | 92.69 | 61.24 | 91.89 | 58.33 | 5.06 | 65.65 | |
| SEALLearning Setting=Unsupervised2025.12 | 73.08 | 64.45 | 41.06 | 71.53 | 78.49 | 70.03 | 85.97 | 70.12 | 22.02 | 66.83 | |
| DCG_GLLearning Setting=Supervised2025.12 | 54.21 | 89.67 | 79.86 | 82.53 | 85.12 | 77.57 | 73.19 | 62.72 | 63.9 | 74.72 | |
| KB-BinderLearning Setting=Unsupervised2025.12 | 46.85 | 15.41 | 12.17 | 41.07 | 40.71 | 39.48 | 64.03 | 39 | 7.44 | 36.66 | |
| BertSP_GLLearning Setting=Supervised2025.12 | 24.08 | 73.23 | 71.44 | 72.19 | 68.87 | 60.33 | 39.45 | 50.24 | 47.52 | 57.33 |