Knowledge Base Question Answering on SimpleQuestions Wiki (test)
79.6F1SPARKLE
Evaluation Results
| Method | Links | |
|---|---|---|
| SPARKLEDecoding constraints=Full, Gold entity mentions=false2024.06 | 79.6 | |
| SPARKLE w/o pruningDecoding constraints=No pruning, Gold entity mentions=false2024.06 | 78.7 | |
| GETT-QAGold entity mentions=false2024.06 | 76.1 | |
| SPARKLE w/o constraintsDecoding constraints=None, Gold entity mentions=false2024.06 | 65.5 | |
| STaG-QAGold entity mentions=false2024.06 | 61.2 | |
| SYGMAGold entity mentions=false2024.06 | 44 | |
| Falcon 2.0Gold entity mentions=false2024.06 | 36.3 |