Knowledge Base Question Answering on WebQSP v1 (test)
79.6F1 ScorePangu
Evaluation Results
| Method | Links | |
|---|---|---|
| PanguBackbone=T5-3B2022.12 | 79.6 | |
| PanguBackbone=T5-large2022.12 | 78.9 | |
| DecAF2022.12 | 78.8 | |
| PanguBackbone=BERT-base2022.12 | 77.9 | |
| PanguBackbone=T5-base2022.12 | 77.3 | |
| TIARA2022.12 | 76.7 | |
| Program TransferOracle entity linking=true2022.12 | 76.5 | |
| Uni-Parser2022.12 | 75.8 | |
| RnG-KBQA2022.12 | 75.6 | |
| ArcaneQA2022.12 | 75.6 | |
| QGG2022.12 | 74 | |
| CBR2022.12 | 72.8 | |
| ReTraCk2022.12 | 71 | |
| PanguBackbone=Codex, Few-shot setting=1000-shot2022.12 | 68.3 | |
| PanguBackbone=Codex, Few-shot setting=100-shot2022.12 | 54.5 | |
| PanguBackbone=Codex, Few-shot setting=10-shot2022.12 | 45.9 |