Knowledge Base Question Answering on DISCOS KB (val)
79Accuracy (Functions)CosmicRoBERTa
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| CosmicRoBERTaModel architecture=Domain-specific retrained encoder2023.05 | 79 | 93 | 97 | 93 | 92 | 48 | |
| GPT-4Prompting=Few-shot until context limit reached2023.05 | 79 | 86 | 87 | 82 | 84 | 50 | |
| ChatGPT-3.5Prompting=Few-shot until context limit reached2023.05 | 51.6 | 41 | 32 | 61 | 72 | 25 |