Question Answering on QALD en 10
66.67AccuracyODA
Evaluation results
| Method | Links | |
|---|---|---|
| ODAKnowledge Usage=With Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-42024.04 | 66.67 | |
| Direct answering (GPT4)Knowledge Usage=Without Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-42024.04 | 57.1 | |
| TOG-RKnowledge Usage=With Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-42024.04 | 54.7 | |
| TOGKnowledge Usage=With Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-42024.04 | 53.8 | |
| SPARQL-QAKnowledge Usage=With Knowledge, Evaluation Protocol=Fine-tuned2024.04 | 45.4 | |
| Self-Consistency (GPT3.5)Knowledge Usage=Without Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-3.52024.04 | 45.3 | |
| Direct answering (GPT3.5)Knowledge Usage=Without Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-3.52024.04 | 44.74 | |
| COT (GPT3.5)Knowledge Usage=Without Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-3.52024.04 | 42.9 |