Fact Verification on Creak
0.956AccuracyTOG
Evaluation results
| Method | Links | |
|---|---|---|
| TOGKnowledge Usage=With Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-42024.04 | 0.956 | |
| TOG-RKnowledge Usage=With Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-42024.04 | 0.954 | |
| ODAKnowledge Usage=With Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-42024.04 | 0.9519 | |
| Direct answering (GPT4)Knowledge Usage=Without Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-42024.04 | 0.9452 | |
| Self-Consistency (GPT3.5)Knowledge Usage=Without Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-3.52024.04 | 0.908 | |
| COT (GPT3.5)Knowledge Usage=Without Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-3.52024.04 | 0.901 | |
| Direct answering (GPT3.5)Knowledge Usage=Without Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-3.52024.04 | 0.9 | |
| RACoKnowledge Usage=With Knowledge, Evaluation Protocol=Fine-tuned2024.04 | 0.882 |