Relation Extraction on RE Zero-Shot
95.3AccuracyODA
Evaluation results
| Method | Links | |
|---|---|---|
| ODAKnowledge Usage=With Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-42024.04 | 95.3 | |
| TOGKnowledge Usage=With Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-42024.04 | 88.3 | |
| TOG-RKnowledge Usage=With Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-42024.04 | 86.9 | |
| Direct answering (GPT4)Knowledge Usage=Without Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-42024.04 | 55.5 | |
| Self-Consistency (GPT3.5)Knowledge Usage=Without Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-3.52024.04 | 45.4 | |
| RAGKnowledge Usage=With Knowledge, Evaluation Protocol=Fine-tuned2024.04 | 44.74 | |
| Direct answering (GPT3.5)Knowledge Usage=Without Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-3.52024.04 | 37.14 | |
| COT (GPT3.5)Knowledge Usage=Without Knowledge, Evaluation Protocol=Zero-Shot, Backbone LLM=GPT-3.52024.04 | 28.8 |