Identifying plausible explanations on δ-ATOMIC
87.6AccuracyAlways Tell Me The Odds
Evaluation results
| Method | Links | |
|---|---|---|
| Always Tell Me The OddsBackbone=Qwen2.5-14B-Instruct, Data Augmentation=+Syn, Training Strategy=+R2025.05 | 87.6 | |
| Always Tell Me The OddsBackbone=Qwen2.5-14B-Instruct, Data Augmentation=+Syn2025.05 | 81.2 | |
| Always Tell Me The OddsBackbone=Qwen2.5-14B-Instruct2025.05 | 80.1 | |
| Always Tell Me The OddsBackbone=Qwen2.5-8B-Instruct2025.05 | 78.9 | |
| Always Tell Me The OddsBackbone=Qwen2.5-7B-Instruct2025.05 | 78.6 | |
| RoBERTaplausibility annotations=with2023.05 | 78.3 | |
| LiPoRplausibility annotations=without2023.05 | 76.82 | |
| KDDC-ATOMIC (N)knowledge-augmented=true, plausibility annotations=without2023.05 | 75.9 | |
| RoBERTa-LType=Encoder2025.05 | 75 | |
| Llama-3-InstructEvaluation Protocol=Probe, Size=14B2025.05 | 74.7 | |
| KDDC-CSKG (N)knowledge-augmented=true, plausibility annotations=without2023.05 | 72.2 | |
| GPT-4oEvaluation Protocol=0-Shot2025.05 | 70.7 | |
| DeepSeek-R1-Distill-Qwen-32BEvaluation Protocol=0-Shot2025.05 | 69.1 | |
| Tuned BARTsetting=tuned, plausibility annotations=without2023.05 | 67.49 | |
| KDDC-CWWV (N)knowledge-augmented=true, plausibility annotations=without2023.05 | 62.48 | |
| ZS BARTsetting=zero-shot, plausibility annotations=without2023.05 | 59.05 | |
| ZS GPT3setting=zero-shot, plausibility annotations=without2023.05 | 50.73 | |
| ZS GPT-NEOsetting=zero-shot, plausibility annotations=without2023.05 | 47.53 |