Claim Verification on DIALFACT (test)
69.2AccuracyAug-WoW
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Aug-WoWEvidence Setting=Oracle-Evidence2021.10 | 69.2 | 69 | |
| ColloquialEvidence Setting=Oracle-Evidence2021.10 | 63.5 | 62.8 | |
| CorefBert-ColloquialEvidence Setting=Oracle-Evidence2021.10 | 61.4 | 60 | |
| VitaminCEvidence Setting=Oracle-Evidence2021.10 | 57.6 | 56.1 | |
| Aug-WoWEvidence Setting=Wiki-Evidence2021.10 | 51.6 | 51.3 | |
| Aug-WoWEvidence Setting=DPR-Evidence2021.10 | 51.5 | 50.2 | |
| ColloquialEvidence Setting=DPR-Evidence2021.10 | 48.7 | 46.4 | |
| ColloquialEvidence Setting=Wiki-Evidence2021.10 | 48.1 | 46.3 | |
| CorefBert-ColloquialEvidence Setting=Wiki-Evidence2021.10 | 47.6 | 45.2 | |
| CorefBert-ColloquialEvidence Setting=DPR-Evidence2021.10 | 46.4 | 41.1 | |
| VitaminCEvidence Setting=Wiki-Evidence2021.10 | 46.2 | 44.7 | |
| VitaminCEvidence Setting=DPR-Evidence2021.10 | 45.9 | 44.2 | |
| DNLIEvidence Setting=Oracle-Evidence2021.10 | 43.3 | 35.4 | |
| DNLIEvidence Setting=Wiki-Evidence2021.10 | 39.1 | 31.5 | |
| DNLIEvidence Setting=DPR-Evidence2021.10 | 38.4 | 29.5 | |
| DECODEEvidence Setting=Oracle-Evidence2021.10 | 37.8 | 30.3 | |
| DECODEEvidence Setting=Wiki-Evidence2021.10 | 35.3 | 25.3 | |
| DECODEEvidence Setting=DPR-Evidence2021.10 | 34.5 | 22.5 |