Claim improvement suggestion on Subset of 135,828 claims
62AccuracyFT-DeBERTa
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| FT-DeBERTaContext=Main thesis2023.05 | 62 | 57.3 | 65.2 | 63.1 | 43.4 | |
| FT-DeBERTaContext=Parent claim2023.05 | 60.3 | 56 | 63.6 | 61.2 | 43 | |
| FT-DeBERTaContext=None2023.05 | 59.9 | 55.4 | 63.7 | 60.2 | 42.5 | |
| FT-ELECTRAContext=Main thesis2023.05 | 57.5 | 52 | 63.4 | 54.4 | 38.3 | |
| FT-ELECTRAContext=Parent claim2023.05 | 56.2 | 50.3 | 62 | 53.6 | 35.3 | |
| FT-ELECTRAContext=None2023.05 | 56 | 49 | 62.4 | 52.4 | 34.5 | |
| Random baseline2023.05 | 33.4 | 31.4 | 38.5 | 33.4 | 45.3 |