Entailment Tree Generation on EntailmentBank Task 2 (Distractors)
90.3Leaves F1NLProofS
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| NLProofSBackbone=T5-large2024.01 | 90.3 | 58.8 | 47.2 | 34.4 | 70.2 | 37.8 | 33.3 | |
| SEERBackbone=T5-large2024.01 | 86.4 | 53.5 | 56.8 | 39.7 | 66.3 | 38.3 | 34.7 | |
| METGENBackbone=T5-large2024.01 | 83.7 | 48.6 | 41.7 | 30.4 | 62.7 | 32.7 | 28 | |
| EntailmentWriterBackbone=T5-large2024.01 | 83.2 | 35 | 39.5 | 24.7 | 62.2 | 28.2 | 23.2 | |
| RLETBackbone=DeBERTa-large2024.01 | 81 | 39 | 38.5 | 28.4 | 56.3 | 28.6 | 25.7 | |
| IRGRBackbone=T5-large2024.01 | 69.9 | 23.8 | 30.5 | 22.3 | 47.7 | 26.5 | 21.8 |