Entailment Tree Generation on EntailmentBank Task 1 (No Distractors)
100Leaves F1METGEN
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| METGENBackbone=T5-large2024.01 | 100 | 100 | 57.9 | 42.1 | 71.3 | 39.2 | 37 | |
| RLETBackbone=DeBERTa-large2024.01 | 100 | 100 | 54.6 | 40.7 | 66.9 | 36.3 | 34.8 | |
| SEERBackbone=T5-large2024.01 | 100 | 100 | 67.6 | 52.6 | 70.3 | 42.6 | 40.6 | |
| EntailmentWriterBackbone=T5-large2024.01 | 98.7 | 84.1 | 50 | 38.5 | 67.6 | 35.9 | 34.4 | |
| NLProofSBackbone=T5-large2024.01 | 97.8 | 90.1 | 55.6 | 42.3 | 72.4 | 40.6 | 38.9 | |
| IRGRBackbone=T5-large2024.01 | 97.6 | 89.4 | 50.2 | 36.8 | 62.1 | 31.8 | 32.4 |