Script Reasoning on Script Reasoning
64.61AccuracyClarET
Evaluation results
| Method | Links | |
|---|---|---|
| ClarETModel Type=Unified Model2022.03 | 64.61 | |
| ROBERTa + Kown. ModelModel Type=Discriminative Model2022.03 | 63.62 | |
| EventBERTModel Type=Discriminative Model2022.03 | 63.5 | |
| ROBERTa-largeModel Type=Discriminative Model2022.03 | 61.53 | |
| BART-largeModel Type=Unified Model2022.03 | 61.34 | |
| ROBERTa + Rep. FusionModel Type=Discriminative Model2022.03 | 58.66 | |
| ROBERTa-baseModel Type=Discriminative Model2022.03 | 56.23 | |
| SGNN + Int&SentiModel Type=Discriminative Model2022.03 | 56.03 | |
| SGNNModel Type=Discriminative Model2022.03 | 52.45 | |
| PairLSTMModel Type=Discriminative Model2022.03 | 50.83 | |
| Event-CompModel Type=Discriminative Model2022.03 | 49.57 | |
| ClarETEvaluation Mode=Zero-shot2022.03 | 32.15 | |
| EventBERTEvaluation Mode=Zero-shot2022.03 | 30.79 | |
| BART-largeEvaluation Mode=Zero-shot2022.03 | 21.72 | |
| DeBERTa-xlargeEvaluation Mode=Zero-shot2022.03 | 20.31 | |
| RoBERTa-largeEvaluation Mode=Zero-shot2022.03 | 20.09 | |
| RandomEvaluation Mode=Zero-shot2022.03 | 20 | |
| RandomModel Type=Discriminative Model2022.03 | 20 |