Relation Type Prediction on CMV Modes (50-50 split)
87Support PrecisionsMLM-LF-prompt
Evaluation Results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sMLM-LF-promptStrategy=Prompting, Backbone=Longformer2022.03 | 87 | 92 | 89 | 53 | 47 | 49 | 30 | 28 | 28 | 45 | 58 | 50 | 35 | 9 | 14 | 69 | |
| DA-LF-promptStrategy=Prompting, Backbone=Longformer2022.03 | 85 | 89 | 87 | 47 | 47 | 44 | 32 | 20 | 24 | 39 | 55 | 44 | 32 | 13 | 16 | 66 | |
| Base-LF-promptStrategy=Prompting, Backbone=Longformer2022.03 | 78 | 87 | 82 | 49 | 44 | 46 | 30 | 19 | 22 | 32 | 40 | 35 | 32 | 13 | 18 | 62 | |
| Base-LF-mpStrategy=Mean Pooling, Backbone=Longformer2022.03 | 73 | 86 | 79 | 36 | 21 | 26 | 25 | 18 | 21 | 23 | 28 | 25 | 43 | 18 | 25 | 56 | |
| ROBERTaBackbone=RoBERTa2022.03 | 72 | 83 | 77 | 47 | 25 | 31 | 22 | 21 | 21 | 13 | 16 | 14 | 17 | 8 | 10 | 55 | |
| QR-BertBackbone=BERT2022.03 | 72 | 84 | 77 | 47 | 28 | 34 | 19 | 13 | 14 | 13 | 18 | 15 | 22 | 7 | 9 | 54 | |
| sMLM-LF-mpStrategy=Mean Pooling, Backbone=Longformer2022.03 | 70 | 90 | 79 | 42.6 | 22 | 28 | 28 | 20 | 22 | 32 | 26 | 28 | 38 | 18 | 24 | 56 |