Zero-shot Triplet Extraction on FewRel (test)
30.71AccuracyZETT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ZETTSetting=Single-triplet, m=52022.12 | 30.71 | — | |
| ZETTSetting=Single-triplet, m=102022.12 | 27.9 | — | |
| ZETTSetting=Single-triplet, m=152022.12 | 26.17 | — | |
| RelationPromptSetting=Single-triplet, m=52022.12 | 24.36 | — | |
| Seq2SeqSetting=Single-triplet, m=52022.12 | 22.02 | — | |
| RelationPromptSetting=Single-triplet, m=102022.12 | 21.45 | — | |
| RelationPromptSetting=Single-triplet, m=152022.12 | 20.24 | — | |
| Seq2SeqSetting=Single-triplet, m=102022.12 | 16.71 | — | |
| TableSequenceSetting=Single-triplet, m=102022.12 | 12.54 | — | |
| Seq2SeqSetting=Single-triplet, m=152022.12 | 11.91 | — | |
| TableSequenceSetting=Single-triplet, m=52022.12 | 11.82 | — | |
| TableSequenceSetting=Single-triplet, m=152022.12 | 11.65 | — | |
| ZS-BERT+spanNERSetting=Single-triplet, m=152022.12 | 7.68 | — | |
| ZS-BERT+spanNERSetting=Single-triplet, m=52022.12 | 7.22 | — | |
| ZS-BERT+spanNERSetting=Single-triplet, m=102022.12 | 6.68 | — | |
| RelationPromptSetting=Multi-triplet, m=52022.12 | — | 30.85 | |
| RelationPromptSetting=Multi-triplet, m=102022.12 | — | 24.45 | |
| RelationPromptSetting=Multi-triplet, m=152022.12 | — | 23.65 | |
| Seq2SeqSetting=Multi-triplet, m=52022.12 | — | 26.02 | |
| Seq2SeqSetting=Multi-triplet, m=102022.12 | — | 17.12 | |
| Seq2SeqSetting=Multi-triplet, m=152022.12 | — | 13.02 | |
| TableSequenceSetting=Multi-triplet, m=52022.12 | — | 3.4 | |
| TableSequenceSetting=Multi-triplet, m=102022.12 | — | 6.37 | |
| TableSequenceSetting=Multi-triplet, m=152022.12 | — | 3.48 | |
| ZETTSetting=Multi-triplet, m=52022.12 | — | 33.71 | |
| ZETTSetting=Multi-triplet, m=102022.12 | — | 31.28 | |
| ZETTSetting=Multi-triplet, m=152022.12 | — | 24.39 | |
| ZS-BERT+spanNERSetting=Multi-triplet, m=52022.12 | — | 15.1 | |
| ZS-BERT+spanNERSetting=Multi-triplet, m=102022.12 | — | 12.14 | |
| ZS-BERT+spanNERSetting=Multi-triplet, m=152022.12 | — | 14.78 |