Zero-shot Triplet Extraction on Wiki ZSL (test)
21.49AccuracyZETT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ZETTSetting=Single-triplet, m=52022.12 | 21.49 | — | |
| ZETTSetting=Single-triplet, m=102022.12 | 17.27 | — | |
| RelationPromptSetting=Single-triplet, m=52022.12 | 16.74 | — | |
| Seq2SeqSetting=Single-triplet, m=52022.12 | 14.73 | — | |
| TableSequenceSetting=Single-triplet, m=52022.12 | 14.47 | — | |
| ZETTSetting=Single-triplet, m=152022.12 | 12.78 | — | |
| RelationPromptSetting=Single-triplet, m=102022.12 | 12.13 | — | |
| RelationPromptSetting=Single-triplet, m=152022.12 | 10.47 | — | |
| Seq2SeqSetting=Single-triplet, m=102022.12 | 9.94 | — | |
| TableSequenceSetting=Single-triplet, m=102022.12 | 9.61 | — | |
| TableSequenceSetting=Single-triplet, m=152022.12 | 9.2 | — | |
| ZS-BERT+spanNERSetting=Single-triplet, m=52022.12 | 8.16 | — | |
| ZS-BERT+spanNERSetting=Single-triplet, m=102022.12 | 8.05 | — | |
| Seq2SeqSetting=Single-triplet, m=152022.12 | 7.05 | — | |
| ZS-BERT+spanNERSetting=Single-triplet, m=152022.12 | 6.47 | — | |
| RelationPromptSetting=Multi-triplet, m=52022.12 | — | 33.28 | |
| RelationPromptSetting=Multi-triplet, m=102022.12 | — | 24.04 | |
| RelationPromptSetting=Multi-triplet, m=152022.12 | — | 18.73 | |
| Seq2SeqSetting=Multi-triplet, m=52022.12 | — | 30.71 | |
| Seq2SeqSetting=Multi-triplet, m=102022.12 | — | 19.7 | |
| Seq2SeqSetting=Multi-triplet, m=152022.12 | — | 11.52 | |
| TableSequenceSetting=Multi-triplet, m=52022.12 | — | 6.29 | |
| TableSequenceSetting=Multi-triplet, m=102022.12 | — | 6.4 | |
| TableSequenceSetting=Multi-triplet, m=152022.12 | — | 6.39 | |
| ZETTSetting=Multi-triplet, m=52022.12 | — | 31.17 | |
| ZETTSetting=Multi-triplet, m=102022.12 | — | 24.87 | |
| ZETTSetting=Multi-triplet, m=152022.12 | — | 21.21 | |
| ZS-BERT+spanNERSetting=Multi-triplet, m=52022.12 | — | 15.96 | |
| ZS-BERT+spanNERSetting=Multi-triplet, m=102022.12 | — | 11.98 | |
| ZS-BERT+spanNERSetting=Multi-triplet, m=152022.12 | — | 11.9 |