Relation Classification on Wiki ZSL (test)
71.54Precision (%)ZS-BERT
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ZS-BERTUnseen Labels (m)=5, Zero-shot=true2022.03 | 71.54 | 72.39 | 71.96 | — | — | — | |
| RelationPromptUnseen Labels (m)=5, Zero-shot=true2022.03 | 70.66 | 83.75 | 76.63 | — | — | — | |
| RelationPromptUnseen Labels (m)=10, Zero-shot=true2022.03 | 68.51 | 74.76 | 71.5 | — | — | — | |
| RelationPromptUnseen Labels (m)=15, Zero-shot=true2022.03 | 63.69 | 67.93 | 65.74 | — | — | — | |
| ZS-BERTUnseen Labels (m)=10, Zero-shot=true2022.03 | 60.51 | 60.98 | 60.74 | — | — | — | |
| NoGenUnseen Labels (m)=10, Zero-shot=true2022.03 | 54.87 | 36.52 | 43.8 | — | — | — | |
| NoGenUnseen Labels (m)=15, Zero-shot=true2022.03 | 54.45 | 29.43 | 37.45 | — | — | — | |
| NoGenUnseen Labels (m)=5, Zero-shot=true2022.03 | 51.78 | 46.76 | 48.93 | — | — | — | |
| CIMUnseen Labels (m)=5, Zero-shot=true2022.03 | 49.63 | 48.81 | 49.22 | — | — | — | |
| CIMUnseen Labels (m)=10, Zero-shot=true2022.03 | 46.54 | 47.9 | 45.57 | — | — | — | |
| R-BERTUnseen Labels (m)=5, Zero-shot=true2022.03 | 39.22 | 43.27 | 41.15 | — | — | — | |
| UDEBODescription enhancement strategy=Ensemble (Description variations), Zero-shot=true2024.06 | 34.79 | 37.11 | — | 40.17 | 34.25 | 40.17 | |
| ZS-BERTDescription enhancement strategy=None (Baseline), Zero-shot=true2024.06 | 34.18 | 33.9 | — | 37.14 | 30.97 | 37.14 | |
| ZS-BERTUnseen Labels (m)=15, Zero-shot=true2022.03 | 34.12 | 34.38 | 34.25 | — | — | — | |
| CIMUnseen Labels (m)=15, Zero-shot=true2022.03 | 29.17 | 30.58 | 29.86 | — | — | — | |
| R-BERTUnseen Labels (m)=10, Zero-shot=true2022.03 | 26.18 | 29.69 | 27.82 | — | — | — | |
| ZS-BERTDescription enhancement strategy=Paraphrased, Zero-shot=true2024.06 | 25.5 | 27.6 | — | 27.6 | 24.56 | 27.6 | |
| ZS-BERTDescription enhancement strategy=Summarization, Zero-shot=true2024.06 | 19.07 | 19.57 | — | 19.62 | 16.87 | 19.62 | |
| ZS-BERTDescription enhancement strategy=Combined, Zero-shot=true2024.06 | 17.34 | 19.62 | — | 18.43 | 16.27 | 18.43 | |
| R-BERTUnseen Labels (m)=15, Zero-shot=true2022.03 | 17.31 | 18.82 | 18.03 | — | — | — | |
| ZS-BERTDescription enhancement strategy=Finetuned, Zero-shot=true2024.06 | 16.23 | 16.26 | — | 16.62 | 13.65 | 16.62 | |
| ZS-BERTDescription enhancement strategy=Pre-trained, Zero-shot=true2024.06 | 14.73 | 15.8 | — | 14.29 | 11.72 | 14.29 |