Relation Classification on FewRel (test)
0.9015PrecisionRelationPrompt
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| RelationPromptUnseen Labels (m)=5, Zero-shot=true2022.03 | 0.9015 | 0.885 | 0.893 | — | — | — | |
| RelationPromptUnseen Labels (m)=10, Zero-shot=true2022.03 | 0.8033 | 0.7962 | 0.7996 | — | — | — | |
| ZS-BERTUnseen Labels (m)=5, Zero-shot=true2022.03 | 0.7696 | 0.7886 | 0.779 | — | — | — | |
| RelationPromptUnseen Labels (m)=15, Zero-shot=true2022.03 | 0.7433 | 0.7251 | 0.734 | — | — | — | |
| NoGenUnseen Labels (m)=5, Zero-shot=true2022.03 | 0.7236 | 0.5861 | 0.6457 | — | — | — | |
| NoGenUnseen Labels (m)=15, Zero-shot=true2022.03 | 0.6649 | 0.4005 | 0.4938 | — | — | — | |
| NoGenUnseen Labels (m)=10, Zero-shot=true2022.03 | 0.6647 | 0.4828 | 0.5561 | — | — | — | |
| CIMUnseen Labels (m)=5, Zero-shot=true2022.03 | 0.5805 | 0.6192 | 0.5992 | — | — | — | |
| ZS-BERTUnseen Labels (m)=10, Zero-shot=true2022.03 | 0.5692 | 0.5759 | 0.5725 | — | — | — | |
| CIMUnseen Labels (m)=10, Zero-shot=true2022.03 | 0.4739 | 0.4911 | 0.4823 | — | — | — | |
| R-BERTUnseen Labels (m)=5, Zero-shot=true2022.03 | 0.4219 | 0.4861 | 0.4517 | — | — | — | |
| ZS-BERTUnseen Labels (m)=15, Zero-shot=true2022.03 | 0.3554 | 0.3819 | 0.3682 | — | — | — | |
| CIMUnseen Labels (m)=15, Zero-shot=true2022.03 | 0.3183 | 0.3306 | 0.3243 | — | — | — | |
| UDEBODescription enhancement strategy=Ensemble (Description variations), Zero-shot=true2024.06 | 0.2838 | 0.2568 | — | 0.2568 | 0.2212 | 0.2568 | |
| ZS-BERTDescription enhancement strategy=Paraphrased, Zero-shot=true2024.06 | 0.2589 | 0.2176 | — | 0.2176 | 0.199 | 0.2176 | |
| R-BERTUnseen Labels (m)=10, Zero-shot=true2022.03 | 0.2552 | 0.3302 | 0.282 | — | — | — | |
| ZS-BERTDescription enhancement strategy=None (Baseline), Zero-shot=true2024.06 | 0.2508 | 0.2159 | — | 0.2159 | 0.1789 | 0.2159 | |
| ZS-BERTDescription enhancement strategy=Summarization, Zero-shot=true2024.06 | 0.1983 | 0.1981 | — | 0.1981 | 0.1521 | 0.1981 | |
| ZS-BERTDescription enhancement strategy=Finetuned, Zero-shot=true2024.06 | 0.1939 | 0.1609 | — | 0.1609 | 0.1459 | 0.1609 | |
| ZS-BERTDescription enhancement strategy=Pre-trained, Zero-shot=true2024.06 | 0.1825 | 0.2529 | — | 0.2529 | 0.191 | 0.2529 | |
| ZS-BERTDescription enhancement strategy=Combined, Zero-shot=true2024.06 | 0.1709 | 0.1653 | — | 0.1653 | 0.1653 | 0.1653 | |
| R-BERTUnseen Labels (m)=15, Zero-shot=true2022.03 | 0.1695 | 0.1937 | 0.1808 | — | — | — |