List your company
ResearchFormerly WizWand

Few-shot Relation Classification on FewRel 2.0

0.6741Accuracy (5-way 1-shot)BERT
0.3902840.4639670.537650.611333Nov 13, 2019
Updated 8mo ago

Evaluation results

MethodLinks
BERTFramework=PAIR, Backbone=BERT, Model Size=BASE2019.110.67410.78570.54890.6685
KEPLER-WikiFramework=PAIR, Backbone=KEPLER, Model Size=BASE2019.110.67230.82090.54320.7101
RoBERTaFramework=PAIR, Backbone=RoBERTa, Model Size=BASE2019.110.66780.81840.53990.7085
KEPLER-WikiFramework=Proto, Backbone=KEPLER, Model Size=BASE2019.110.66410.84020.51850.736
KnowBert-BERTFramework=PAIR, Backbone=BERT, Model Size=BASE2019.110.66050.77880.50860.6719
RoBERTaFramework=Proto, Backbone=RoBERTa, Model Size=BASE2019.110.64650.82760.5080.7184
KnowBert-BERTFramework=Proto, Backbone=BERT, Model Size=BASE2019.110.6440.79870.51660.6971
Our RoBERTaFramework=PAIR, Backbone=RoBERTa, Model Size=BASE2019.110.63220.77660.49280.6597
Our RoBERTaFramework=Proto, Backbone=RoBERTa, Model Size=BASE2019.110.61980.83110.48560.7219
ERNIE-RoBERTaFramework=PAIR, Backbone=RoBERTa, Model Size=BASE2019.110.59290.72910.48510.6026
ERNIE-BERTFramework=PAIR, Backbone=BERT, Model Size=BASE2019.110.56180.68970.4340.5435
KnowBert-RoBERTaFramework=Proto, Backbone=RoBERTa, Model Size=BASE2019.110.55680.71820.4190.5855
ERNIE-RoBERTaFramework=Proto, Backbone=RoBERTa, Model Size=BASE2019.110.54430.80480.37970.6626
MTBFramework=Proto, Backbone=MTB, Model Size=BASE2019.110.52130.76670.48280.6975
KnowBert-RoBERTaFramework=PAIR, Backbone=RoBERTa, Model Size=BASE2019.110.50680.66040.3710.5113
ERNIE-BERTFramework=Proto, Backbone=BERT, Model Size=BASE2019.110.4940.65550.34990.4968
MTBFramework=PAIR, Backbone=MTB, Model Size=BASE2019.110.46180.7050.36920.5517
BERTFramework=Proto, Backbone=BERT, Model Size=BASE2019.110.40120.5150.26450.3693