List your company
ResearchFormerly WizWand

Text Classification on Yahoo! Answer (test)

75.66Macro F1Prompt-based FT (soft)
57.387262.131166.87571.6189May 2, 2023
Updated 8mo ago

Evaluation results

MethodLinks
Prompt-based FT (soft)Number of labeled samples=full, Backbone=RoBERTa-Large2023.0575.66
Prompt-based FT (hard)Number of labeled samples=full, Backbone=RoBERTa-Large2023.0574.3
Prompt-based FT (hard) + PCPNumber of labeled samples=200, Backbone=RoBERTa-Large2023.0570.22
Prompt-based FT (soft) + PCPNumber of labeled samples=200, Backbone=RoBERTa-Large2023.0570.03
FIXMATCHNumber of labeled samples=200, Backbone=RoBERTa-Large2023.0568.37
ADAMATCHNumber of labeled samples=200, Backbone=RoBERTa-Large2023.0568.09
Prompt-based FT (soft)Number of labeled samples=200, Backbone=RoBERTa-Large2023.0567.85
Prompt-based FT (hard)Number of labeled samples=200, Backbone=RoBERTa-Large2023.0566.94
DASHNumber of labeled samples=200, Backbone=RoBERTa-Large2023.0566.46
FLEXMATCHNumber of labeled samples=200, Backbone=RoBERTa-Large2023.0566.43
Prompt-based FT (hard) + PCPNumber of labeled samples=40, Backbone=RoBERTa-Large2023.0565.58
Prompt-based FT (soft) + PCPNumber of labeled samples=40, Backbone=RoBERTa-Large2023.0565.26
ADAMATCHNumber of labeled samples=40, Backbone=RoBERTa-Large2023.0563.68
FIXMATCHNumber of labeled samples=40, Backbone=RoBERTa-Large2023.0561.56
Prompt-based FT (soft)Number of labeled samples=40, Backbone=RoBERTa-Large2023.0561.18
Prompt-based FT (hard)Number of labeled samples=40, Backbone=RoBERTa-Large2023.0560.63
DASHNumber of labeled samples=40, Backbone=RoBERTa-Large2023.0560.07
FLEXMATCHNumber of labeled samples=40, Backbone=RoBERTa-Large2023.0558.09