List your company
ResearchFormerly WizWand

Text Classification on Amazon Review (test)

63.85Macro F1 ScorePrompt-based FT (hard)
43.299648.634853.9759.3052May 2, 2023
Updated 8mo ago

Evaluation results

MethodLinks
Prompt-based FT (hard)Number of labeled samples=full, Backbone=RoBERTa-Large2023.0563.85
Prompt-based FT (soft)Number of labeled samples=full, Backbone=RoBERTa-Large2023.0563.32
Prompt-based FT (hard) + PCPNumber of labeled samples=200, Backbone=RoBERTa-Large2023.0559.64
Prompt-based FT (soft) + PCPNumber of labeled samples=200, Backbone=RoBERTa-Large2023.0559.16
Prompt-based FT (hard)Number of labeled samples=200, Backbone=RoBERTa-Large2023.0557.01
Prompt-based FT (soft)Number of labeled samples=200, Backbone=RoBERTa-Large2023.0555.03
FLEXMATCHNumber of labeled samples=200, Backbone=RoBERTa-Large2023.0554.19
DASHNumber of labeled samples=200, Backbone=RoBERTa-Large2023.0553.95
Prompt-based FT (hard) + PCPNumber of labeled samples=40, Backbone=RoBERTa-Large2023.0553.44
ADAMATCHNumber of labeled samples=200, Backbone=RoBERTa-Large2023.0553.05
Prompt-based FT (soft) + PCPNumber of labeled samples=40, Backbone=RoBERTa-Large2023.0552.78
FIXMATCHNumber of labeled samples=200, Backbone=RoBERTa-Large2023.0552.33
FLEXMATCHNumber of labeled samples=40, Backbone=RoBERTa-Large2023.0545.48
ADAMATCHNumber of labeled samples=40, Backbone=RoBERTa-Large2023.0544.66
Prompt-based FT (soft)Number of labeled samples=40, Backbone=RoBERTa-Large2023.0544.52
Prompt-based FT (hard)Number of labeled samples=40, Backbone=RoBERTa-Large2023.0544.34
FIXMATCHNumber of labeled samples=40, Backbone=RoBERTa-Large2023.0544.26
DASHNumber of labeled samples=40, Backbone=RoBERTa-Large2023.0544.09