Text Classification on WRENCH (test)
87.93TRECSAMA
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| SAMAOperations=Data reweighting and label correction (+R & C)2023.10 | 87.93 | 88.83 | 85.71 | 77.78 | 89.79 | 93.77 | |
| SAMAOperations=Data reweighting (+R)2023.10 | 85.73 | 89.67 | 84.31 | 76.89 | 89.05 | 93.64 | |
| SAMA-NAOperations=Data reweighting and label correction (+R & C)2023.10 | 79 | 87.67 | 80.44 | 64.05 | 87.05 | 80.73 | |
| COSINEAlgorithm=Self-training2023.10 | 76.56 | 86.8 | 82.98 | 58.47 | 87.03 | 89.22 | |
| SAMA-NAOperations=Data reweighting (+R)2023.10 | 74.33 | 87.11 | 81.92 | 60.88 | 86.83 | 80.96 | |
| Finetune (ours)Algorithm=Finetuning, Implementation=Current Paper's Baseline2023.10 | 67.93 | 79.28 | 78.16 | 57.35 | 85.79 | 84.32 | |
| Finetune (orig)Algorithm=Finetuning, Implementation=Original2023.10 | 66.56 | 83.93 | 79.73 | 56.09 | 86.27 | 82.26 |