Text Classification on Trec Merge Imbalance, with Label Noise (pool)
62.43Balanced AccuracyPriorAL
Evaluation results
| Method | Links | |
|---|---|---|
| PriorALAnnotation Cost=20%2026.05 | 62.43 | |
| CORESETAnnotation Cost=20%2026.05 | 62.1 | |
| BADGEAnnotation Cost=20%2026.05 | 61.73 | |
| ConfidenceAnnotation Cost=20%2026.05 | 61.57 | |
| MarginAnnotation Cost=20%2026.05 | 61.5 | |
| GALAXYAnnotation Cost=20%2026.05 | 59.52 | |
| RandomAnnotation Cost=20%2026.05 | 59.09 | |
| Most LikelyAnnotation Cost=20%2026.05 | 58.62 | |
| DIRECTAnnotation Cost=20%2026.05 | 54.55 | |
| MarginAnnotation Cost=10%2026.05 | 54.35 | |
| ConfidenceAnnotation Cost=10%2026.05 | 54.3 | |
| BADGEAnnotation Cost=10%2026.05 | 54.1 | |
| CORESETAnnotation Cost=10%2026.05 | 54.09 | |
| PriorALAnnotation Cost=10%2026.05 | 53.96 | |
| BASEAnnotation Cost=20%2026.05 | 53.4 | |
| GALAXYAnnotation Cost=10%2026.05 | 52.1 | |
| RandomAnnotation Cost=10%2026.05 | 50.66 | |
| Most LikelyAnnotation Cost=10%2026.05 | 49.05 | |
| BASEAnnotation Cost=10%2026.05 | 47.49 | |
| DIRECTAnnotation Cost=10%2026.05 | 47.3 | |
| Pretrained PriorsAnnotation Cost=10%2026.05 | 34.38 | |
| Pretrained PriorsAnnotation Cost=20%2026.05 | 34.38 |