Annotator Modeling on AG News
93.1AUROCunion-net
Evaluation Results
| Method | Links | |
|---|---|---|
| union-netEvaluation Epoch=Best Epoch, False label fraction=56.82024.05 | 93.1 | |
| crowd-layerEvaluation Epoch=Last Epoch, False label fraction=56.82024.05 | 93 | |
| union-netEvaluation Epoch=Last Epoch, False label fraction=56.82024.05 | 93 | |
| crowd-layerEvaluation Epoch=Best Epoch, False label fraction=56.82024.05 | 93 | |
| annot-mixEvaluation Epoch=Last Epoch, False label fraction=56.82024.05 | 92.7 | |
| annot-mixEvaluation Epoch=Best Epoch, False label fraction=56.82024.05 | 92.7 | |
| trace-regEvaluation Epoch=Best Epoch, False label fraction=56.82024.05 | 92.4 | |
| geo-reg-fEvaluation Epoch=Best Epoch, False label fraction=56.82024.05 | 92.4 | |
| geo-reg-fEvaluation Epoch=Last Epoch, False label fraction=56.82024.05 | 92.2 | |
| trace-regEvaluation Epoch=Last Epoch, False label fraction=56.82024.05 | 92.1 | |
| geo-reg-wEvaluation Epoch=Best Epoch, False label fraction=56.82024.05 | 89.7 | |
| geo-reg-wEvaluation Epoch=Last Epoch, False label fraction=56.82024.05 | 89.4 | |
| madlEvaluation Epoch=Best Epoch, False label fraction=56.82024.05 | 89.2 | |
| madlEvaluation Epoch=Last Epoch, False label fraction=56.82024.05 | 88.1 | |
| crowd-arEvaluation Epoch=Last Epoch, False label fraction=56.82024.05 | 63.4 | |
| crowd-arEvaluation Epoch=Best Epoch, False label fraction=56.82024.05 | 63.1 | |
| conalEvaluation Epoch=Last Epoch, False label fraction=56.82024.05 | 61.7 | |
| conalEvaluation Epoch=Best Epoch, False label fraction=56.82024.05 | 61.3 |