Annotator Modeling on trec6
95.5AUROCcrowd-layer
Evaluation Results
| Method | Links | |
|---|---|---|
| crowd-layerEvaluation Epoch=Last Epoch, False label fraction=36.92024.05 | 95.5 | |
| crowd-layerEvaluation Epoch=Best Epoch, False label fraction=36.92024.05 | 95.4 | |
| union-netEvaluation Epoch=Last Epoch, False label fraction=36.92024.05 | 94.7 | |
| madlEvaluation Epoch=Last Epoch, False label fraction=36.92024.05 | 94.6 | |
| union-netEvaluation Epoch=Best Epoch, False label fraction=36.92024.05 | 94.6 | |
| madlEvaluation Epoch=Best Epoch, False label fraction=36.92024.05 | 94.5 | |
| annot-mixEvaluation Epoch=Last Epoch, False label fraction=36.92024.05 | 94.2 | |
| annot-mixEvaluation Epoch=Best Epoch, False label fraction=36.92024.05 | 94 | |
| geo-reg-fEvaluation Epoch=Last Epoch, False label fraction=36.92024.05 | 93.9 | |
| trace-regEvaluation Epoch=Last Epoch, False label fraction=36.92024.05 | 93.8 | |
| geo-reg-wEvaluation Epoch=Last Epoch, False label fraction=36.92024.05 | 93.8 | |
| geo-reg-fEvaluation Epoch=Best Epoch, False label fraction=36.92024.05 | 93.8 | |
| trace-regEvaluation Epoch=Best Epoch, False label fraction=36.92024.05 | 93.7 | |
| geo-reg-wEvaluation Epoch=Best Epoch, False label fraction=36.92024.05 | 93.7 | |
| conalEvaluation Epoch=Best Epoch, False label fraction=36.92024.05 | 56.5 | |
| conalEvaluation Epoch=Last Epoch, False label fraction=36.92024.05 | 56.3 | |
| crowd-arEvaluation Epoch=Last Epoch, False label fraction=36.92024.05 | 56.3 | |
| crowd-arEvaluation Epoch=Best Epoch, False label fraction=36.92024.05 | 56.3 |