Annotator Modeling on DTD
81.6AUROCannot-mix
Evaluation Results
| Method | Links | |
|---|---|---|
| annot-mixEvaluation Epoch=Last Epoch, False label fraction=76.82024.05 | 81.6 | |
| annot-mixEvaluation Epoch=Best Epoch, False label fraction=76.82024.05 | 81.5 | |
| madlEvaluation Epoch=Last Epoch, False label fraction=76.82024.05 | 75.4 | |
| madlEvaluation Epoch=Best Epoch, False label fraction=76.82024.05 | 74 | |
| geo-reg-wEvaluation Epoch=Last Epoch, False label fraction=76.82024.05 | 66.1 | |
| union-netEvaluation Epoch=Last Epoch, False label fraction=76.82024.05 | 65.9 | |
| geo-reg-fEvaluation Epoch=Last Epoch, False label fraction=76.82024.05 | 65.8 | |
| crowd-layerEvaluation Epoch=Last Epoch, False label fraction=76.82024.05 | 65.2 | |
| geo-reg-fEvaluation Epoch=Best Epoch, False label fraction=76.82024.05 | 64 | |
| geo-reg-wEvaluation Epoch=Best Epoch, False label fraction=76.82024.05 | 63.6 | |
| crowd-layerEvaluation Epoch=Best Epoch, False label fraction=76.82024.05 | 62.6 | |
| union-netEvaluation Epoch=Best Epoch, False label fraction=76.82024.05 | 61.6 | |
| conalEvaluation Epoch=Best Epoch, False label fraction=76.82024.05 | 58.5 | |
| conalEvaluation Epoch=Last Epoch, False label fraction=76.82024.05 | 58 | |
| trace-regEvaluation Epoch=Best Epoch, False label fraction=76.82024.05 | 57.9 | |
| crowd-arEvaluation Epoch=Last Epoch, False label fraction=76.82024.05 | 56.9 | |
| crowd-arEvaluation Epoch=Best Epoch, False label fraction=76.82024.05 | 56 | |
| trace-regEvaluation Epoch=Last Epoch, False label fraction=76.82024.05 | 55.4 |