List your company
ResearchFormerly WizWand

Annotator Modeling on trec6

95.5AUROCcrowd-layer
54.73265.31675.986.484May 6, 2024
Updated 4mo ago

Evaluation results

MethodLinks
crowd-layerEvaluation Epoch=Last Epoch, False label fraction=36.92024.0595.5
crowd-layerEvaluation Epoch=Best Epoch, False label fraction=36.92024.0595.4
union-netEvaluation Epoch=Last Epoch, False label fraction=36.92024.0594.7
madlEvaluation Epoch=Last Epoch, False label fraction=36.92024.0594.6
union-netEvaluation Epoch=Best Epoch, False label fraction=36.92024.0594.6
madlEvaluation Epoch=Best Epoch, False label fraction=36.92024.0594.5
annot-mixEvaluation Epoch=Last Epoch, False label fraction=36.92024.0594.2
annot-mixEvaluation Epoch=Best Epoch, False label fraction=36.92024.0594
geo-reg-fEvaluation Epoch=Last Epoch, False label fraction=36.92024.0593.9
trace-regEvaluation Epoch=Last Epoch, False label fraction=36.92024.0593.8
geo-reg-wEvaluation Epoch=Last Epoch, False label fraction=36.92024.0593.8
geo-reg-fEvaluation Epoch=Best Epoch, False label fraction=36.92024.0593.8
trace-regEvaluation Epoch=Best Epoch, False label fraction=36.92024.0593.7
geo-reg-wEvaluation Epoch=Best Epoch, False label fraction=36.92024.0593.7
conalEvaluation Epoch=Best Epoch, False label fraction=36.92024.0556.5
conalEvaluation Epoch=Last Epoch, False label fraction=36.92024.0556.3
crowd-arEvaluation Epoch=Last Epoch, False label fraction=36.92024.0556.3
crowd-arEvaluation Epoch=Best Epoch, False label fraction=36.92024.0556.3