Classification on Traffic Domain (test)
84.28Macro F1Active Learning + Explanation
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Active Learning + ExplanationAL Rounds=0, Num. Manual Labels=863, Accum. Manual Labels=863, No. Pseudo Labels=637, Training Samples=1500, Annotation Saved (%)=42.472026.05 | 84.28 | 90.4 | |
| Active Learning + ExplanationAL Rounds=3, Num. Manual Labels=38, Accum. Manual Labels=1054, No. Pseudo Labels=2946, Training Samples=4000, Annotation Saved (%)=73.652026.05 | 84.16 | 89.2 | |
| Active Learning + ExplanationAL Rounds=2, Num. Manual Labels=27, Accum. Manual Labels=1016, No. Pseudo Labels=1984, Training Samples=3000, Annotation Saved (%)=66.132026.05 | 84.01 | 89 | |
| Fine-tunedAL Rounds=-, Num. Manual Labels=4035, Accum. Manual Labels=4035, No. Pseudo Labels=0, Training Samples=4035, Annotation Saved (%)=02026.05 | 83.68 | 89.6 | |
| Active Learning + ExplanationAL Rounds=1, Num. Manual Labels=126, Accum. Manual Labels=989, No. Pseudo Labels=1011, Training Samples=2000, Annotation Saved (%)=50.552026.05 | 82.68 | 87.8 | |
| Active LearningAL Rounds=0, Num. Manual Labels=863, Accum. Manual Labels=863, No. Pseudo Labels=637, Training Samples=1500, Annotation Saved (%)=42.472026.05 | 79.54 | 85.6 | |
| Zero-shot + ExplanationAL Rounds=-, Num. Manual Labels=0, Accum. Manual Labels=0, No. Pseudo Labels=0, Training Samples=0, Annotation Saved (%)=02026.05 | 61.82 | 66 | |
| Zero-shotAL Rounds=-, Num. Manual Labels=0, Accum. Manual Labels=0, No. Pseudo Labels=0, Training Samples=0, Annotation Saved (%)=02026.05 | 57.73 | 60.4 |