Classification on CGA-WIKI
69.5AccuracySOTA with oracle threshold
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| SOTA with oracle thresholdThresholding protocol=oracle, Random seeds=52026.05 | 69.5 | 33.5 | 69 | 72.6 | 70.3 | 3.5 | |
| SOTARandom seeds=52026.05 | 69.4 | 36.7 | 67.7 | 75.4 | 71.1 | 3.6 | |
| SOTA + selective deferralDeferral mechanism=selective, Random seeds=52026.05 | 69.2 | 35.3 | 68.1 | 71.6 | 69.6 | 3.6 | |
| SOTA + random deferralDeferral mechanism=random, Random seeds=52026.05 | 68 | 33.6 | 67.9 | 72.7 | 70 | 3.5 | |
| SOTA + simulation (majority)Simulation strategy=majority, Random seeds=52026.05 | 67.4 | 40.2 | 65.8 | 75 | 69.5 | 3.5 | |
| SOTA + simulation (average)Simulation strategy=average, Random seeds=52026.05 | 66.9 | 46.4 | 63.8 | 80.2 | 70.6 | 3.7 |