Text Classification on AG News small (held-out)
0.259CostWarm-start static
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Warm-start staticModels=3, Knob=No, Budget=0.252026.05 | 0.259 | 84.5 | |
| Warm-start budgetedModels=1, Knob=Yes, Budget=0.252026.05 | 0.325 | 81.8 | |
| Post-hoc pruningModels=1 + masks, Knob=Discrete, Budget=0.502026.05 | 0.5 | 78 | |
| Warm-start budgetedModels=1, Knob=Yes, Budget=0.502026.05 | 0.503 | 83.5 | |
| Warm-start staticModels=3, Knob=No, Budget=0.502026.05 | 0.529 | 84.4 | |
| Warm-start budgetedModels=1, Knob=Yes, Budget=0.752026.05 | 0.68 | 83.9 | |
| Warm-start staticModels=3, Knob=No, Budget=0.752026.05 | 0.736 | 84.2 | |
| Post-hoc pruningModels=1 + masks, Knob=Discrete, Budget=0.752026.05 | 0.75 | 81.8 | |
| Dense fullModels=1, Knob=No, Budget=1.002026.05 | 1 | 84 |