Question Classification on TREC (Accuracy Statistics)
90.6Average AccuracyPERFECT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| PERFECTInitialization=random2022.04 | 90.6 | 81.6 | 3.2 | |
| PERFECTInitialization=prototype-based2022.04 | 90.4 | 86.6 | 1.8 | |
| bitfit+mteMode=Ablation2022.04 | 90.4 | 85 | 1.4 | |
| FINETUNE2022.04 | 87.6 | 75.8 | 3.7 | |
| PETStrategy=Best2022.04 | 85.8 | 70.6 | 4.4 | |
| PETStrategy=Average2022.04 | 85 | 70.6 | 4.5 | |
| Logan IV et al. (2021)2022.04 | 84.7 | 81.8 | 1.6 | |
| prompt+mteMode=Ablation2022.04 | 79.6 | 66.8 | 6.5 |