Commonsense Question Answering on CQA (test)
43.9AccuracyMI-based distillation
Evaluation Results
| Method | Links | |
|---|---|---|
| MI-based distillationBackbone=T5-small2024.03 | 43.9 | |
| DSSBackbone=T5-small, Evaluation Protocol=Distilling Step-by-Step2024.03 | 43.24 | |
| FinetuningBackbone=T5-small, Evaluation Protocol=Standard Label Supervision2024.03 | 43.16 |