MCQ Classification on CSQA 5 v1 (eva)
100AccuracyMLP value vector update
Evaluation Results
| Method | Links | |
|---|---|---|
| MLP value vector updateModel=GPT2-Small, Updated Vector=v_{9,1853}2024.05 | 100 | |
| MLP value vector updateModel=GPT2-Large, Updated Vector=v_{34,1541}2024.05 | 100 | |
| MLP value vector updateModel=GPT2-XL, Updated Vector=v_{38,4191}2024.05 | 95.2 | |
| MLP value vector updateModel=GPT2-Large, Updated Vector=v_{44,4967}2024.05 | 94.2 | |
| MLP value vector updateModel=GPT2-Small, Updated Vector=v_{9,2859}2024.05 | 56.4 | |
| MLP value vector updateModel=GPT2-Medium, Updated Vector=v_{20,3713}2024.05 | 27.5 |