MCQ Classification on IOI 2 v1 (Eva)
100AccuracyMLP value vector update
Evaluation Results
| Method | Links | |
|---|---|---|
| MLP value vector updateModel=GPT2-Small, Updated Vector=v_{9,1853}2024.05 | 100 | |
| MLP value vector updateModel=GPT2-Large, Updated Vector=v_{34,1541}2024.05 | 100 | |
| MLP value vector updateModel=GPT2-XL, Updated Vector=v_{38,4191}2024.05 | 100 | |
| MLP value vector updateModel=GPT2-Medium, Updated Vector=v_{20,3713}2024.05 | 98.1 | |
| MLP value vector updateModel=GPT2-Large, Updated Vector=v_{44,4967}2024.05 | 97.8 | |
| MLP value vector updateModel=GPT2-Small, Updated Vector=v_{9,2859}2024.05 | 44.2 |