MCQ Classification on IOI v1 (Infer)
1AccuracyMLP value vector update
Evaluation Results
| Method | Links | |
|---|---|---|
| MLP value vector updateModel=GPT2-Small, Updated Vector=v_{9,1853}2024.05 | 1 | |
| MLP value vector updateModel=GPT2-Large, Updated Vector=v_{34,1541}2024.05 | 1 | |
| MLP value vector updateModel=GPT2-XL, Updated Vector=v_{38,4191}2024.05 | 1 | |
| MLP value vector updateModel=GPT2-Medium, Updated Vector=v_{20,3713}2024.05 | 0.994 | |
| MLP value vector updateModel=GPT2-Large, Updated Vector=v_{44,4967}2024.05 | 0.982 | |
| MLP value vector updateModel=GPT2-Small, Updated Vector=v_{9,2859}2024.05 | 0.446 |