MCQ Classification on ARC v1 (Eva.)
100AccuracyMLP value vector update
Evaluation Results
| Method | Links | |
|---|---|---|
| MLP value vector updateModel=GPT2-Small, Updated Vector=v_{9,1853}2024.05 | 100 | |
| MLP value vector updateModel=GPT2-XL, Updated Vector=v_{38,4191}2024.05 | 96.9 | |
| MLP value vector updateModel=GPT2-Large, Updated Vector=v_{34,1541}2024.05 | 96.7 | |
| MLP value vector updateModel=GPT2-Small, Updated Vector=v_{9,2859}2024.05 | 96.2 | |
| MLP value vector updateModel=GPT2-Large, Updated Vector=v_{44,4967}2024.05 | 90.8 | |
| MLP value vector updateModel=GPT2-Medium, Updated Vector=v_{20,3713}2024.05 | 60.4 |