MCQ Classification on ARC Infer. v1
100AccuracyMLP value vector update
Evaluation Results
| Method | Links | |
|---|---|---|
| MLP value vector updateModel=GPT2-Small, Updated Vector=v_{9,1853}2024.05 | 100 | |
| MLP value vector updateModel=GPT2-XL, Updated Vector=v_{38,4191}2024.05 | 97.4 | |
| MLP value vector updateModel=GPT2-Large, Updated Vector=v_{34,1541}2024.05 | 96.7 | |
| MLP value vector updateModel=GPT2-Small, Updated Vector=v_{9,2859}2024.05 | 93.7 | |
| MLP value vector updateModel=GPT2-Large, Updated Vector=v_{44,4967}2024.05 | 90.7 | |
| MLP value vector updateModel=GPT2-Medium, Updated Vector=v_{20,3713}2024.05 | 56.8 |