Question Answering on ARC-Easy (zero-shot n=200 subset)
71Accuracyfp16
Evaluation results
| Method | Links | |
|---|---|---|
| fp16bits=16.002026.05 | 71 | |
| HQMQ s192 r6 + Med3xbits=5.152026.05 | 70 | |
| HQMQ s24 r6 + Med3xbits=4.422026.05 | 69 | |
| HQMQ s96 r6 + Med3xbits=4.912026.05 | 67 | |
| naive int4bits=4.002026.05 | 24 |