Question Answering on PIQA (zero-shot, n=200 subset)
82Accuracyfp16
Evaluation results
| Method | Links | |
|---|---|---|
| fp16bits=16.002026.05 | 82 | |
| HQMQ s24 r6 + Med3xbits=4.422026.05 | 81 | |
| HQMQ s192 r6 + Med3xbits=5.152026.05 | 81 | |
| HQMQ s96 r6 + Med3xbits=4.912026.05 | 79 | |
| naive int4bits=4.002026.05 | 51 |