Multi-task Language Understanding on MMLU (0-shot Accuracy)
73.040-shot AccuracyLDLQ
Evaluation results
| Method | Links | |
|---|---|---|
| LDLQBITS=4, Protocol=Zero-shot2025.05 | 73.04 | |
| UNQUANTIZEDBITS=16, Protocol=Zero-shot2025.05 | 72.99 | |
| YAQA-BBITS=4, Protocol=Zero-shot2025.05 | 72.78 | |
| YAQA-BBITS=3, Protocol=Zero-shot2025.05 | 71.36 | |
| LDLQBITS=3, Protocol=Zero-shot2025.05 | 70.4 | |
| YAQA-BBITS=2, Protocol=Zero-shot2025.05 | 66.75 | |
| LDLQBITS=2, Protocol=Zero-shot2025.05 | 63.94 |