Zero-shot Reasoning on Reasoning Suite (PIQA, ARCe, ARCc, BoolQ, HellaSwag, WinoGrande)
79.05PIQA AccuracyFP16
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| FP16Model=LLAMA-1-13B, Bits=FP162026.04 | 79.05 | 59.89 | 44.71 | 68.47 | 76.23 | 70.24 | 66.43 | |
| FP16Model=LLAMA-1-7B, Bits=FP162026.04 | 77.37 | 52.48 | 41.38 | 73.06 | 73 | 67.01 | 64.05 | |
| LBLLMModel=LLAMA-1-13B, Bits=W(1+1)A42026.04 | 74.05 | 50.21 | 34.9 | 65.81 | 64.49 | 63.85 | 58.88 | |
| LBLLMModel=LLAMA-1-7B, Bits=W(1+1)A42026.04 | 71.33 | 44.74 | 33.53 | 66.24 | 58.29 | 61.72 | 55.97 |