Question Answering on ARC-E (Accuracy, Avg.)
84.68AccuracyFP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FPModel=Dream-Instruct, Quantization=Full Precision2026.06 | 84.68 | 71.01 | |
| FPModel=Dream-Base, Quantization=Full Precision2026.06 | 83.84 | 70.01 | |
| FAIR-CalibModel=Dream-Instruct, Quantization=W4A42026.06 | 83.46 | 66.66 | |
| FlatQuantModel=Dream-Instruct, Quantization=W4A42026.06 | 80.89 | 63.98 | |
| FAIR-CalibModel=Dream-Base, Quantization=W4A42026.06 | 80.51 | 64.64 | |
| QuaRotModel=Dream-Instruct, Quantization=W4A42026.06 | 78.2 | 61.14 | |
| FlatQuantModel=Dream-Base, Quantization=W4A42026.06 | 77.19 | 62.08 | |
| QuaRotModel=Dream-Base, Quantization=W4A42026.06 | 75.72 | 57.49 | |
| RTNModel=Dream-Instruct, Quantization=W4A42026.06 | 59.51 | 45.76 | |
| RTNModel=Dream-Base, Quantization=W4A42026.06 | 51.6 | 42 |