Accuracy on SciQ (Question Answering)
86.3Accuracy (SciQ)BF16
Evaluation Results
| Method | Links | |
|---|---|---|
| BF16Model Size=13B, Precision=BF16, Zero-shot=true2025.01 | 86.3 | |
| FP4Model Size=13B, Precision=FP4, Zero-shot=true2025.01 | 85.8 | |
| BF16Model Size=7B, Precision=BF16, Zero-shot=true2025.01 | 85 | |
| FP4Model Size=7B, Precision=FP4, Zero-shot=true2025.01 | 84.7 | |
| FP4Model Size=1.3B, Precision=FP4, Zero-shot=true2025.01 | 83.9 | |
| BF16Model Size=1.3B, Precision=BF16, Zero-shot=true2025.01 | 83.3 |