Yes/No Reading Comprehension on BoolQ 1.0 (test)
69Normalized AccuracyLlama-3.2-3b
Evaluation results
| Method | Links | |
|---|---|---|
| Llama-3.2-3bShots=52025.02 | 69 | |
| Qwen-2.5-1.5bShots=52025.02 | 68 | |
| Qwen-2.5-1.5bShots=02025.02 | 62 | |
| Gemma-2-2bShots=52025.02 | 60 | |
| BLOOM-1b7Shots=52025.02 | 59 | |
| Llama-3.2-1bShots=52025.02 | 58 | |
| Qwen-2.5-0.5bShots=52025.02 | 58 | |
| BLOOM-1b1Shots=52025.02 | 58 | |
| Gemma-2-2bShots=02025.02 | 56 | |
| BLOOM-1b1Shots=02025.02 | 56 | |
| SmolLM2-1.7bShots=52025.02 | 55 | |
| BongLLaMA-3.2-3bShots=52025.02 | 54 | |
| TituLLM-3b-v2.0Shots=52025.02 | 54 | |
| davinciShots=02025.02 | 53 | |
| Llama-3.2-1bShots=02025.02 | 53 | |
| Llama-3.2-3bShots=02025.02 | 53 | |
| Qwen-2.5-0.5bShots=02025.02 | 53 | |
| SmolLM2-135mShots=02025.02 | 53 | |
| SmolLM2-360mShots=02025.02 | 53 | |
| SmolLM2-1.7bShots=02025.02 | 53 | |
| BLOOM-560mShots=02025.02 | 53 | |
| BLOOM-560mShots=52025.02 | 53 | |
| BLOOM-1b7Shots=02025.02 | 53 | |
| BLOOM-3bShots=02025.02 | 53 | |
| BLOOM-3bShots=52025.02 | 53 | |
| BongLLaMA-3.2-1bShots=02025.02 | 53 | |
| BongLLaMA-3.2-1bShots=52025.02 | 53 | |
| BongLLaMA-3.2-3bShots=02025.02 | 53 | |
| TituLLM-1b-v2.0Shots=02025.02 | 53 | |
| TituLLM-3b-v2.0Shots=02025.02 | 53 | |
| SmolLM2-360mShots=52025.02 | 52 | |
| SmolLM2-135mShots=52025.02 | 51 | |
| TituLLM-1b-v2.0Shots=52025.02 | 51 |