Linguistic Knowledge on MultiBLiMP (avg)
78.8AccuracyGoldfish
Evaluation results
| Method | Links | |
|---|---|---|
| GoldfishNumber of Parameters=124M, Evaluation Protocol=Zero-shot2024.08 | 78.8 | |
| Gemma 2Number of Parameters=1B, Evaluation Protocol=Zero-shot2024.08 | 78 | |
| LLaMA 3Number of Parameters=1B, Evaluation Protocol=Zero-shot2024.08 | 77.4 | |
| Gemma 2Number of Parameters=270M, Evaluation Protocol=Zero-shot2024.08 | 72.3 | |
| XGLMNumber of Parameters=564M, Evaluation Protocol=Zero-shot2024.08 | 66.6 | |
| BLOOMNumber of Parameters=560M, Evaluation Protocol=Zero-shot2024.08 | 64.2 | |
| XGLMNumber of Parameters=1.7B, Evaluation Protocol=Zero-shot2024.08 | 62.7 | |
| Chance2024.08 | 50 |