Linguistic Analysis on BLiMP
81.5AccuracyBaseline
Evaluation results
| Method | Links | |
|---|---|---|
| BaselineScale=Large, Evaluation Protocol=Zero-shot2026.06 | 81.5 | |
| PrismScale=Large, Evaluation Protocol=Zero-shot2026.06 | 81.5 | |
| BaselineScale=Medium, Evaluation Protocol=Zero-shot2026.06 | 80.8 | |
| PrismScale=Medium, Evaluation Protocol=Zero-shot2026.06 | 80.6 | |
| PrismScale=Small, Evaluation Protocol=Zero-shot2026.06 | 80 | |
| BaselineScale=Small, Evaluation Protocol=Zero-shot2026.06 | 79.5 | |
| Fine-TunedBackbone=all-MiniLM-L12-v2, Method (Evaluation Protocol)=Fine-Tuned2025.12 | 60.5 | |
| Task MatrixBackbone=all-MiniLM-L12-v2, Method (Evaluation Protocol)=Task Matrix, Best Layer=L3,42025.12 | 50 | |
| Linear ProbeBackbone=all-MiniLM-L12-v2, Method (Evaluation Protocol)=Linear Probe2025.12 | 38.1 | |
| Base w/ FT ClassifierBackbone=all-MiniLM-L12-v2, Method (Evaluation Protocol)=Base w/ FT Classifier2025.12 | 2.6 |