Sequence Labeling on NLU++ (test)
81.29Micro F1Sequence repetition
Evaluation results
| Method | Links | |
|---|---|---|
| Sequence repetitionModel=Gemma-7B, r=42026.01 | 81.29 | |
| Sequence repetitionModel=Mistral-7B, r=42026.01 | 80.28 | |
| Full unmaskingModel=Mistral-7B2026.01 | 80.23 | |
| Sequence repetitionModel=Gemma2-2B, r=22026.01 | 79.98 | |
| Middle unmaskingModel=Gemma-7B2026.01 | 79.9 | |
| Middle unmaskingModel=Mistral-7B2026.01 | 79.35 | |
| Sequence repetitionModel=Gemma2-9B, r=22026.01 | 78.83 | |
| Middle unmaskingModel=Gemma2-2B2026.01 | 78.21 | |
| Sequence repetitionModel=Qwen3-4B, r=82026.01 | 77.97 | |
| Sequence repetitionModel=Qwen3-1.7B, r=42026.01 | 77.75 | |
| Middle unmaskingModel=Gemma2-9B2026.01 | 77.63 | |
| Sequence repetitionModel=Qwen3-8B, r=42026.01 | 77.61 | |
| Full unmaskingModel=Gemma2-9B2026.01 | 76.83 | |
| Full unmaskingModel=Gemma2-2B2026.01 | 76.42 | |
| Middle unmaskingModel=Qwen3-8B2026.01 | 75.06 | |
| Middle unmaskingModel=Qwen3-4B2026.01 | 74.56 | |
| Full unmaskingModel=Qwen3-8B2026.01 | 74.45 | |
| Full unmaskingModel=Gemma-7B2026.01 | 74.34 | |
| Full unmaskingModel=Qwen3-4B2026.01 | 73.79 | |
| Middle unmaskingModel=Qwen3-1.7B2026.01 | 73.67 | |
| RoBERTaModel=RoBERTa2026.01 | 72.22 | |
| ModernBERTModel=ModernBERT2026.01 | 70.5 | |
| Full unmaskingModel=Qwen3-1.7B2026.01 | 67.28 |