Named Entity Recognition on UNER
75.4Macro F1OTTER
Evaluation results
| Method | Links | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| OTTERArchitecture=Cross-Encoder, Backbone=mmBERT, Training Steps=100k, Thresholding Strategy=Best per language2026.01 | 75.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Gemma3-27B2026.01 | 74.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| OTTERArchitecture=Cross-Encoder, Backbone=mmBERT, Training Steps=100k2026.01 | 71.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| OTTERArchitecture=Bi-Encoder, Backbone=RemBERT2026.01 | 70.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-32B2026.01 | 68.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| OTTERArchitecture=Cross-Encoder, Backbone=mmBERT2026.01 | 67.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| OTTERArchitecture=Bi-Encoder, Backbone=mmBERT2026.01 | 67 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GLiNER-x-base2026.01 | 64.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| OTTERArchitecture=Bi-Encoder, Backbone=mmBERT, Training Steps=100k2026.01 | 59.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GLiNER-multi-v2.12026.01 | 55.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| OTTERArchitecture=Cross-Encoder, Backbone=RemBERT2026.01 | 54 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| WikiNeural2026.01 | 50.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPT-52026.01 | 46.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EasyProject2026.03 | — | 47.6 | 53.9 | 52.9 | 62.2 | 77.4 | 75.5 | 76.9 | 62.2 | 65.1 | 56.7 | 74.8 | 64.3 | 70.8 | 67.3 | 54.1 | 38.5 | 62.5 | |
| LabelPigeon2026.03 | — | 78.3 | 46.4 | 47.4 | 54.5 | 85.6 | 79.3 | 80.2 | 83 | 86.1 | 70.4 | 87.4 | 78.6 | 87.7 | 88.5 | 91.5 | 81.5 | 76.7 |