Named Entity Recognition on MultiCoNER v2
37.3Macro F1Gemma3-27B
Evaluation results
| Method | Links | |
|---|---|---|
| Gemma3-27B2026.01 | 37.3 | |
| Qwen3-32B2026.01 | 34.9 | |
| OTTERArchitecture=Cross-Encoder, Backbone=RemBERT2026.01 | 29.4 | |
| OTTERArchitecture=Cross-Encoder, Backbone=mmBERT, Training Steps=100k, Thresholding Strategy=Best per language2026.01 | 26.5 | |
| OTTERArchitecture=Cross-Encoder, Backbone=mmBERT, Training Steps=100k2026.01 | 25.4 | |
| GLiNER-multi-v2.12026.01 | 23.8 | |
| OTTERArchitecture=Bi-Encoder, Backbone=mmBERT, Training Steps=100k2026.01 | 23.8 | |
| OTTERArchitecture=Cross-Encoder, Backbone=mmBERT2026.01 | 23.3 | |
| GLiNER-x-base2026.01 | 21 | |
| OTTERArchitecture=Bi-Encoder, Backbone=mmBERT2026.01 | 17.5 | |
| OTTERArchitecture=Bi-Encoder, Backbone=RemBERT2026.01 | 15.6 | |
| GPT-52026.01 | 13.3 | |
| WikiNeural2026.01 | 1.3 |