Named Entity Recognition on MariNER (val)
76.7Micro-F1LLM ensemble pipeline
Evaluation results
| Method | Links | |
|---|---|---|
| LLM ensemble pipelineExtraction=Gemma2, Voting=Phi3, Gemma2, LLaMA3, Disambiguation=Phi3, Mistral, Qwen2, Evaluation Protocol=Zero-shot2025.12 | 76.7 | |
| Gemma2Evaluation Protocol=Zero-shot2025.12 | 73.4 | |
| Phi3Evaluation Protocol=Zero-shot2025.12 | 66.7 | |
| LLaMA3Evaluation Protocol=Zero-shot2025.12 | 65.2 | |
| Qwen2Evaluation Protocol=Zero-shot2025.12 | 64.8 | |
| MistralEvaluation Protocol=Zero-shot2025.12 | 54.7 |