Named Entity Recognition on UlyssesNER (test)
88.9Micro-F1RoBERTa
Evaluation results
| Method | Links | |
|---|---|---|
| RoBERTaEvaluation Protocol=Supervised2025.12 | 88.9 | |
| LLM ensemble pipelineExtraction=LLaMA3, Voting=Phi3, Gemma2, Qwen2, Disambiguation=Mistral, LLaMA3, Qwen2, Evaluation Protocol=Zero-shot2025.12 | 35.3 | |
| Gemma2Evaluation Protocol=Zero-shot2025.12 | 33.4 | |
| Phi3Evaluation Protocol=Zero-shot2025.12 | 32.4 | |
| LLaMA3Evaluation Protocol=Zero-shot2025.12 | 30.9 | |
| Qwen2Evaluation Protocol=Zero-shot2025.12 | 29.1 | |
| MistralEvaluation Protocol=Zero-shot2025.12 | 27.9 |