Named Entity Recognition on UlyssesNER (val)
42Micro-F1LLM ensemble pipeline
Evaluation Results
| Method | Links | |
|---|---|---|
| LLM ensemble pipelineExtraction=LLaMA3, Voting=Phi3, Gemma2, Qwen2, Disambiguation=Mistral, LLaMA3, Qwen2, Evaluation Protocol=Zero-shot2025.12 | 42 | |
| LLaMA3Evaluation Protocol=Zero-shot2025.12 | 34 | |
| Gemma2Evaluation Protocol=Zero-shot2025.12 | 28.1 | |
| Phi3Evaluation Protocol=Zero-shot2025.12 | 27.1 | |
| MistralEvaluation Protocol=Zero-shot2025.12 | 21.5 | |
| Qwen2Evaluation Protocol=Zero-shot2025.12 | 15.5 |