Named Entity Recognition on MIT Restaurant
82.1Micro-F1HAMR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HAMRBackbone=DeBERTa-v3-base2026.04 | 82.1 | — | 81.1 | |
| DiceBackbone=DeBERTa-v3-base2026.04 | 81.3 | — | 80.4 | |
| LNRBackbone=DeBERTa-v3-base2026.04 | 80.6 | — | 79.4 | |
| FocalBackbone=DeBERTa-v3-base2026.04 | 80.1 | — | 79.1 | |
| ICFBackbone=DeBERTa-v3-base2026.04 | 80.1 | — | 79.5 | |
| GBCBackbone=DeBERTa-v3-base2026.04 | 79.3 | — | 78.7 | |
| ENBackbone=DeBERTa-v3-base2026.04 | 79.1 | — | 78.5 | |
| PromptNERNumber of labeled instances (Shots)=500, Source domain=CoNLL032023.05 | 77.4 | — | — | |
| TemplateNERNumber of labeled instances (Shots)=500, Source domain=CoNLL032023.05 | 75.7 | — | — | |
| BERTTaggerNumber of labeled instances (Shots)=500, Source domain=CoNLL032023.05 | 75.3 | — | — | |
| PromptNERNumber of labeled instances (Shots)=200, Source domain=CoNLL032023.05 | 74.4 | — | — | |
| TemplateNERNumber of labeled instances (Shots)=200, Source domain=CoNLL032023.05 | 72.2 | — | — | |
| PromptNERNumber of labeled instances (Shots)=100, Source domain=CoNLL032023.05 | 71.3 | — | — | |
| Rainbow CuckooShots=4, Evaluation Protocol=In-domain Transfer2025.02 | 70.3 | — | — | |
| MetaIE+Shots=4, Evaluation Protocol=Few-shot2025.02 | 70.08 | — | — | |
| PromptNERNumber of labeled instances (Shots)=50, Source domain=CoNLL032023.05 | 69.3 | — | — | |
| MRQAShots=4, Evaluation Protocol=Few-shot2025.02 | 68.68 | — | — | |
| NuNER+Shots=4, Evaluation Protocol=Few-shot2025.02 | 68.57 | — | — | |
| CuckooShots=4, Evaluation Protocol=Few-shot2025.02 | 67.63 | — | — | |
| TemplateNERNumber of labeled instances (Shots)=100, Source domain=CoNLL032023.05 | 67.3 | — | — | |
| Cuckoo (Only Pre-train)Shots=4, Evaluation Protocol=Few-shot2025.02 | 66.87 | — | — | |
| Cuckoo (Only Post-train)Shots=4, Evaluation Protocol=Few-shot2025.02 | 66.02 | — | — | |
| TemplateNERNumber of labeled instances (Shots)=50, Source domain=CoNLL032023.05 | 64.1 | — | — | |
| PromptNERNumber of labeled instances (Shots)=20, Source domain=CoNLL032023.05 | 62.6 | — | — | |
| ROBERTaShots=4, Evaluation Protocol=Few-shot2025.02 | 62.15 | — | — | |
| TemplateNERNumber of labeled instances (Shots)=20, Source domain=CoNLL032023.05 | 60.3 | — | — | |
| MultiNERD+Shots=4, Evaluation Protocol=Few-shot2025.02 | 60.13 | — | — | |
| OPT-C4-TuluV3Shots=4, Evaluation Protocol=Few-shot2025.02 | 58.91 | — | — | |
| BERTTaggerNumber of labeled instances (Shots)=200, Source domain=CoNLL032023.05 | 58.6 | — | — | |
| BERTTaggerNumber of labeled instances (Shots)=100, Source domain=CoNLL032023.05 | 57.4 | — | — | |
| BERTTaggerNumber of labeled instances (Shots)=50, Source domain=CoNLL032023.05 | 56.3 | — | — | |
| PromptNERNumber of labeled instances (Shots)=10, Source domain=CoNLL032023.05 | 56.1 | — | — | |
| TemplateNERNumber of labeled instances (Shots)=10, Source domain=CoNLL032023.05 | 53.1 | — | — | |
| MP-NSPNumber of labeled instances (Shots)=500, Source domain=CoNLL032023.05 | 50.1 | — | — | |
| MP-NSPNumber of labeled instances (Shots)=200, Source domain=CoNLL032023.05 | 50 | — | — | |
| MP-NSPNumber of labeled instances (Shots)=50, Source domain=CoNLL032023.05 | 49.6 | — | — | |
| MP-NSPNumber of labeled instances (Shots)=100, Source domain=CoNLL032023.05 | 49.6 | — | — | |
| MP-NSPNumber of labeled instances (Shots)=20, Source domain=CoNLL032023.05 | 48.2 | — | — | |
| MP-NSPNumber of labeled instances (Shots)=10, Source domain=CoNLL032023.05 | 46.1 | — | — | |
| BERTTaggerNumber of labeled instances (Shots)=20, Source domain=CoNLL032023.05 | 40.9 | — | — | |
| chatgptSetting=zero-shot2023.04 | 37.76 | — | — | |
| Rainbow CuckooShots=0, Evaluation Protocol=Zero-shot2025.02 | 35.38 | — | — | |
| BERTTaggerNumber of labeled instances (Shots)=10, Source domain=CoNLL032023.05 | 27.2 | — | — | |
| Example-basedNumber of labeled instances (Shots)=50, Source domain=CoNLL032023.05 | 26.8 | — | — | |
| Example-basedNumber of labeled instances (Shots)=100, Source domain=CoNLL032023.05 | 26.2 | — | — | |
| Example-basedNumber of labeled instances (Shots)=20, Source domain=CoNLL032023.05 | 26.1 | — | — | |
| Example-basedNumber of labeled instances (Shots)=200, Source domain=CoNLL032023.05 | 25.7 | — | — | |
| Example-basedNumber of labeled instances (Shots)=10, Source domain=CoNLL032023.05 | 25.2 | — | — | |
| Example-basedNumber of labeled instances (Shots)=500, Source domain=CoNLL032023.05 | 25.1 | — | — | |
| CuckooShots=0, Evaluation Protocol=Zero-shot2025.02 | 8.11 | — | — | |
| NeighborTaggerNumber of labeled instances (Shots)=500, Source domain=CoNLL032023.05 | 8.1 | — | — | |
| NeighborTaggerNumber of labeled instances (Shots)=200, Source domain=CoNLL032023.05 | 5.5 | — | — | |
| NeighborTaggerNumber of labeled instances (Shots)=100, Source domain=CoNLL032023.05 | 4.6 | — | — | |
| NeighborTaggerNumber of labeled instances (Shots)=10, Source domain=CoNLL032023.05 | 4.1 | — | — | |
| NeighborTaggerNumber of labeled instances (Shots)=50, Source domain=CoNLL032023.05 | 4 | — | — | |
| NeighborTaggerNumber of labeled instances (Shots)=20, Source domain=CoNLL032023.05 | 3.6 | — | — | |
| davinciSetting=zero-shot2023.04 | 2.94 | — | — | |
| B2NEREvaluation Protocol=Supervised2024.11 | — | 83.71 | — | |
| B2NEREvaluation Protocol=Supervised2026.04 | — | 83.7 | — | |
| BERTEvaluation Protocol=Supervised2024.11 | — | 81.02 | — | |
| BERT-baseEvaluation Protocol=Supervised2026.04 | — | 81 | — | |
| ChatGPTEvaluation Protocol=Zero-shot2026.04 | — | 32.8 | — | |
| DiZiNEREvaluation Protocol=Zero-shot2026.04 | — | 67.3 | — | |
| EvoPromptEvaluation Protocol=Zero-shot2026.04 | — | 69.3 | — | |
| GLiNEREvaluation Protocol=Zero-shot2026.04 | — | 42.9 | — | |
| GLiNEREvaluation Protocol=Supervised2026.04 | — | 83.6 | — | |
| gliner_large-v2.5Evaluation Protocol=Zero-shot2026.02 | — | 45 | — | |
| gliner_medium-v2.5Evaluation Protocol=Zero-shot2026.02 | — | 38.5 | — | |
| gliner_small-v2.5Evaluation Protocol=Zero-shot2026.02 | — | 39.8 | — | |
| GLiNER-Lzero-shot=true2026.04 | — | 42.9 | — | |
| GNEREvaluation Protocol=Supervised2026.04 | — | 83.8 | — | |
| GoLLIEEvaluation Protocol=Zero-shot2026.04 | — | 52.7 | — | |
| GPT-5 miniEvaluation Protocol=Zero-shot, Note=supervisor model2026.04 | — | 58.5 | — | |
| IEPILEEvaluation Protocol=Supervised2024.11 | — | 79.85 | — | |
| InstructUIEEvaluation Protocol=Supervised2026.04 | — | 82.6 | — | |
| JPT-4Bzero-shot=true2026.04 | — | 61.9 | — | |
| KnowCoder-7BEvaluation Protocol=Supervised2026.04 | — | 81.3 | — | |
| KnowCoder-XEvaluation Protocol=Supervised2024.11 | — | 81.95 | — | |
| UniNER-7Bzero-shot=true2026.04 | — | 31.7 | — | |
| UniNER-7BEvaluation Protocol=Zero-shot2026.04 | — | 31.7 | — | |
| UniNER-7BEvaluation Protocol=Supervised2026.04 | — | 82.3 | — | |
| YAYI-UIEEvaluation Protocol=Supervised2024.11 | — | 79.38 | — |