Named Entity Recognition on GUM
95.74Micro F1ChuLo
Evaluation Results
| Method | Links | |
|---|---|---|
| ChuLo2024.10 | 95.74 | |
| ChuLo2024.10 | 95.58 | |
| Longformer2024.10 | 94.39 | |
| Longformer2024.10 | 94.27 | |
| BigBird2024.10 | 94.26 | |
| BigBird2024.10 | 94.17 | |
| ProMLShot=5-shot2022.11 | 36.99 | |
| Gemini 1.52024.10 | 32.15 | |
| Gemini 1.52024.10 | 30.93 | |
| GPT4o2024.10 | 30.18 | |
| GPT4o2024.10 | 28.08 | |
| TransferBERTShot=5-shot, Evaluation Protocol=reproduced2022.11 | 27.5 | |
| ProtoBERTShot=5-shot, Evaluation Protocol=reproduced2022.11 | 25.02 | |
| DualEncoderShot=5-shot, Evaluation Protocol=reproduced2022.11 | 24.55 | |
| CONTAINERShot=5-shot, Evaluation Protocol=original paper2022.11 | 24.4 | |
| StructShotShot=5-shot, Evaluation Protocol=reproduced2022.11 | 19.67 | |
| ProtoBERTShot=5-shot, Evaluation Protocol=original paper2022.11 | 19.5 | |
| NNShotShot=5-shot, Evaluation Protocol=reproduced2022.11 | 19.04 | |
| DemonstrateNERShot=5-shot, Evaluation Protocol=reproduced2022.11 | 18.01 | |
| CONTAINERShot=1-shot, Evaluation Protocol=original paper2022.11 | 17.9 | |
| ProtoBERTShot=1-shot, Evaluation Protocol=original paper2022.11 | 17.8 | |
| CONTAINERShot=5-shot, Evaluation Protocol=reproduced2022.11 | 16.19 | |
| NNShotShot=5-shot, Evaluation Protocol=original paper2022.11 | 15.9 | |
| ProMLShot=1-shot2022.11 | 15.29 | |
| EntLMShot=5-shot, Evaluation Protocol=reproduced2022.11 | 13.35 | |
| StructShotShot=5-shot, Evaluation Protocol=original paper2022.11 | 13.3 | |
| CONTAINERShot=1-shot, Evaluation Protocol=reproduced2022.11 | 12.07 | |
| ProtoBERTShot=1-shot, Evaluation Protocol=reproduced2022.11 | 11.91 | |
| DualEncoderShot=1-shot, Evaluation Protocol=reproduced2022.11 | 11.87 | |
| StructShotShot=1-shot, Evaluation Protocol=reproduced2022.11 | 11.17 | |
| NNShotShot=1-shot, Evaluation Protocol=original paper2022.11 | 10.5 | |
| NNShotShot=1-shot, Evaluation Protocol=reproduced2022.11 | 10.33 | |
| TransferBERTShot=1-shot, Evaluation Protocol=reproduced2022.11 | 8.97 | |
| EntLMShot=1-shot, Evaluation Protocol=reproduced2022.11 | 8.85 | |
| StructShotShot=1-shot, Evaluation Protocol=original paper2022.11 | 7.8 | |
| DemonstrateNERShot=1-shot, Evaluation Protocol=reproduced2022.11 | 3.24 |