List your company
ResearchFormerly WizWand

Named Entity Recognition on GUM

95.74Micro F1ChuLo
-0.4624.51549.4974.465Nov 8, 2022Mar 5, 2023Jul 1, 2023Oct 27, 2023Feb 21, 2024Jun 18, 2024Oct 14, 2024
Updated 8mo ago

Evaluation results

MethodLinks
ChuLo2024.1095.74
ChuLo2024.1095.58
Longformer2024.1094.39
Longformer2024.1094.27
BigBird2024.1094.26
BigBird2024.1094.17
ProMLShot=5-shot2022.1136.99
Gemini 1.52024.1032.15
Gemini 1.52024.1030.93
GPT4o2024.1030.18
GPT4o2024.1028.08
TransferBERTShot=5-shot, Evaluation Protocol=reproduced2022.1127.5
ProtoBERTShot=5-shot, Evaluation Protocol=reproduced2022.1125.02
DualEncoderShot=5-shot, Evaluation Protocol=reproduced2022.1124.55
CONTAINERShot=5-shot, Evaluation Protocol=original paper2022.1124.4
StructShotShot=5-shot, Evaluation Protocol=reproduced2022.1119.67
ProtoBERTShot=5-shot, Evaluation Protocol=original paper2022.1119.5
NNShotShot=5-shot, Evaluation Protocol=reproduced2022.1119.04
DemonstrateNERShot=5-shot, Evaluation Protocol=reproduced2022.1118.01
CONTAINERShot=1-shot, Evaluation Protocol=original paper2022.1117.9
ProtoBERTShot=1-shot, Evaluation Protocol=original paper2022.1117.8
CONTAINERShot=5-shot, Evaluation Protocol=reproduced2022.1116.19
NNShotShot=5-shot, Evaluation Protocol=original paper2022.1115.9
ProMLShot=1-shot2022.1115.29
EntLMShot=5-shot, Evaluation Protocol=reproduced2022.1113.35
StructShotShot=5-shot, Evaluation Protocol=original paper2022.1113.3
CONTAINERShot=1-shot, Evaluation Protocol=reproduced2022.1112.07
ProtoBERTShot=1-shot, Evaluation Protocol=reproduced2022.1111.91
DualEncoderShot=1-shot, Evaluation Protocol=reproduced2022.1111.87
StructShotShot=1-shot, Evaluation Protocol=reproduced2022.1111.17
NNShotShot=1-shot, Evaluation Protocol=original paper2022.1110.5
NNShotShot=1-shot, Evaluation Protocol=reproduced2022.1110.33
TransferBERTShot=1-shot, Evaluation Protocol=reproduced2022.118.97
EntLMShot=1-shot, Evaluation Protocol=reproduced2022.118.85
StructShotShot=1-shot, Evaluation Protocol=original paper2022.117.8
DemonstrateNERShot=1-shot, Evaluation Protocol=reproduced2022.113.24