Named Entity Recognition on CoNLL English 2003 (val)
97.3Micro-F1SubRegWeigh (Random)
Evaluation Results
| Method | Links | |
|---|---|---|
| SubRegWeigh (Random)Backbone=RoBERTa-LARGE, Processing time (hh:mm)=3:262024.09 | 97.3 | |
| SubRegWeigh (K-means)Backbone=RoBERTa-LARGE, Processing time (hh:mm)=5:212024.09 | 97.28 | |
| SubRegWeigh (Cos-Sim)Backbone=RoBERTa-LARGE, Processing time (hh:mm)=4:512024.09 | 97.27 | |
| VanillaBackbone=RoBERTa-LARGE2024.09 | 97.26 | |
| CrossWeighBackbone=RoBERTa-LARGE, Processing time (hh:mm)=30:552024.09 | 97.11 | |
| VanillaBackbone=LUKE-LARGE2024.09 | 96.78 | |
| SubRegWeigh (K-means)Backbone=LUKE-LARGE, Processing time (hh:mm)=6:362024.09 | 96.65 | |
| CrossWeighBackbone=LUKE-LARGE, Processing time (hh:mm)=26:192024.09 | 96.62 | |
| SubRegWeigh (Random)Backbone=LUKE-LARGE, Processing time (hh:mm)=2:592024.09 | 96.54 | |
| SubRegWeigh (Cos-Sim)Backbone=LUKE-LARGE, Processing time (hh:mm)=6:192024.09 | 96.53 | |
| FinetuningBackbone=BERT-base-cased, # params=108M2023.05 | 94.97 | |
| BitFitBackbone=BERT-base-cased, # params=109K2023.05 | 93.62 | |
| AdapterBackbone=BERT-base-cased, m=1, # params=63K2023.05 | 93.55 | |
| LoRABackbone=BERT-base-cased, rank=1, # params=44K2023.05 | 93.38 | |
| SLaShBackbone=BERT-base-cased, d=5K, # params=12K2023.05 | 91.38 | |
| JR-WARP1Backbone=BERT-base-cased, d=5K, # params=12K2023.05 | 90.93 | |
| WARP20Backbone=BERT-base-cased, # params=22.3K2023.05 | 89.89 | |
| SLaShBackbone=BERT-base-cased, d=1,024, # params=8K2023.05 | 89.37 | |
| Linear ClassifierBackbone=BERT-base-cased, # params=7K2023.05 | 85.94 |