Named Entity Recognition on SEC-filings (test)
57.05Micro-F1GPT2-xl
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT2-xl#Param=1.5B, shot=5-shot2023.05 | 57.05 | |
| MetaNER#Param=770M, shot=5-shot2023.05 | 54.87 | |
| T5v1.1-large#Param=770M, shot=5-shot2023.05 | 53.44 | |
| MetaNER#Param=770M, shot=1-shot2023.05 | 52.07 | |
| MetaNER-base#Param=220M, shot=5-shot2023.05 | 51.39 | |
| OPT-66B#Param=66B, shot=5-shot2023.05 | 47.01 | |
| MetaNER-base#Param=220M, shot=1-shot2023.05 | 46.88 | |
| OPT-30B#Param=30B, shot=5-shot2023.05 | 46.52 | |
| GPT-Neox-20B#Param=20B, shot=5-shot2023.05 | 45.17 | |
| GPT-Neox-20B#Param=20B, shot=1-shot2023.05 | 45.07 | |
| OPT-13B#Param=13B, shot=5-shot2023.05 | 43.1 | |
| GPT2-xl#Param=1.5B, shot=1-shot2023.05 | 42.83 | |
| T5-xxl#Param=11B, shot=5-shot2023.05 | 42.44 | |
| T5-xl#Param=3B, shot=5-shot2023.05 | 42.22 | |
| T5v1.1-large#Param=770M, shot=1-shot2023.05 | 41.89 | |
| OPT-13B#Param=13B, shot=1-shot2023.05 | 41.6 | |
| OPT-30B#Param=30B, shot=1-shot2023.05 | 40.83 | |
| CONTAINER#Param=345M, shot=5-shot2023.05 | 40.44 | |
| GPT-J-6B#Param=6B, shot=1-shot2023.05 | 40.12 | |
| GPT-J-6B#Param=6B, shot=5-shot2023.05 | 39.61 | |
| OPT-66B#Param=66B, shot=1-shot2023.05 | 39.15 | |
| StructShot#Param=345M, shot=5-shot2023.05 | 38.44 | |
| NNShot#Param=345M, shot=5-shot2023.05 | 37.86 | |
| CONTAINER#Param=345M, shot=1-shot2023.05 | 34.07 | |
| T5-xxl#Param=11B, shot=1-shot2023.05 | 32.65 | |
| T5-xl#Param=3B, shot=1-shot2023.05 | 30.58 | |
| StructShot#Param=345M, shot=1-shot2023.05 | 30.4 | |
| NNShot#Param=345M, shot=1-shot2023.05 | 30.19 | |
| ProtoNet#Param=345M, shot=5-shot2023.05 | 23.67 | |
| ProtoNet#Param=345M, shot=1-shot2023.05 | 16.79 |