Financial Named Entity Recognition
91.2F1 Score (NER)DeepSeek-R1-8B + NEFTune
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DeepSeek-R1-8B + NEFTuneParameters=8B, NEFTune=true2026.06 | 91.2 | 91.1 | 91.3 | |
| DeepSeek-R1-8BParameters=8B, NEFTune=false2026.06 | 90.1 | 90 | 90.2 | |
| Llama3-8BParameters=8B2026.06 | 89.4 | 89.3 | 89.5 | |
| Qwen3-8BParameters=8B2026.06 | 83.3 | 84.3 | 82.4 | |
| Baichuan2-7BParameters=7B2026.06 | 79.2 | 80.1 | 78.2 | |
| T52026.06 | 76.7 | 77.6 | 75.8 | |
| BERT-Base2026.06 | 70.8 | 71.7 | 70 | |
| GPT-4 (gpt-4-0613)Type=Heart, Zero-shot=true2024.02 | 0.8 | — | — | |
| FinTral-DPOType=Spade, Zero-shot=true2024.02 | 0.7 | — | — | |
| ChatGPT (gpt-3.5-turbo)Type=Heart, Zero-shot=true2024.02 | 0.53 | — | — | |
| FinTral-INSTType=Spade, Zero-shot=true2024.02 | 0.4 | — | — | |
| FinMA-7BType=Club, Zero-shot=true2024.02 | 0.38 | — | — | |
| FinMA-7B-fullType=Spade, Zero-shot=true2024.02 | 0.35 | — | — | |
| Llama-2-7b-chat-hfType=Heart, Zero-shot=true2024.02 | 0.07 | — | — | |
| Llama-2-13b-chat-hfType=Heart, Zero-shot=true2024.02 | 0.02 | — | — | |
| Vicuna-7BType=Diamond, Zero-shot=true2024.02 | 0.01 | — | — | |
| FinMA-7B-tradeType=Spade, Zero-shot=true2024.02 | 0 | — | — | |
| Llama-2-7b-hfType=Club, Zero-shot=true2024.02 | 0 | — | — | |
| Mistral-7B-v0.1Type=Club, Zero-shot=true2024.02 | 0 | — | — | |
| Mistral-7B-Instruct-v0.1Type=Diamond, Zero-shot=true2024.02 | 0 | — | — |