Named Entity Recognition on Instruc-tUIE NER
53.15F1 ScoreJsonTuning
Evaluation Results
| Method | Links | |
|---|---|---|
| JsonTuningBackbone=LLaMA3-8B, Zero-shot generalization=true2023.10 | 53.15 | |
| JsonTuningBackbone=Mistral-7B, Zero-shot generalization=true2023.10 | 53.02 | |
| JsonTuningBackbone=LLaMA2-13B, Zero-shot generalization=true2023.10 | 47.71 | |
| JsonTuningBackbone=LLaMA-13B, Zero-shot generalization=true2023.10 | 45.31 | |
| JsonTuningBackbone=LLaMA2-7B, Zero-shot generalization=true2023.10 | 45.25 | |
| JsonTuningBackbone=LLaMA-7B, Zero-shot generalization=true2023.10 | 43.47 | |
| TextTuningBackbone=LLaMA3-8B, Zero-shot generalization=true2023.10 | 43.31 | |
| TextTuningBackbone=LLaMA2-7B, Zero-shot generalization=true2023.10 | 41.66 | |
| TextTuningBackbone=LLaMA2-13B, Zero-shot generalization=true2023.10 | 40.95 | |
| TextTuningBackbone=Mistral-7B, Zero-shot generalization=true2023.10 | 40.18 | |
| TextTuningBackbone=LLaMA-13B, Zero-shot generalization=true2023.10 | 38.15 | |
| TextTuningBackbone=LLaMA-7B, Zero-shot generalization=true2023.10 | 37.61 | |
| JsonTuningBackbone=Falcon-7B, Zero-shot generalization=true2023.10 | 29.02 | |
| TextTuningBackbone=Falcon-7B, Zero-shot generalization=true2023.10 | 20.72 |