Entity Extraction on RESUME
96.54Overall F1 ScoreGlyce+BERT
Evaluation results
| Method | Links | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Glyce+BERTincorporates_glyph=true2019.01 | 96.54 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 96.62 | 96.48 | |
| BERT2019.01 | 95.78 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 96.12 | 95.45 | |
| Lattice-LSTM+Glyceincorporates_glyph=true2019.01 | 95.67 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 95.72 | 95.63 | |
| TENERScaled Attention=false2019.11 | 95 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CAN-NEREmbeddings=100d pre-trained character and bigram2019.11 | 94.94 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Lattice-LSTM2019.01 | 94.46 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 94.81 | 94.11 | |
| BiLSTM2019.11 | 94.41 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CRF-LSTM2019.01 | 94.41 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 94.53 | 94.29 | |
| TENERScaled Attention=true2019.11 | 94 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ID-CNN2019.11 | 93.75 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Transformer2019.11 | 93.43 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| multi-turn QAModel Architecture=multi-turn QA2019.05 | — | 98.1 | 99 | 98.6 | 82.3 | 87.6 | 84.9 | 97.1 | 98.5 | 97.8 | 96.6 | 98.8 | 97.7 | 91 | 93.2 | 92.1 | — | — | |
| multi-turn QA+RLModel Architecture=multi-turn QA+RL2019.05 | — | 98.1 | 99 | 98.6 | 83.3 | 87.8 | 85.5 | 97.3 | 98.9 | 98.1 | 97 | 98.9 | 97.9 | 91.6 | 93.5 | 92.5 | — | — | |
| tagging+dependencyModel Architecture=tagging+dependency2019.05 | — | 97 | 97.2 | 97.1 | 81.4 | 87.3 | 84.2 | 96.3 | 98 | 97 | 95.2 | 96.3 | 95.7 | 90 | 91.7 | 90.8 | — | — | |
| tagging+relationModel Architecture=tagging+relation2019.05 | — | 97 | 97.2 | 97.1 | 81 | 86.2 | 83.5 | 94.4 | 97.8 | 96 | 94 | 95.9 | 94.9 | 88.2 | 91.5 | 89.8 | — | — |