Intent Classification on SciCite (test)
88.93macro F1ImpactCite
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ImpactCiteArchitecture=Base2020.05 | 88.93 | 92.67 | 85.79 | 88.34 | 88.13 | — | |
| Mercier et. al.Dataset=SciCite2023.04 | 88.93 | — | — | — | — | — | |
| CitePromptDataset=SciCite2023.04 | 86.33 | — | — | — | — | 87.56 | |
| Beltagy et. al.Dataset=SciCite2023.04 | 85.49 | — | — | — | — | — | |
| Cohan et. al.Dataset=SciCite2023.04 | 84 | — | — | — | — | — | |
| BERTArchitecture=Base2020.05 | 83.13 | 84.56 | 75.37 | 89.47 | 84.2 | — | |
| ALBERTArchitecture=Base2020.05 | 82.62 | 83.78 | 77.03 | 87.06 | 83.34 | — | |
| CNNArchitecture=L 3 F 100 C 2,4,62020.05 | 80.22 | 81.85 | 77.69 | 81.14 | 80.12 | — | |
| Jurgens et. al.Dataset=SciCite2023.04 | 79.6 | — | — | — | — | — | |
| CNNArchitecture=L 3 F 100 C 3,5,72020.05 | 78.65 | 76.45 | 74.05 | 85.46 | 80.49 | — | |
| CNNArchitecture=L 3 F 100 C 3,4,52020.05 | 78.56 | 79.92 | 76.53 | 79.24 | 78.5 | — | |
| LSTMArchitecture=L 4 F 5122020.05 | 75.94 | 75.29 | 69.59 | 82.95 | 77.54 | — | |
| LSTMArchitecture=L 2 F 5122020.05 | 75.61 | 73.75 | 73.55 | 79.54 | 76.8 | — | |
| CNNArchitecture=L 3 F 100 C 3,7,92020.05 | 75.39 | 68.34 | 70.58 | 87.26 | 79.2 | — | |
| LSTMArchitecture=L 4 F 10242020.05 | 74.63 | 68.73 | 70.91 | 84.25 | 77.75 | — | |
| CNNArchitecture=L 3 F 100 C 3,3,32020.05 | 73.76 | 64.09 | 71.74 | 85.46 | 78.05 | — | |
| RNNArchitecture=L 2 F 5122020.05 | 48.05 | 25.1 | 56.86 | 62.19 | 55.3 | — | |
| BERTArchitecture=Base2020.05 | — | — | — | — | 84.85 | — | |
| BiLSTM-Att2020.05 | — | — | — | — | 82.6 | — | |
| Scaffolds2020.05 | — | — | — | — | 84 | — | |
| SciBert2020.05 | — | — | — | — | 85.49 | — |