Citation Intent Classification on OARelatedWork (test)
72.8Background PrecisionGRASP
Evaluation Results
| Method | Links | |||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GRASPvariant=pruned2026.07 | 72.8 | 96.4 | 82.9 | 84.4 | 96 | 89.8 | 86.2 | 98 | 91.7 | 100 | 100 | 100 | 68.4 | 98.3 | 80.6 | 95.5 | 95.5 | 95.5 | 99.1 | 95 | 97 | |
| GRASPvariant=unpruned2026.07 | 70 | 96.5 | 81.1 | 88 | 96 | 91.8 | 94 | 100 | 97.1 | 75 | 100 | 85.7 | 63.5 | 98.3 | 77.2 | 97.7 | 95.5 | 96.6 | 98.5 | 95 | 96.7 | |
| L&OModel=L&O2026.07 | 67 | 96.5 | 79.1 | 59 | 96 | 73.1 | 34 | 100 | 50.8 | 42.9 | 100 | 60 | 27.4 | 98.3 | 42.9 | 49.2 | 95.5 | 65 | 82.7 | 95 | 88.4 | |
| No-graphModel=No-graph2026.07 | 64.9 | 93.5 | 76.6 | 83.8 | 95.4 | 89.2 | 96.2 | 100 | 98.1 | 75 | 100 | 85.7 | 53.6 | 97.4 | 69.1 | 97.7 | 95.5 | 96.6 | 97.4 | 94.3 | 95.8 | |
| DirectModel=Direct2026.07 | 32 | 96.4 | 48.1 | 9 | 95.7 | 16.5 | 5.4 | 100 | 10.3 | 40 | 100 | 57.1 | 20.5 | 98.8 | 33.9 | 34.3 | 96.6 | 50.5 | 35.2 | 98.3 | 51.9 | |
| SRWModel=SRW2026.07 | 16.3 | 51.8 | 24.8 | 31.3 | 46.4 | 37.4 | 12.5 | 70 | 21.2 | 0 | 0 | 0 | 9.1 | 58.1 | 15.8 | 2.7 | 21.1 | 4.8 | 48.9 | 31.9 | 38.7 |