Character Component Tagging on Jane Eyre
1.57MAE (N)BookNLP
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| BookNLPManual co-reference intervention=false2026.01 | 1.57 | 7.4 | 4.55 | 7.12 | 4.25 | 1.23 | 4.35 | 0.86 | 0.52 | 0.49 | 0.29 | 0.62 | 0.42 | 0.46 | |
| BookNLP-based pipelineManual co-reference intervention=true2026.01 | 1.57 | 4.89 | 3.17 | 4.16 | 3.48 | 1.18 | 3.08 | 0.86 | 0.89 | 0.82 | 0.91 | 0.8 | 0.56 | 0.86 | |
| SpanLLM2026.01 | 3.06 | 8.5 | 3.07 | 7.71 | 4.08 | 1.3 | 4.62 | 0.62 | 0.79 | 0.81 | 0.76 | 0.77 | 0.52 | 0.55 | |
| GPT-4o-miniInput chunked=false, Asked individually=true2026.01 | 3.53 | 8.24 | 5.35 | 6.94 | 6.68 | 1.87 | 5.43 | 0.61 | 0.68 | 0.55 | 0.76 | 0.27 | 0.52 | 0.6 | |
| GPT-4o-miniInput chunked=false, Asked individually=false2026.01 | 3.92 | 10.31 | 5.92 | 8.21 | 6.6 | 1.76 | 6.12 | 0.57 | 0.65 | 0.66 | 0.67 | 0.46 | 0.53 | 0.42 | |
| GPT-4o-miniInput chunked=true, Asked individually=true2026.01 | 5.05 | 7.75 | 4.1 | 7.11 | 5.92 | 4.04 | 5.66 | 0.78 | 0.74 | 0.7 | 0.8 | 0.46 | 0.58 | 0.71 | |
| GPT-4o-miniInput chunked=true, Asked individually=false2026.01 | 7.74 | 8.4 | 4.3 | 6.8 | 5.89 | 2.7 | 5.97 | 0.68 | 0.66 | 0.66 | 0.67 | 0.48 | 0.61 | 0.45 |