Character Component Tagging on Pride and Prejudice
0.83MAE (N)BookNLP
Evaluation Results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| BookNLP2026.01 | 0.83 | 1.92 | 1.16 | 1.95 | 3.68 | 0.67 | 1.7 | 0.95 | 0.73 | 0.74 | 0.77 | 0.64 | 0.44 | 0.75 | |
| SpanLLM2026.01 | 1.48 | 1.52 | 0.87 | 1.9 | 2.48 | 0.62 | 1.48 | 0.82 | 0.74 | 0.9 | 0.75 | 0.79 | 0.56 | 0.8 | |
| GPT-4o-miniInput chapter text chunked=false, Label counts for each character individually=true, Asked about each component individually=false2026.01 | 2.08 | 2.33 | 1.79 | 2 | 4.06 | 1.59 | 2.31 | 0.78 | 0.66 | 0.66 | 0.77 | 0.49 | 0.46 | 0.58 | |
| GPT-4o-miniInput chapter text chunked=false, Label counts for each character individually=false, Asked about each component individually=false2026.01 | 2.28 | 1.98 | 1.48 | 2.11 | 4.14 | 1.08 | 2.18 | 0.75 | 0.66 | 0.67 | 0.74 | 0.47 | 0.49 | 0.57 | |
| GPT-4o-miniInput chapter text chunked=true, Label counts for each character individually=false, Asked about each component individually=true2026.01 | 2.95 | 4.25 | 2.47 | 3.18 | 3.6 | 2.92 | 3.23 | 0.86 | 0.73 | 0.67 | 0.77 | 0.6 | 0.48 | 0.64 | |
| GPT-4o-miniInput chapter text chunked=true, Label counts for each character individually=false, Asked about each component individually=false2026.01 | 3.36 | 1.64 | 1.82 | 2.24 | 3.72 | 2.66 | 2.57 | 0.78 | 0.71 | 0.69 | 0.72 | 0.54 | 0.5 | 0.57 | |
| GPT-4o-miniInput chapter text chunked=false, Label counts for each character individually=false, Asked about each component individually=true2026.01 | 3.56 | 1.82 | 1.31 | 1.98 | 3.81 | 1.85 | 2.39 | 0.84 | 0.7 | 0.71 | 0.73 | 0.58 | 0.5 | 0.58 | |
| GPT-4o-miniInput chapter text chunked=true, Label counts for each character individually=true, Asked about each component individually=false2026.01 | 4 | 4.75 | 3.36 | 12.48 | 3.92 | 2.67 | 5.2 | 0.78 | 0.65 | 0.66 | 0.8 | 0.53 | 0.46 | 0.53 | |
| GPT-4o-miniInput chapter text chunked=true, Label counts for each character individually=true, Asked about each component individually=true2026.01 | 4.58 | 12.69 | 4.62 | 26.12 | 5.08 | 4.57 | 9.61 | 0.83 | 0.67 | 0.62 | 0.72 | 0.61 | 0.5 | 0.48 | |
| GPT-4o-miniInput chapter text chunked=false, Label counts for each character individually=true, Asked about each component individually=true2026.01 | 9.09 | 1.6 | 2.38 | 4.16 | 3.54 | 5.14 | 4.32 | 0.8 | 0.73 | 0.67 | 0.71 | 0.58 | 0.48 | 0.57 |