ToC Extraction on Chinese ESG Reports (5-page segments)
100CCQwen3
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Qwen3Prompting Strategy=RAP2025.11 | 100 | 98 | 97.02 | |
| DoubaoPrompting Strategy=RAP2025.11 | 100 | 97 | 97 | |
| GPT-4oPrompting Strategy=RAP2025.11 | 99 | 100 | 99 | |
| Gemini 2.5 ProPrompting Strategy=RAP2025.11 | 97.02 | 96.03 | 94.06 | |
| DoubaoPrompting Strategy=GP2025.11 | 95.04 | 81.19 | 89.11 | |
| Qwen3Prompting Strategy=GP2025.11 | 94.06 | 96.04 | 92.08 | |
| Pharos-ESGPrompting Strategy=RAP2025.11 | 93.19 | 97.52 | 93.81 | |
| Gemini 2.5 ProPrompting Strategy=GP2025.11 | 93.07 | 93.07 | 91.09 | |
| DeepSeek-R1Prompting Strategy=RAP2025.11 | 93 | 94.06 | 98.02 | |
| GPT-4oPrompting Strategy=GP2025.11 | 85.15 | 88.2 | 71.29 | |
| DeepSeek-V3Prompting Strategy=RAP2025.11 | 84.16 | 89.11 | 92.08 | |
| DeepSeek-R1Prompting Strategy=GP2025.11 | 82.18 | 87.13 | 77.23 | |
| Pharos-ESGPrompting Strategy=GP2025.11 | 81.64 | 79.68 | 68.19 | |
| DeepSeek-V3Prompting Strategy=GP2025.11 | 64.35 | 56.43 | 69.31 |