Long PDF Understanding on PaperPDF English 1.0
41.9ANLSPDF-WuKong
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| PDF-WuKong#Param=8.5B, Token=2107, Solution Category=Parsed Interleaved Text and Images2024.10 | 41.9 | 43.5 | 40.9 | 77.5 | |
| InternVL2+BGE-M3*#Param=8.5B, Token=849, Solution Category=Plain Text Solution2024.10 | 36.4 | 37.3 | 34.7 | 53.3 | |
| Qwen2.5-VL#Param=7B, Token=5878, Solution Category=Pure Vision Solution2024.10 | 35.5 | 34.8 | 32.6 | 38.3 | |
| InternVL2#Param=8B, Token=6220, Solution Category=Parsed Interleaved Text and Images2024.10 | 33.4 | 36.2 | 36.6 | 54.3 | |
| IXC2-VL+BGE-M3#Param=8.5B, Token=623, Solution Category=Plain Text Solution2024.10 | 32.4 | 34 | 32.4 | 48.4 | |
| MiniCPM-V 2.6 + VisRAG*(3p)#Param=10B, Token=2199, Solution Category=Pure Vision Solution2024.10 | 32.4 | 32.5 | 28.5 | 28.4 | |
| MiniCPM-V 2.6 + VisRAG*(2p)#Param=10B, Token=1444, Solution Category=Pure Vision Solution2024.10 | 31.8 | 31 | 27.2 | 27.6 | |
| InternVL2+BGE-M3#Param=8.5B, Token=583, Solution Category=Plain Text Solution2024.10 | 29.8 | 29.8 | 28.3 | 50.2 | |
| InternVL2#Param=8B, Token=5008, Solution Category=Pure Vision Solution2024.10 | 29.4 | 33.1 | 35 | 35.5 | |
| IXC2-VL#Param=8B, Token=6217, Solution Category=Parsed Interleaved Text and Images2024.10 | 27.8 | 31.2 | 32.6 | 37.7 | |
| IXC2-VL#Param=8B, Token=4644, Solution Category=Plain Text Solution2024.10 | 27.4 | 30.8 | 32.8 | 37.6 | |
| IXC2-VL#Param=8B, Token=4712, Solution Category=Pure Vision Solution2024.10 | 27.1 | 24.8 | 25.1 | 20.5 | |
| InternVL2#Param=8B, Token=4051, Solution Category=Plain Text Solution2024.10 | 19.5 | 28 | 27.6 | 37.5 | |
| Hi-VT5#Param=0.3B, Token=11589, Solution Category=Pure Vision Solution2024.10 | 13.5 | 3.1 | 3.7 | 15.2 |