Table Extraction on 100 pages (451 tables) synthetic (test)
9.55LLM Score (Overall)Gemini 3 Pro
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Gemini 3 ProInference=API, Cost / Time=$10.002026.03 | 9.55 | 9.58 | 9.57 | 9.49 | 85 | |
| Gemini 3 FlashInference=API, Cost / Time=$0.572026.03 | 9.5 | 9.53 | 9.38 | 9.61 | 85 | |
| LightOnOCR-2-1BInference=GPU, Cost / Time=30 min2026.03 | 9.08 | 9.41 | 8.9 | 8.91 | 83 | |
| Mistral OCR 3Inference=API, Cost / Time=$0.202026.03 | 8.89 | 8.92 | 8.69 | 9.07 | 88 | |
| dots.ocrInference=GPU, Cost / Time=20 min2026.03 | 8.73 | 9.01 | 8.43 | 8.76 | 81 | |
| MathpixInference=API, Cost / Time=$0.35–0.502026.03 | 8.53 | 9.32 | 8.4 | 7.77 | 74 | |
| ChandraInference=GPU, Cost / Time=4 h2026.03 | 8.43 | 8.96 | 8.14 | 8.15 | 77 | |
| Qwen3-VL-235BInference=API/GPU, Cost / Time=$0.202026.03 | 8.43 | 9.23 | 8.27 | 7.67 | 78 | |
| MonkeyOCR-3BInference=GPU, Cost / Time=20 min2026.03 | 8.39 | 8.6 | 8.1 | 8.47 | 80 | |
| GLM-4.5VInference=API, Cost / Time=$0.602026.03 | 7.98 | 9.19 | 7.59 | 7 | 78 | |
| GPT-5 miniInference=API, Cost / Time=$1.002026.03 | 7.14 | 8.03 | 6.82 | 6.48 | 68 | |
| Claude Sonnet 4.6Inference=API, Cost / Time=$3.002026.03 | 7.02 | 6.94 | 7.1 | 7.01 | 63 | |
| Nanonets-OCR-sInference=GPU, Cost / Time=50 min2026.03 | 6.92 | 8.27 | 6.51 | 5.82 | 69 | |
| Gemini 2.5 FlashInference=API, Cost / Time=$0.402026.03 | 6.85 | 7.93 | 6.52 | 5.94 | 72 | |
| MinerU2.5Inference=API/GPU2026.03 | 6.49 | 7.07 | 6.03 | 6.35 | 78 | |
| GPT-5 nanoInference=API, Cost / Time=$0.352026.03 | 6.48 | 7.63 | 6.18 | 5.47 | 32 | |
| DeepSeek-OCRInference=GPU, Cost / Time=4 min2026.03 | 5.75 | 7.45 | 5.34 | 4.2 | 66 | |
| PyMuPDF4LLMInference=CPU, Cost / Time=30 s2026.03 | 5.25 | 6.78 | 4.86 | 3.91 | — | |
| GOT-OCR2.0Inference=GPU, Cost / Time=20 min2026.03 | 5.13 | 5.89 | 4.95 | 4.45 | 58 | |
| olmOCR-2-7BInference=GPU, Cost / Time=25 min2026.03 | 4.05 | 4.64 | 3.78 | 3.68 | 35 | |
| GROBIDInference=CPU, Cost / Time=2 min2026.03 | 2.1 | 2.27 | 1.94 | 2.09 | — |