Key Information Extraction on RealKIE FCC Verified
79.91Extraction ScoreClaude Sonnet 4.5
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Claude Sonnet 4.5OCR=true, Image=true2026.02 | 79.91 | 1 | 7.18 | 0 | |
| Claude Sonnet 4.5OCR=true, Image=false2026.02 | 79.14 | 2 | 5.56 | 0 | |
| Claude Opus 4.5OCR=false, Image=true2026.02 | 78.6 | 2 | 7.71 | 0 | |
| Qwen3-VLOCR=true, Image=true2026.02 | 78.05 | 3 | 1.9 | 4 | |
| Claude Opus 4.5OCR=true, Image=true2026.02 | 78.04 | 2 | 10.26 | 0 | |
| Claude Opus 4.5OCR=true, Image=false2026.02 | 77.82 | 2 | 7.28 | 0 | |
| Claude Haiku 4.5OCR=true, Image=true2026.02 | 77.82 | 1 | 3.39 | 1 | |
| Gemma-3OCR=true, Image=true2026.02 | 76.94 | 2 | 1.35 | 4 | |
| Qwen3-VLOCR=true, Image=false2026.02 | 76.5 | 2 | 2.08 | 0 | |
| Gemma-3OCR=true, Image=false2026.02 | 76.36 | 3 | 1.64 | 0 | |
| Claude Haiku 4.5OCR=true, Image=false2026.02 | 75.54 | 1 | 2.83 | 1 | |
| Qwen3-VLOCR=false, Image=true2026.02 | 74.5 | 200 | 1.71 | 4 | |
| Claude Sonnet 4.5OCR=false, Image=true2026.02 | 72.95 | 1 | 5.49 | 0 | |
| Claude Haiku 4.5OCR=false, Image=true2026.02 | 66.8 | 1 | 2.82 | 0 | |
| Gemma-3OCR=false, Image=true2026.02 | 53.59 | 200 | 1.36 | 5 |