Document Extraction on Dataset C2 Finance domain (test)
73.3F1-scoreGemini 2.0 Pro
Evaluation Results
| Method | Links | |
|---|---|---|
| Gemini 2.0 ProInput Format=Image-only2026.03 | 73.3 | |
| Gemini 2.0 ProInput Format=Image + OCR2026.03 | 73.2 | |
| Claude 3.5 SonnetInput Format=OCR-only2026.03 | 72.6 | |
| Gemini 2.5 FlashInput Format=Image + OCR2026.03 | 71.4 | |
| Pixtral Large (2411)Input Format=OCR-only2026.03 | 71.2 | |
| Gemini 2.5 FlashInput Format=Image-only2026.03 | 71.2 | |
| GPT-4o miniInput Format=OCR-only2026.03 | 70.5 | |
| GPT-4o miniInput Format=Image + OCR2026.03 | 70.5 | |
| Llama 4 ScoutInput Format=Image + OCR2026.03 | 69.8 | |
| Gemini 1.5 ProInput Format=OCR-only2026.03 | 69.8 | |
| Llama 4 ScoutInput Format=OCR-only2026.03 | 69.7 | |
| Claude 3.5 SonnetInput Format=Image + OCR2026.03 | 69.6 | |
| Gemini 2.5 FlashInput Format=OCR-only2026.03 | 69.6 | |
| GPT-4oInput Format=OCR-only2026.03 | 69.5 | |
| Gemini 2.0 ProInput Format=OCR-only2026.03 | 69.5 | |
| Llama 4 ScoutInput Format=Image-only2026.03 | 69.3 | |
| GPT-4oInput Format=Image + OCR2026.03 | 69.3 | |
| Claude 3.5 SonnetInput Format=Image-only2026.03 | 69.3 | |
| Claude 3 OpusInput Format=Image + OCR2026.03 | 69.1 | |
| GPT-4oInput Format=Image-only2026.03 | 68.9 | |
| Llama 4 MaverickInput Format=Image-only2026.03 | 68.2 | |
| Llama 4 MaverickInput Format=Image + OCR2026.03 | 68.2 | |
| Claude 3 OpusInput Format=OCR-only2026.03 | 68.2 | |
| Llama 4 MaverickInput Format=OCR-only2026.03 | 68.1 | |
| Pixtral Large (2411)Input Format=Image + OCR2026.03 | 68 | |
| Nova ProInput Format=Image + OCR2026.03 | 66.6 | |
| Gemini 1.5 ProInput Format=Image-only2026.03 | 66.4 | |
| Nova ProInput Format=Image-only2026.03 | 65.1 | |
| Nova ProInput Format=OCR-only2026.03 | 65.1 | |
| Gemini 1.5 ProInput Format=Image + OCR2026.03 | 65 | |
| GPT-4o miniInput Format=Image-only2026.03 | 64.9 | |
| Pixtral Large (2411)Input Format=Image-only2026.03 | 57.4 | |
| Claude 3 OpusInput Format=Image-only2026.03 | 56.4 |