Key Information Extraction on VRDU a.-b. (test)
88.8F1 ScoreDocLLM-7B
Evaluation results
| Method | Links | |
|---|---|---|
| DocLLM-7BModel Size=7B, Modality=Text+Layout, Evaluation Setting=SDDS2023.12 | 88.8 | |
| DocLLM-1BModel Size=1B, Modality=Text+Layout, Evaluation Setting=SDDS2023.12 | 87.6 | |
| GPT-4+OCRModel Size=~1T, Modality=Text, Evaluation Setting=Zero-Shot (ZS)2023.12 | 43.7 | |
| Llama2+OCRModel Size=7B, Modality=Text, Evaluation Setting=Zero-Shot (ZS)2023.12 | 18.7 |