Layout prediction on NSR-1K numerical
97.55PrecisionGPT-4 (reference)
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| GPT-4 (reference)Model Size=>70B est.2024.03 | 97.55 | 98.41 | 97.98 | 93.41 | |
| Qwen3-8B + DivConModel Size=8B, Precision=INT42024.03 | 97.45 | 96.87 | 97.16 | 90.07 | |
| Mistral-7B + DivConModel Size=7B, Precision=INT42024.03 | 97.36 | 94.5 | 95.9 | 92.03 | |
| Mistral-7BModel Size=7B, Precision=FP162024.03 | 95.39 | 93.38 | 94.38 | 89.06 | |
| TinyLlama + DivConModel Size=1.1B, Precision=INT42024.03 | 93.45 | 89.21 | 91.28 | 75.99 | |
| Qwen3-4B + DivConModel Size=4B, Precision=FP162024.03 | 92.21 | 89.07 | 91.09 | 80.21 | |
| Qwen3-8BModel Size=8B, Precision=INT42024.03 | 91.86 | 92.04 | 91.95 | 86.89 | |
| TinyLlamaModel Size=1.1B, Precision=FP162024.03 | 90.38 | 87.46 | 88.89 | 70.77 | |
| Qwen3-4BModel Size=4B, Precision=FP162024.03 | 89.21 | 84.07 | 86.56 | 76.13 | |
| Phi-2 + DivConModel Size=2.7B, Precision=INT42024.03 | 87.61 | 96.05 | 91.63 | 80.1 | |
| Phi-2Model Size=2.7B, Precision=FP162024.03 | 83.35 | 95.63 | 89.07 | 66.52 |