Layout prediction on NSR-1K spatial
94.97AccuracyQwen3-8B + DivCon
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen3-8B + DivConModel Size=8B, Precision=INT42024.03 | 94.97 | |
| GPT-4 (reference)Model Size=>70B est.2024.03 | 94.68 | |
| Qwen3-8BModel Size=8B, Precision=INT42024.03 | 84.45 | |
| Mistral-7B + DivConModel Size=7B, Precision=INT42024.03 | 69.98 | |
| Mistral-7BModel Size=7B, Precision=FP162024.03 | 59.36 | |
| Qwen3-4B + DivConModel Size=4B, Precision=FP162024.03 | 59.34 | |
| Phi-2 + DivConModel Size=2.7B, Precision=INT42024.03 | 54.79 | |
| Qwen3-4BModel Size=4B, Precision=FP162024.03 | 49.66 | |
| Phi-2Model Size=2.7B, Precision=FP162024.03 | 39.58 | |
| TinyLlama + DivConModel Size=1.1B, Precision=INT42024.03 | 34.6 | |
| TinyLlamaModel Size=1.1B, Precision=FP162024.03 | 16.25 |