Table Understanding on MMTU (test)
33.9Overall PerformanceTAMA-QWen3
Evaluation results
| Method | Links | |
|---|---|---|
| TAMA-QWen3Training Corpora Size=2.6K, Base Model=QWen 3, Model Size=8B2025.01 | 33.9 | |
| QWen 3 8BTraining Corpora Size=N/A, Base Model=QWen 3, Model Size=8B2025.01 | 32.9 | |
| TableGPT2Training Corpora Size=2.38M, Base Model=QWen 2.5, Model Size=7B2025.01 | 30 | |
| Qwen2.5 7BTraining Corpora Size=N/A, Base Model=QWen 2.5, Model Size=7B2025.01 | 28.5 | |
| TAMA-QWen2.5Training Corpora Size=2.6K, Base Model=QWen 2.5, Model Size=7B2025.01 | 27.6 | |
| Table R1 ZeroTraining Corpora Size=48.6K, Base Model=LLAMA 3.1, Model Size=8B2025.01 | 26.6 | |
| LLaMA 3.1 8B InstructTraining Corpora Size=N/A, Base Model=LLAMA 3.1, Model Size=8B2025.01 | 25.3 | |
| TAMA-VBTraining Corpora Size=2.6K, Base Model=LLAMA 3.1, Model Size=8B2025.01 | 21.1 | |
| TAMA-VATraining Corpora Size=2.6K, Base Model=LLAMA 3.1, Model Size=8B2025.01 | 16.9 | |
| TableBenchLLMTraining Corpora Size=20K, Base Model=LLAMA 3.1, Model Size=8B2025.01 | 3.4 | |
| TableLLMTraining Corpora Size=309K, Base Model=CodeLLaMA, Model Size=7B2025.01 | 2.5 | |
| TableLLaMATraining Corpora Size=2M, Base Model=LongLoRA, Model Size=7B2025.01 | 0 |