Question Answering on TAT-QA
75.7AccuracyRELOOP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RELOOPAggregation Metric=best2025.10 | 75.7 | 83.5 | |
| RELOOPAggregation Metric=median2025.10 | 73.2 | 79.6 | |
| TAT-LLMTask Specialization=Table task2025.10 | 73.1 | 81 | |
| HippoRAGTask Specialization=Table + text2025.10 | 70.1 | 74.9 | |
| TableRAGTask Specialization=Table task2025.10 | 61.9 | 68.6 | |
| Falcon-H1-7B-InstructCategory=LLM-only (direct QA)2025.10 | 43.7 | — | |
| Qwen3-4B-Instruct-2507Category=LLM-only (direct QA)2025.10 | 42.1 | — | |
| Llama-3.1-8B-InstructCategory=LLM-only (direct QA)2025.10 | 37.6 | — | |
| Falcon3-10B-instructCategory=LLM-only (direct QA)2025.10 | 35.2 | — |