Table Question Answering on BirdQA
45.5Exact Match AccuracyTableRAG
Evaluation results
| Method | Links | |
|---|---|---|
| TableRAGLanguage Model=GPT 3.5 Turbo2024.10 | 45.5 | |
| TableRAGLanguage Model=Mistral Nemo2024.10 | 45.1 | |
| TableRAGLanguage Model=Gemini 1.0 Pro2024.10 | 44.2 | |
| ReadSchemaLanguage Model=GPT 3.5 Turbo2024.10 | 40.3 | |
| RowColRetrievalLanguage Model=GPT 3.5 Turbo2024.10 | 39.6 | |
| RowColRetrievalLanguage Model=Mistral Nemo2024.10 | 36.4 | |
| ReadSchemaLanguage Model=Mistral Nemo2024.10 | 35.7 | |
| RandRowSamplingLanguage Model=GPT 3.5 Turbo2024.10 | 34.7 | |
| RandRowSamplingLanguage Model=Mistral Nemo2024.10 | 33.4 | |
| ReadSchemaLanguage Model=Gemini 1.0 Pro2024.10 | 31.8 | |
| RandRowSamplingLanguage Model=Gemini 1.0 Pro2024.10 | 25.3 | |
| RowColRetrievalLanguage Model=Gemini 1.0 Pro2024.10 | 21.8 | |
| ReadTableLanguage Model=GPT 3.5 Turbo2024.10 | 9.1 | |
| ReadTableLanguage Model=Mistral Nemo2024.10 | 8.4 | |
| ReadTableLanguage Model=Gemini 1.0 Pro2024.10 | 4.9 |