# Symbolic Chain of Thought Reasoning on TableBench

Source: [Symbolic Chain of Thought Reasoning on TableBench](<https://www.sota2.com/research/sota/symbolic-chain-of-thought-reasoning-on-tablebench>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:02:19.020Z

Evaluation of model performance on the TableBench dataset specifically for Symbolic Chain of Thought Reasoning tasks, measured by Rge.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Symbolic Chain of Thought Reasoning |
| Dataset (including any stated split) | TableBench |
| Metric | Rge |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 13 of 13 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Rge](<https://www.sota2.com/research/sota/symbolic-chain-of-thought-reasoning-on-tablebench.md?metric=Rge>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Rge | Result date | Report paper |
| --- | --- | --- | --- |
| TableLLM | 1.99 | Not recorded | 694b737b53fdd5c3617399cd |
| Llama-3.1-8B | 21.94 | Not recorded | 694b737b53fdd5c3617399cd |
| Table-R1-Zero-7B | 28.89 | Not recorded | 694b737b53fdd5c3617399cd |
| TableGPT2-7B | 40.7 | Not recorded | 694b737b53fdd5c3617399cd |
| GPT-4o | 41.43 | Not recorded | 694b737b53fdd5c3617399cd |
| Qwen3-8B | 41.86 | Not recorded | 694b737b53fdd5c3617399cd |
| Qwen-Plus | 44.06 | Not recorded | 694b737b53fdd5c3617399cd |
| QwQ-32B | 44.84 | Not recorded | 694b737b53fdd5c3617399cd |
| Qwen3-72B | 45.68 | Not recorded | 694b737b53fdd5c3617399cd |
| Qwen3-14B | 47.36 | Not recorded | 694b737b53fdd5c3617399cd |
| Qwen3-32B | 47.47 | Not recorded | 694b737b53fdd5c3617399cd |
| TableGPT-R1-8B | 49.53 | Not recorded | 694b737b53fdd5c3617399cd |
| DeepSeek-V3 | 50.11 | Not recorded | 694b737b53fdd5c3617399cd |

### TableLLM

Rge: 1.99. Result ID: 699943eb5698665ec4ae0281.

[Reporting paper](<https://www.sota2.com/research/paper/694b737b53fdd5c3617399cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77771e209131cea734e9.md>)

Recorded evaluation configuration: {"Model Scale Group":"Comparable"}. This record does not assert independent reproduction.

### Llama-3.1-8B

Rge: 21.94. Result ID: 699943eb5698665ec4ae0282.

[Reporting paper](<https://www.sota2.com/research/paper/694b737b53fdd5c3617399cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d11e209131cea6a028.md>)

[Implementation](<https://github.com/meta-llama/llama-agentic-system>)

Recorded evaluation configuration: {"Model Scale Group":"Comparable"}. This record does not assert independent reproduction.

### Table-R1-Zero-7B

Rge: 28.89. Result ID: 699943eb5698665ec4ae0283.

[Reporting paper](<https://www.sota2.com/research/paper/694b737b53fdd5c3617399cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ba61e209131cea89a3e.md>)

Recorded evaluation configuration: {"Model Scale Group":"Comparable"}. This record does not assert independent reproduction.

### TableGPT2-7B

Rge: 40.7. Result ID: 699943eb5698665ec4ae0284.

[Reporting paper](<https://www.sota2.com/research/paper/694b737b53fdd5c3617399cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa759d1e209131cea68f7b.md>)

Recorded evaluation configuration: {"Model Scale Group":"Comparable"}. This record does not assert independent reproduction.

### GPT-4o

Rge: 41.43. Result ID: 699943eb5698665ec4ae028a.

[Reporting paper](<https://www.sota2.com/research/paper/694b737b53fdd5c3617399cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75681e209131cea67a98.md>)

Recorded evaluation configuration: {"Model Scale Group":"Larger"}. This record does not assert independent reproduction.

### Qwen3-8B

Rge: 41.86. Result ID: 699943eb5698665ec4ae0280.

[Reporting paper](<https://www.sota2.com/research/paper/694b737b53fdd5c3617399cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Model Scale Group":"Comparable"}. This record does not assert independent reproduction.

### Qwen-Plus

Rge: 44.06. Result ID: 699943eb5698665ec4ae028c.

[Reporting paper](<https://www.sota2.com/research/paper/694b737b53fdd5c3617399cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Model Scale Group":"Larger"}. This record does not assert independent reproduction.

### QwQ-32B

Rge: 44.84. Result ID: 699943eb5698665ec4ae0289.

[Reporting paper](<https://www.sota2.com/research/paper/694b737b53fdd5c3617399cd.md>)

Recorded evaluation configuration: {"Model Scale Group":"Larger"}. This record does not assert independent reproduction.

### Qwen3-72B

Rge: 45.68. Result ID: 699943eb5698665ec4ae0288.

[Reporting paper](<https://www.sota2.com/research/paper/694b737b53fdd5c3617399cd.md>)

Recorded evaluation configuration: {"Model Scale Group":"Larger"}. This record does not assert independent reproduction.

### Qwen3-14B

Rge: 47.36. Result ID: 699943eb5698665ec4ae0286.

[Reporting paper](<https://www.sota2.com/research/paper/694b737b53fdd5c3617399cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Model Scale Group":"Larger"}. This record does not assert independent reproduction.

### Qwen3-32B

Rge: 47.47. Result ID: 699943eb5698665ec4ae0287.

[Reporting paper](<https://www.sota2.com/research/paper/694b737b53fdd5c3617399cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Model Scale Group":"Larger"}. This record does not assert independent reproduction.

### TableGPT-R1-8B

Rge: 49.53. Result ID: 699943eb5698665ec4ae0285.

[Reporting paper](<https://www.sota2.com/research/paper/694b737b53fdd5c3617399cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694b737b53fdd5c3617399cd.md>)

Recorded evaluation configuration: {"Model Scale Group":"Comparable"}. This record does not assert independent reproduction.

### DeepSeek-V3

Rge: 50.11. Result ID: 699943eb5698665ec4ae028b.

[Reporting paper](<https://www.sota2.com/research/paper/694b737b53fdd5c3617399cd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77001e209131cea7066a.md>)

Recorded evaluation configuration: {"Model Scale Group":"Larger"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
