# Logic Reasoning on Autologic en

Source: [Logic Reasoning on Autologic en](<https://www.sota2.com/research/sota/logic-reasoning-on-autologic-en>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:03:51.735Z

Evaluation of model performance on the Logic Reasoning task using the Autologic en dataset, measured by Score.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Logic Reasoning |
| Dataset (including any stated split) | Autologic en |
| Metric | Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Score](<https://www.sota2.com/research/sota/logic-reasoning-on-autologic-en.md?metric=Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Score | Result date | Report paper |
| --- | --- | --- | --- |
| DARL | 0.439 | Not recorded | 6971af09e25ad2fa9d1ed9a3 |
| DARL | 0.42 | Not recorded | 6971af09e25ad2fa9d1ed9a3 |
| Qwen2.5-7B-Inst | 0.406 | Not recorded | 6971af09e25ad2fa9d1ed9a3 |
| VeriFree | 0.395 | Not recorded | 6971af09e25ad2fa9d1ed9a3 |
| RLPR | 0.349 | Not recorded | 6971af09e25ad2fa9d1ed9a3 |
| RLPR | 0.319 | Not recorded | 6971af09e25ad2fa9d1ed9a3 |
| SimpleRL-Zoo | 0.312 | Not recorded | 6971af09e25ad2fa9d1ed9a3 |
| General Reasoner | 0.29 | Not recorded | 6971af09e25ad2fa9d1ed9a3 |
| Llama3.1-8B-Inst | 0.251 | Not recorded | 6971af09e25ad2fa9d1ed9a3 |
| RLVR | 0.224 | Not recorded | 6971af09e25ad2fa9d1ed9a3 |
| RLVR | 0.202 | Not recorded | 6971af09e25ad2fa9d1ed9a3 |
| Oat-Zero | 0.191 | Not recorded | 6971af09e25ad2fa9d1ed9a3 |
| SimpleRL-Zoo | 0.144 | Not recorded | 6971af09e25ad2fa9d1ed9a3 |
| TTRL | 0.128 | Not recorded | 6971af09e25ad2fa9d1ed9a3 |
| Qwen2.5-7B | 0.084 | Not recorded | 6971af09e25ad2fa9d1ed9a3 |
| PRIME | 0.012 | Not recorded | 6971af09e25ad2fa9d1ed9a3 |

### DARL

Score: 0.439. Result ID: 699677305698665ec4beaf22.

[Reporting paper](<https://www.sota2.com/research/paper/6971af09e25ad2fa9d1ed9a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6971af09e25ad2fa9d1ed9a3.md>)

Recorded evaluation configuration: {"Base":"Base","Verifier":"✗"}. This record does not assert independent reproduction.

### DARL

Score: 0.42. Result ID: 699677305698665ec4beaf16.

[Reporting paper](<https://www.sota2.com/research/paper/6971af09e25ad2fa9d1ed9a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6971af09e25ad2fa9d1ed9a3.md>)

Recorded evaluation configuration: {"Base":"Inst","Verifier":"✗"}. This record does not assert independent reproduction.

### Qwen2.5-7B-Inst

Score: 0.406. Result ID: 699677305698665ec4beaf18.

[Reporting paper](<https://www.sota2.com/research/paper/6971af09e25ad2fa9d1ed9a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa767e1e209131cea6d6a7.md>)

Recorded evaluation configuration: {"Base":"Base","Verifier":"-"}. This record does not assert independent reproduction.

### VeriFree

Score: 0.395. Result ID: 699677305698665ec4beaf20.

[Reporting paper](<https://www.sota2.com/research/paper/6971af09e25ad2fa9d1ed9a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78d11e209131cea7a946.md>)

Recorded evaluation configuration: {"Base":"Base","Verifier":"✗"}. This record does not assert independent reproduction.

### RLPR

Score: 0.349. Result ID: 699677305698665ec4beaf15.

[Reporting paper](<https://www.sota2.com/research/paper/6971af09e25ad2fa9d1ed9a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa798f1e209131cea7e388.md>)

Recorded evaluation configuration: {"Base":"Inst","Verifier":"✗"}. This record does not assert independent reproduction.

### RLPR

Score: 0.319. Result ID: 699677305698665ec4beaf21.

[Reporting paper](<https://www.sota2.com/research/paper/6971af09e25ad2fa9d1ed9a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa798f1e209131cea7e388.md>)

Recorded evaluation configuration: {"Base":"Base","Verifier":"✗"}. This record does not assert independent reproduction.

### SimpleRL-Zoo

Score: 0.312. Result ID: 699677305698665ec4beaf1d.

[Reporting paper](<https://www.sota2.com/research/paper/6971af09e25ad2fa9d1ed9a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a721e209131cea8345b.md>)

Recorded evaluation configuration: {"Base":"Base","Verifier":"Rule"}. This record does not assert independent reproduction.

### General Reasoner

Score: 0.29. Result ID: 699677305698665ec4beaf1f.

[Reporting paper](<https://www.sota2.com/research/paper/6971af09e25ad2fa9d1ed9a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa793e1e209131cea7cd45.md>)

Recorded evaluation configuration: {"Base":"Base","Verifier":"Model"}. This record does not assert independent reproduction.

### Llama3.1-8B-Inst

Score: 0.251. Result ID: 699677305698665ec4beaf13.

[Reporting paper](<https://www.sota2.com/research/paper/6971af09e25ad2fa9d1ed9a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d11e209131cea6a028.md>)

[Implementation](<https://github.com/meta-llama/llama-agentic-system>)

Recorded evaluation configuration: {"Base":"Inst","Verifier":"-"}. This record does not assert independent reproduction.

### RLVR

Score: 0.224. Result ID: 699677305698665ec4beaf1e.

[Reporting paper](<https://www.sota2.com/research/paper/6971af09e25ad2fa9d1ed9a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa770a1e209131cea70ace.md>)

Recorded evaluation configuration: {"Base":"Base","Verifier":"Rule"}. This record does not assert independent reproduction.

### RLVR

Score: 0.202. Result ID: 699677305698665ec4beaf14.

[Reporting paper](<https://www.sota2.com/research/paper/6971af09e25ad2fa9d1ed9a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa770a1e209131cea70ace.md>)

Recorded evaluation configuration: {"Base":"Inst","Verifier":"Rule"}. This record does not assert independent reproduction.

### Oat-Zero

Score: 0.191. Result ID: 699677305698665ec4beaf19.

[Reporting paper](<https://www.sota2.com/research/paper/6971af09e25ad2fa9d1ed9a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7be51e209131cea8b201.md>)

Recorded evaluation configuration: {"Base":"Math","Verifier":"Rule"}. This record does not assert independent reproduction.

### SimpleRL-Zoo

Score: 0.144. Result ID: 699677305698665ec4beaf1b.

[Reporting paper](<https://www.sota2.com/research/paper/6971af09e25ad2fa9d1ed9a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a721e209131cea8345b.md>)

Recorded evaluation configuration: {"Base":"Math","Verifier":"Rule"}. This record does not assert independent reproduction.

### TTRL

Score: 0.128. Result ID: 699677305698665ec4beaf1c.

[Reporting paper](<https://www.sota2.com/research/paper/6971af09e25ad2fa9d1ed9a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79ce1e209131cea7f7aa.md>)

Recorded evaluation configuration: {"Base":"Base","Verifier":"Rule"}. This record does not assert independent reproduction.

### Qwen2.5-7B

Score: 0.084. Result ID: 699677305698665ec4beaf17.

[Reporting paper](<https://www.sota2.com/research/paper/6971af09e25ad2fa9d1ed9a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa767e1e209131cea6d6a7.md>)

Recorded evaluation configuration: {"Base":"-","Verifier":"-"}. This record does not assert independent reproduction.

### PRIME

Score: 0.012. Result ID: 699677305698665ec4beaf1a.

[Reporting paper](<https://www.sota2.com/research/paper/6971af09e25ad2fa9d1ed9a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b9f1e209131cea8965d.md>)

Recorded evaluation configuration: {"Base":"Math","Verifier":"Rule"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
