# Logical Reasoning on RP LP Domain, Npred ≤ 60, δ ≤ 6 Source: [Logical Reasoning on RP LP Domain, Npred ≤ 60, δ ≤ 6]() Collection index: [llms.txt]() Data updated: 2026-05-07T06:55:46.335Z Evaluation of model performance on Logical Reasoning using the RP LP Domain subset constrained by Npred ≤ 60 and δ ≤ 6, measured by Accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Logical Reasoning | | Dataset (including any stated split) | RP LP Domain, Npred ≤ 60, δ ≤ 6 | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 25 of 25 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | cot w. L = 64 | 99.4 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 128 | 99.2 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 128 | 98.9 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 128 | 98.6 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 64 | 98.5 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 96 | 98.4 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 64 | 97.8 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 48 | 97.6 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 32 | 97.5 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 128 | 97 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 24 | 96.7 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 96 | 96.7 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 48 | 96.6 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 24 | 95.7 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 32 | 95.4 | Not recorded | 69fc1c725497b3b670c88433 | | cot (baseline) | 94.7 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 16 | 92.4 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 16 | 92.2 | Not recorded | 69fc1c725497b3b670c88433 | | direct (baseline) | 91.8 | Not recorded | 69fc1c725497b3b670c88433 | | cot (baseline) | 88.2 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. Nepochs = 60 | 85.3 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. Nepochs = 30 | 85.1 | Not recorded | 69fc1c725497b3b670c88433 | | direct (baseline) | 80.9 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. Nepochs = 30 | 78.3 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. Nepochs = 60 | 77.3 | Not recorded | 69fc1c725497b3b670c88433 | ### cot w. L = 64 Accuracy: 99.4. Result ID: 69fc368947f34ce924de834e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"64"}. This record does not assert independent reproduction. ### direct w. L = 128 Accuracy: 99.2. Result ID: 69fc368947f34ce924de834c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"128"}. This record does not assert independent reproduction. ### direct w. L = 128 Accuracy: 98.9. Result ID: 69fc368947f34ce924de8321. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"128"}. This record does not assert independent reproduction. ### cot w. L = 128 Accuracy: 98.6. Result ID: 69fc368947f34ce924de834f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"128"}. This record does not assert independent reproduction. ### direct w. L = 64 Accuracy: 98.5. Result ID: 69fc368947f34ce924de831f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"64"}. This record does not assert independent reproduction. ### direct w. L = 96 Accuracy: 98.4. Result ID: 69fc368947f34ce924de8320. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"96"}. This record does not assert independent reproduction. ### cot w. L = 64 Accuracy: 97.8. Result ID: 69fc368947f34ce924de8329. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"64"}. This record does not assert independent reproduction. ### direct w. L = 48 Accuracy: 97.6. Result ID: 69fc368947f34ce924de831e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"48"}. This record does not assert independent reproduction. ### direct w. L = 32 Accuracy: 97.5. Result ID: 69fc368947f34ce924de831d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"32"}. This record does not assert independent reproduction. ### cot w. L = 128 Accuracy: 97. Result ID: 69fc368947f34ce924de832b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"128"}. This record does not assert independent reproduction. ### direct w. L = 24 Accuracy: 96.7. Result ID: 69fc368947f34ce924de831c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"24"}. This record does not assert independent reproduction. ### cot w. L = 96 Accuracy: 96.7. Result ID: 69fc368947f34ce924de832a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"96"}. This record does not assert independent reproduction. ### cot w. L = 48 Accuracy: 96.6. Result ID: 69fc368947f34ce924de8328. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"48"}. This record does not assert independent reproduction. ### cot w. L = 24 Accuracy: 95.7. Result ID: 69fc368947f34ce924de8326. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"24"}. This record does not assert independent reproduction. ### cot w. L = 32 Accuracy: 95.4. Result ID: 69fc368947f34ce924de8327. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"32"}. This record does not assert independent reproduction. ### cot (baseline) Accuracy: 94.7. Result ID: 69fc368947f34ce924de834d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT"}. This record does not assert independent reproduction. ### cot w. L = 16 Accuracy: 92.4. Result ID: 69fc368947f34ce924de8325. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"16"}. This record does not assert independent reproduction. ### direct w. L = 16 Accuracy: 92.2. Result ID: 69fc368947f34ce924de831b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"16"}. This record does not assert independent reproduction. ### direct (baseline) Accuracy: 91.8. Result ID: 69fc368947f34ce924de834b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct"}. This record does not assert independent reproduction. ### cot (baseline) Accuracy: 88.2. Result ID: 69fc368947f34ce924de8322. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT"}. This record does not assert independent reproduction. ### cot w. Nepochs = 60 Accuracy: 85.3. Result ID: 69fc368947f34ce924de8324. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","N\_epochs":"60"}. This record does not assert independent reproduction. ### cot w. Nepochs = 30 Accuracy: 85.1. Result ID: 69fc368947f34ce924de8323. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","N\_epochs":"30"}. This record does not assert independent reproduction. ### direct (baseline) Accuracy: 80.9. Result ID: 69fc368947f34ce924de8318. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct"}. This record does not assert independent reproduction. ### direct w. Nepochs = 30 Accuracy: 78.3. Result ID: 69fc368947f34ce924de8319. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","N\_epochs":"30"}. This record does not assert independent reproduction. ### direct w. Nepochs = 60 Accuracy: 77.3. Result ID: 69fc368947f34ce924de831a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","N\_epochs":"60"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.