# Logical Reasoning on RP LP Domain, Npred ≤ 30, δ ≤ 6 Source: [Logical Reasoning on RP LP Domain, Npred ≤ 30, δ ≤ 6]() Collection index: [llms.txt]() Data updated: 2026-05-07T06:55:46.229Z Evaluation of model performance on Logical Reasoning using the RP LP Domain subset constrained by Npred ≤ 30 and δ ≤ 6, measured by Accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Logical Reasoning | | Dataset (including any stated split) | RP LP Domain, Npred ≤ 30, δ ≤ 6 | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 26 of 26 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | direct w. L = 128 | 100 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 64 | 100 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 24 | 100 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 128 | 100 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 64 | 100 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 128 | 100 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 48 | 99.9 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 64 | 99.9 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 48 | 99.9 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 96 | 99.9 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 128 | 99.9 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 96 | 99.8 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 32 | 99.8 | Not recorded | 69fc1c725497b3b670c88433 | | cot (baseline) | 99.7 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 32 | 99.6 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 24 | 99.6 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 24 | 99.3 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 16 | 98.7 | Not recorded | 69fc1c725497b3b670c88433 | | cot (baseline) | 97.4 | Not recorded | 69fc1c725497b3b670c88433 | | direct (baseline) | 96.9 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 16 | 96.6 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. Nepochs = 60 | 96.5 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. Nepochs = 30 | 96 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. Nepochs = 60 | 87.2 | Not recorded | 69fc1c725497b3b670c88433 | | direct (baseline) | 85.7 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. Nepochs = 30 | 84 | Not recorded | 69fc1c725497b3b670c88433 | ### direct w. L = 128 Accuracy: 100. Result ID: 69fc368947f34ce924de82f9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"128"}. This record does not assert independent reproduction. ### cot w. L = 64 Accuracy: 100. Result ID: 69fc368947f34ce924de8301. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"64"}. This record does not assert independent reproduction. ### direct w. L = 24 Accuracy: 100. Result ID: 69fc368947f34ce924de8341. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"24"}. This record does not assert independent reproduction. ### direct w. L = 128 Accuracy: 100. Result ID: 69fc368947f34ce924de8342. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"128"}. This record does not assert independent reproduction. ### cot w. L = 64 Accuracy: 100. Result ID: 69fc368947f34ce924de8344. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"64"}. This record does not assert independent reproduction. ### cot w. L = 128 Accuracy: 100. Result ID: 69fc368947f34ce924de8345. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"128"}. This record does not assert independent reproduction. ### direct w. L = 48 Accuracy: 99.9. Result ID: 69fc368947f34ce924de82f6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"48"}. This record does not assert independent reproduction. ### direct w. L = 64 Accuracy: 99.9. Result ID: 69fc368947f34ce924de82f7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"64"}. This record does not assert independent reproduction. ### cot w. L = 48 Accuracy: 99.9. Result ID: 69fc368947f34ce924de8300. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"48"}. This record does not assert independent reproduction. ### cot w. L = 96 Accuracy: 99.9. Result ID: 69fc368947f34ce924de8302. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"96"}. This record does not assert independent reproduction. ### cot w. L = 128 Accuracy: 99.9. Result ID: 69fc368947f34ce924de8303. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"128"}. This record does not assert independent reproduction. ### direct w. L = 96 Accuracy: 99.8. Result ID: 69fc368947f34ce924de82f8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"96"}. This record does not assert independent reproduction. ### cot w. L = 32 Accuracy: 99.8. Result ID: 69fc368947f34ce924de82ff. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"32"}. This record does not assert independent reproduction. ### cot (baseline) Accuracy: 99.7. Result ID: 69fc368947f34ce924de8343. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT"}. This record does not assert independent reproduction. ### direct w. L = 32 Accuracy: 99.6. Result ID: 69fc368947f34ce924de82f5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"32"}. This record does not assert independent reproduction. ### cot w. L = 24 Accuracy: 99.6. Result ID: 69fc368947f34ce924de82fe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"24"}. This record does not assert independent reproduction. ### direct w. L = 24 Accuracy: 99.3. Result ID: 69fc368947f34ce924de82f4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"24"}. This record does not assert independent reproduction. ### cot w. L = 16 Accuracy: 98.7. Result ID: 69fc368947f34ce924de82fd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"16"}. This record does not assert independent reproduction. ### cot (baseline) Accuracy: 97.4. Result ID: 69fc368947f34ce924de82fa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT"}. This record does not assert independent reproduction. ### direct (baseline) Accuracy: 96.9. Result ID: 69fc368947f34ce924de8340. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct"}. This record does not assert independent reproduction. ### direct w. L = 16 Accuracy: 96.6. Result ID: 69fc368947f34ce924de82f3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"16"}. This record does not assert independent reproduction. ### cot w. Nepochs = 60 Accuracy: 96.5. Result ID: 69fc368947f34ce924de82fc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","N\_epochs":"60"}. This record does not assert independent reproduction. ### cot w. Nepochs = 30 Accuracy: 96. Result ID: 69fc368947f34ce924de82fb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","N\_epochs":"30"}. This record does not assert independent reproduction. ### direct w. Nepochs = 60 Accuracy: 87.2. Result ID: 69fc368947f34ce924de82f2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","N\_epochs":"60"}. This record does not assert independent reproduction. ### direct (baseline) Accuracy: 85.7. Result ID: 69fc368947f34ce924de82f0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct"}. This record does not assert independent reproduction. ### direct w. Nepochs = 30 Accuracy: 84. Result ID: 69fc368947f34ce924de82f1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","N\_epochs":"30"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.