# Logical Reasoning on RP LP Domain, Npred ≤ 30, 6 \< δ ≤ 12 Source: [Logical Reasoning on RP LP Domain, Npred ≤ 30, 6 \< δ ≤ 12]() Collection index: [llms.txt]() Data updated: 2026-05-07T06:55:46.285Z Evaluation of model performance on Logical Reasoning using the specific subset of the RP LP Domain defined by Npred ≤ 30 and 6 \< δ ≤ 12, measured by Accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Logical Reasoning | | Dataset (including any stated split) | RP LP Domain, Npred ≤ 30, 6 \< δ ≤ 12 | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 25 of 25 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | cot w. L = 64 | 99.5 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 128 | 99.5 | Not recorded | 69fc1c725497b3b670c88433 | | cot (baseline) | 98.8 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 64 | 98.3 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 128 | 98.3 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 96 | 96 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 48 | 93.9 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 128 | 93.2 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 32 | 92.3 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 24 | 91 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 128 | 90.9 | Not recorded | 69fc1c725497b3b670c88433 | | cot (baseline) | 87.1 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. Nepochs = 60 | 86 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. L = 16 | 83.5 | Not recorded | 69fc1c725497b3b670c88433 | | direct (baseline) | 82.8 | Not recorded | 69fc1c725497b3b670c88433 | | cot w. Nepochs = 30 | 82.6 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 64 | 81.8 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 96 | 77.8 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 48 | 76.2 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 32 | 72 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 24 | 70 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. Nepochs = 30 | 66.1 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. Nepochs = 60 | 64.6 | Not recorded | 69fc1c725497b3b670c88433 | | direct (baseline) | 62.7 | Not recorded | 69fc1c725497b3b670c88433 | | direct w. L = 16 | 60.3 | Not recorded | 69fc1c725497b3b670c88433 | ### cot w. L = 64 Accuracy: 99.5. Result ID: 69fc368947f34ce924de8349. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"64"}. This record does not assert independent reproduction. ### cot w. L = 128 Accuracy: 99.5. Result ID: 69fc368947f34ce924de834a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"128"}. This record does not assert independent reproduction. ### cot (baseline) Accuracy: 98.8. Result ID: 69fc368947f34ce924de8348. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT"}. This record does not assert independent reproduction. ### cot w. L = 64 Accuracy: 98.3. Result ID: 69fc368947f34ce924de8315. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"64"}. This record does not assert independent reproduction. ### cot w. L = 128 Accuracy: 98.3. Result ID: 69fc368947f34ce924de8317. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"128"}. This record does not assert independent reproduction. ### cot w. L = 96 Accuracy: 96. Result ID: 69fc368947f34ce924de8316. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"96"}. This record does not assert independent reproduction. ### cot w. L = 48 Accuracy: 93.9. Result ID: 69fc368947f34ce924de8314. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"48"}. This record does not assert independent reproduction. ### direct w. L = 128 Accuracy: 93.2. Result ID: 69fc368947f34ce924de830d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"128"}. This record does not assert independent reproduction. ### cot w. L = 32 Accuracy: 92.3. Result ID: 69fc368947f34ce924de8313. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"32"}. This record does not assert independent reproduction. ### cot w. L = 24 Accuracy: 91. Result ID: 69fc368947f34ce924de8312. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"24"}. This record does not assert independent reproduction. ### direct w. L = 128 Accuracy: 90.9. Result ID: 69fc368947f34ce924de8347. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"128"}. This record does not assert independent reproduction. ### cot (baseline) Accuracy: 87.1. Result ID: 69fc368947f34ce924de830e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT"}. This record does not assert independent reproduction. ### cot w. Nepochs = 60 Accuracy: 86. Result ID: 69fc368947f34ce924de8310. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","N\_epochs":"60"}. This record does not assert independent reproduction. ### cot w. L = 16 Accuracy: 83.5. Result ID: 69fc368947f34ce924de8311. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","Number of Layers":"16"}. This record does not assert independent reproduction. ### direct (baseline) Accuracy: 82.8. Result ID: 69fc368947f34ce924de8346. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct"}. This record does not assert independent reproduction. ### cot w. Nepochs = 30 Accuracy: 82.6. Result ID: 69fc368947f34ce924de830f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"CoT","N\_epochs":"30"}. This record does not assert independent reproduction. ### direct w. L = 64 Accuracy: 81.8. Result ID: 69fc368947f34ce924de830b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"64"}. This record does not assert independent reproduction. ### direct w. L = 96 Accuracy: 77.8. Result ID: 69fc368947f34ce924de830c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"96"}. This record does not assert independent reproduction. ### direct w. L = 48 Accuracy: 76.2. Result ID: 69fc368947f34ce924de830a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"48"}. This record does not assert independent reproduction. ### direct w. L = 32 Accuracy: 72. Result ID: 69fc368947f34ce924de8309. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"32"}. This record does not assert independent reproduction. ### direct w. L = 24 Accuracy: 70. Result ID: 69fc368947f34ce924de8308. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"24"}. This record does not assert independent reproduction. ### direct w. Nepochs = 30 Accuracy: 66.1. Result ID: 69fc368947f34ce924de8305. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","N\_epochs":"30"}. This record does not assert independent reproduction. ### direct w. Nepochs = 60 Accuracy: 64.6. Result ID: 69fc368947f34ce924de8306. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","N\_epochs":"60"}. This record does not assert independent reproduction. ### direct (baseline) Accuracy: 62.7. Result ID: 69fc368947f34ce924de8304. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct"}. This record does not assert independent reproduction. ### direct w. L = 16 Accuracy: 60.3. Result ID: 69fc368947f34ce924de8307. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Reasoning Strategy":"Direct","Number of Layers":"16"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.