# Paper Classification on Fall paper classification corpus 2025 Source: [Paper Classification on Fall paper classification corpus 2025]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:05:55.878Z Evaluation of Paper Classification performance on the Fall paper classification corpus 2025 dataset, measured using standard classification metrics (Accuracy, Precision, Recall, F1). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Paper Classification | | Dataset (including any stated split) | Fall paper classification corpus 2025 | | Metric | TP (True Positives) | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [TP (True Positives)](): Higher is better; unit: SCALAR. - [FP (False Positives)](): Lower is better; unit: SCALAR. - [TN (True Negatives)](): Higher is better; unit: SCALAR. - [FN (False Negatives)](): Lower is better; unit: SCALAR. - [Accuracy](): Higher is better; unit: PERCENT. - [Precision](): Higher is better; unit: PERCENT. - [Recall](): Higher is better; unit: PERCENT. - [F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | TP (True Positives) | Result date | Report paper | | --- | --- | --- | --- | | Consensus (Open Large) | 88 | Not recorded | 68fa7c211e209131cea8c958 | | Consensus (Commercial) | 88 | Not recorded | 68fa7c211e209131cea8c958 | | Consensus (Best) | 88 | Not recorded | 68fa7c211e209131cea8c958 | | Consensus (All) | 88 | Not recorded | 68fa7c211e209131cea8c958 | | Llama 4 Scout | 86 | Not recorded | 68fa7c211e209131cea8c958 | | Llama 3.3 70B | 85 | Not recorded | 68fa7c211e209131cea8c958 | | GPT 5 Mini | 85 | Not recorded | 68fa7c211e209131cea8c958 | | GPT 5 Nano | 84 | Not recorded | 68fa7c211e209131cea8c958 | | Consensus (Open 8B) | 82 | Not recorded | 68fa7c211e209131cea8c958 | | DeepSeek R1 0528 8B | 80 | Not recorded | 68fa7c211e209131cea8c958 | | GPT 5 | 80 | Not recorded | 68fa7c211e209131cea8c958 | | Gemini 2.5 Flash | 79 | Not recorded | 68fa7c211e209131cea8c958 | | DeepSeek R1 0528 | 77 | Not recorded | 68fa7c211e209131cea8c958 | | GPT OSS 20B | 77 | Not recorded | 68fa7c211e209131cea8c958 | | Claude Sonnet 4.5 | 77 | Not recorded | 68fa7c211e209131cea8c958 | | Llama 3.1 8B | 72 | Not recorded | 68fa7c211e209131cea8c958 | | Qwen3 | 72 | Not recorded | 68fa7c211e209131cea8c958 | | Qwen3 8B | 56 | Not recorded | 68fa7c211e209131cea8c958 | ### Consensus (Open Large) TP (True Positives): 88. Result ID: 699aa7275698665ec433cd09. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Description":"Consensus between all large (\>8B) open models: DeepSeek R1 0528, GPT OSS 20B, Llama 4 Scout, Llama 3.3 70B, Qwen3"}. This record does not assert independent reproduction. ### Consensus (Commercial) TP (True Positives): 88. Result ID: 699aa7285698665ec433cd0a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Description":"Consensus between all commercial models: Claude Sonnet 4.5, Gemini 2.5 Flash, GPT 5 (Full/Mini/Nano)"}. This record does not assert independent reproduction. ### Consensus (Best) TP (True Positives): 88. Result ID: 699aa7285698665ec433cd0b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Description":"Consensus between best combination of models: GPT 5, Claude Sonnet 4.5, Llama 3.3 70B"}. This record does not assert independent reproduction. ### Consensus (All) TP (True Positives): 88. Result ID: 699aa7285698665ec433cd0c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Description":"Consensus between all 13 models"}. This record does not assert independent reproduction. ### Llama 4 Scout TP (True Positives): 86. Result ID: 699aa7275698665ec433cd00. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"\>8B"}. This record does not assert independent reproduction. ### Llama 3.3 70B TP (True Positives): 85. Result ID: 699aa7275698665ec433cd01. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"70B"}. This record does not assert independent reproduction. ### GPT 5 Mini TP (True Positives): 85. Result ID: 699aa7275698665ec433cd06. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### GPT 5 Nano TP (True Positives): 84. Result ID: 699aa7275698665ec433cd07. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Consensus (Open 8B) TP (True Positives): 82. Result ID: 699aa7275698665ec433cd08. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Description":"Consensus between all small (8B) open models: Llama 3.1 8B, DeepSeek R1 0528 8B, Qwen3 8B"}. This record does not assert independent reproduction. ### DeepSeek R1 0528 8B TP (True Positives): 80. Result ID: 699aa7275698665ec433ccfc. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"8B"}. This record does not assert independent reproduction. ### GPT 5 TP (True Positives): 80. Result ID: 699aa7275698665ec433cd05. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Gemini 2.5 Flash TP (True Positives): 79. Result ID: 699aa7275698665ec433cd04. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### DeepSeek R1 0528 TP (True Positives): 77. Result ID: 699aa7275698665ec433ccfe. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"\>8B"}. This record does not assert independent reproduction. ### GPT OSS 20B TP (True Positives): 77. Result ID: 699aa7275698665ec433ccff. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"20B"}. This record does not assert independent reproduction. ### Claude Sonnet 4.5 TP (True Positives): 77. Result ID: 699aa7275698665ec433cd03. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Llama 3.1 8B TP (True Positives): 72. Result ID: 699aa7275698665ec433ccfb. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"8B"}. This record does not assert independent reproduction. ### Qwen3 TP (True Positives): 72. Result ID: 699aa7275698665ec433cd02. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"\>8B"}. This record does not assert independent reproduction. ### Qwen3 8B TP (True Positives): 56. Result ID: 699aa7275698665ec433ccfd. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"8B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.