# Classification on magic (F1 score) Source: [Classification on magic (F1 score)]() Collection index: [llms.txt]() Data updated: 2026-04-03T06:45:04.341Z Evaluation of Classification performance on the 'magic' dataset, measured using the F1 score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Classification | | Dataset (including any stated split) | magic | | Metric | F1 Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 26 of 26 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | F1 Score | Result date | Report paper | | --- | --- | --- | --- | | XGB | 86.69 | Not recorded | 68fa74901e209131cea628a1 | | RNS | 86.68 | Not recorded | 68fa74901e209131cea628a1 | | LGBM | 86.67 | Not recorded | 68fa74901e209131cea628a1 | | LORD | 86.52 | Not recorded | 68fa74901e209131cea628a1 | | RF | 86.48 | Not recorded | 68fa74901e209131cea628a1 | | RRL | 86.24 | Not recorded | 68fa74901e209131cea628a1 | | NODE | 86.2 | Not recorded | 68fa74901e209131cea628a1 | | FT | 85.95 | Not recorded | 68fa74901e209131cea628a1 | | SAINT | 85.46 | Not recorded | 68fa74901e209131cea628a1 | | TabNet | 85.08 | Not recorded | 68fa74901e209131cea628a1 | | VIME | 83.19 | Not recorded | 68fa74901e209131cea628a1 | | PLNN | 83.07 | Not recorded | 68fa74901e209131cea628a1 | | SBRL | 82.52 | Not recorded | 68fa74901e209131cea628a1 | | C4.5 | 82.44 | Not recorded | 68fa74901e209131cea628a1 | | CART | 81.2 | Not recorded | 68fa74901e209131cea628a1 | | TabTrans | 81.03 | Not recorded | 68fa74901e209131cea628a1 | | CRS | 80.87 | Not recorded | 68fa74901e209131cea628a1 | | BNN | 79.5 | Not recorded | 68fa74901e209131cea628a1 | | SVM | 79.43 | Not recorded | 68fa74901e209131cea628a1 | | DRNET | 79.26 | Not recorded | 68fa74901e209131cea628a1 | | KNN | 77.92 | Not recorded | 68fa74901e209131cea628a1 | | RIPPER | 77.92 | Not recorded | 68fa74901e209131cea628a1 | | CORELS | 77.37 | Not recorded | 68fa74901e209131cea628a1 | | PTURS | 76.18 | Not recorded | 68fa74901e209131cea628a1 | | LR | 75.72 | Not recorded | 68fa74901e209131cea628a1 | | STG | 68.38 | Not recorded | 68fa74901e209131cea628a1 | ### XGB F1 Score: 86.69. Result ID: 69cf61e347f34ce924b89ad8. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Interpretability":"Non-interpretable"}. This record does not assert independent reproduction. ### RNS F1 Score: 86.68. Result ID: 69cf61e347f34ce924b89ae5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Interpretability":"Interpretable"}. This record does not assert independent reproduction. ### LGBM F1 Score: 86.67. Result ID: 69cf61e347f34ce924b89ace. [Reporting paper]() Recorded evaluation configuration: {"Model Interpretability":"Non-interpretable"}. This record does not assert independent reproduction. ### LORD F1 Score: 86.52. Result ID: 69cf61e347f34ce924b89adf. [Reporting paper]() Recorded evaluation configuration: {"Model Interpretability":"Interpretable"}. This record does not assert independent reproduction. ### RF F1 Score: 86.48. Result ID: 69cf61e347f34ce924b89ad1. [Reporting paper]() Recorded evaluation configuration: {"Model Interpretability":"Non-interpretable"}. This record does not assert independent reproduction. ### RRL F1 Score: 86.24. Result ID: 69cf61e347f34ce924b89ae3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Interpretability":"Interpretable"}. This record does not assert independent reproduction. ### NODE F1 Score: 86.2. Result ID: 69cf61e347f34ce924b89acf. [Reporting paper]() Recorded evaluation configuration: {"Model Interpretability":"Non-interpretable"}. This record does not assert independent reproduction. ### FT F1 Score: 85.95. Result ID: 69cf61e347f34ce924b89acd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Interpretability":"Non-interpretable"}. This record does not assert independent reproduction. ### SAINT F1 Score: 85.46. Result ID: 69cf61e347f34ce924b89ad2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Interpretability":"Non-interpretable"}. This record does not assert independent reproduction. ### TabNet F1 Score: 85.08. Result ID: 69cf61e347f34ce924b89ad5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Interpretability":"Non-interpretable"}. This record does not assert independent reproduction. ### VIME F1 Score: 83.19. Result ID: 69cf61e347f34ce924b89ad7. [Reporting paper]() Recorded evaluation configuration: {"Model Interpretability":"Non-interpretable"}. This record does not assert independent reproduction. ### PLNN F1 Score: 83.07. Result ID: 69cf61e347f34ce924b89ad0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Interpretability":"Non-interpretable"}. This record does not assert independent reproduction. ### SBRL F1 Score: 82.52. Result ID: 69cf61e347f34ce924b89ae4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Interpretability":"Interpretable"}. This record does not assert independent reproduction. ### C4.5 F1 Score: 82.44. Result ID: 69cf61e347f34ce924b89ad9. [Reporting paper]() Recorded evaluation configuration: {"Model Interpretability":"Interpretable"}. This record does not assert independent reproduction. ### CART F1 Score: 81.2. Result ID: 69cf61e347f34ce924b89ada. [Reporting paper]() Recorded evaluation configuration: {"Model Interpretability":"Interpretable"}. This record does not assert independent reproduction. ### TabTrans F1 Score: 81.03. Result ID: 69cf61e347f34ce924b89ad6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Interpretability":"Non-interpretable"}. This record does not assert independent reproduction. ### CRS F1 Score: 80.87. Result ID: 69cf61e347f34ce924b89adc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Interpretability":"Interpretable"}. This record does not assert independent reproduction. ### BNN F1 Score: 79.5. Result ID: 69cf61e347f34ce924b89acc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Interpretability":"Non-interpretable"}. This record does not assert independent reproduction. ### SVM F1 Score: 79.43. Result ID: 69cf61e347f34ce924b89ad4. [Reporting paper]() Recorded evaluation configuration: {"Model Interpretability":"Non-interpretable"}. This record does not assert independent reproduction. ### DRNET F1 Score: 79.26. Result ID: 69cf61e347f34ce924b89add. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Interpretability":"Interpretable"}. This record does not assert independent reproduction. ### KNN F1 Score: 77.92. Result ID: 69cf61e347f34ce924b89ade. [Reporting paper]() Recorded evaluation configuration: {"Model Interpretability":"Interpretable"}. This record does not assert independent reproduction. ### RIPPER F1 Score: 77.92. Result ID: 69cf61e347f34ce924b89ae2. [Reporting paper]() Recorded evaluation configuration: {"Model Interpretability":"Interpretable"}. This record does not assert independent reproduction. ### CORELS F1 Score: 77.37. Result ID: 69cf61e347f34ce924b89adb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Interpretability":"Interpretable"}. This record does not assert independent reproduction. ### PTURS F1 Score: 76.18. Result ID: 69cf61e347f34ce924b89ae1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Interpretability":"Interpretable"}. This record does not assert independent reproduction. ### LR F1 Score: 75.72. Result ID: 69cf61e347f34ce924b89ae0. [Reporting paper]() Recorded evaluation configuration: {"Model Interpretability":"Interpretable"}. This record does not assert independent reproduction. ### STG F1 Score: 68.38. Result ID: 69cf61e347f34ce924b89ad3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Interpretability":"Non-interpretable"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.