# Classification on Temporal heterogeneity synthetic datasets Source: [Classification on Temporal heterogeneity synthetic datasets]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:51:50.184Z Evaluation of Classification performance on the Temporal heterogeneity synthetic datasets, measured by Mean accuracy and Worst accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Classification | | Dataset (including any stated split) | Temporal heterogeneity synthetic datasets | | Metric | Mean Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 30 of 30 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Mean Accuracy](): Higher is better; unit: PERCENT. - [Worst Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Mean Accuracy | Result date | Report paper | | --- | --- | --- | --- | | IRM | 87.57 | Not recorded | 68fa6da51e209131cea3b25c | | ZIN | 87.5 | Not recorded | 68fa6da51e209131cea3b25c | | IRM | 86.57 | Not recorded | 68fa6da51e209131cea3b25c | | ZIN | 86.35 | Not recorded | 68fa6da51e209131cea3b25c | | IRM | 83.99 | Not recorded | 68fa6da51e209131cea3b25c | | ZIN | 83.71 | Not recorded | 68fa6da51e209131cea3b25c | | IRM | 77.99 | Not recorded | 68fa6da51e209131cea3b25c | | ZIN | 77.85 | Not recorded | 68fa6da51e209131cea3b25c | | IRM | 77 | Not recorded | 68fa6da51e209131cea3b25c | | ZIN | 76.79 | Not recorded | 68fa6da51e209131cea3b25c | | ERM | 75.37 | Not recorded | 68fa6da51e209131cea3b25c | | IRM | 73.84 | Not recorded | 68fa6da51e209131cea3b25c | | ZIN | 73.55 | Not recorded | 68fa6da51e209131cea3b25c | | EIIL | 70.1 | Not recorded | 68fa6da51e209131cea3b25c | | ERM | 68.72 | Not recorded | 68fa6da51e209131cea3b25c | | EIIL | 68.36 | Not recorded | 68fa6da51e209131cea3b25c | | EIIL | 64.89 | Not recorded | 68fa6da51e209131cea3b25c | | EIIL | 61.99 | Not recorded | 68fa6da51e209131cea3b25c | | ERM | 60.61 | Not recorded | 68fa6da51e209131cea3b25c | | ERM | 59.65 | Not recorded | 68fa6da51e209131cea3b25c | | ERM | 55.9 | Not recorded | 68fa6da51e209131cea3b25c | | ERM | 52.85 | Not recorded | 68fa6da51e209131cea3b25c | | EIIL | 50.77 | Not recorded | 68fa6da51e209131cea3b25c | | HRM | 50.01 | Not recorded | 68fa6da51e209131cea3b25c | | HRM | 50 | Not recorded | 68fa6da51e209131cea3b25c | | HRM | 50 | Not recorded | 68fa6da51e209131cea3b25c | | HRM | 50 | Not recorded | 68fa6da51e209131cea3b25c | | HRM | 49.99 | Not recorded | 68fa6da51e209131cea3b25c | | HRM | 49.98 | Not recorded | 68fa6da51e209131cea3b25c | | EIIL | 38.41 | Not recorded | 68fa6da51e209131cea3b25c | ### IRM Mean Accuracy: 87.57. Result ID: 698fcd073a6c314849fbf464. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Env Partition":"Yes","ps(t)":"0.999, 0.7","pv":"0.9"}. This record does not assert independent reproduction. ### ZIN Mean Accuracy: 87.5. Result ID: 698fcd073a6c314849fbf45e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.7","pv":"0.9"}. This record does not assert independent reproduction. ### IRM Mean Accuracy: 86.57. Result ID: 698fcd073a6c314849fbf466. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Env Partition":"Yes","ps(t)":"0.999, 0.8","pv":"0.9"}. This record does not assert independent reproduction. ### ZIN Mean Accuracy: 86.35. Result ID: 698fcd073a6c314849fbf460. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.8","pv":"0.9"}. This record does not assert independent reproduction. ### IRM Mean Accuracy: 83.99. Result ID: 698fcd073a6c314849fbf468. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Env Partition":"Yes","ps(t)":"0.999, 0.9","pv":"0.9"}. This record does not assert independent reproduction. ### ZIN Mean Accuracy: 83.71. Result ID: 698fcd073a6c314849fbf462. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.9","pv":"0.9"}. This record does not assert independent reproduction. ### IRM Mean Accuracy: 77.99. Result ID: 698fcd073a6c314849fbf465. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Env Partition":"Yes","ps(t)":"0.999, 0.7","pv":"0.8"}. This record does not assert independent reproduction. ### ZIN Mean Accuracy: 77.85. Result ID: 698fcd073a6c314849fbf45f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.7","pv":"0.8"}. This record does not assert independent reproduction. ### IRM Mean Accuracy: 77. Result ID: 698fcd073a6c314849fbf467. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Env Partition":"Yes","ps(t)":"0.999, 0.8","pv":"0.8"}. This record does not assert independent reproduction. ### ZIN Mean Accuracy: 76.79. Result ID: 698fcd073a6c314849fbf461. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.8","pv":"0.8"}. This record does not assert independent reproduction. ### ERM Mean Accuracy: 75.37. Result ID: 698fcd073a6c314849fbf44c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.7","pv":"0.9"}. This record does not assert independent reproduction. ### IRM Mean Accuracy: 73.84. Result ID: 698fcd073a6c314849fbf469. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Env Partition":"Yes","ps(t)":"0.999, 0.9","pv":"0.8"}. This record does not assert independent reproduction. ### ZIN Mean Accuracy: 73.55. Result ID: 698fcd073a6c314849fbf463. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.9","pv":"0.8"}. This record does not assert independent reproduction. ### EIIL Mean Accuracy: 70.1. Result ID: 698fcd073a6c314849fbf457. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.9","pv":"0.8"}. This record does not assert independent reproduction. ### ERM Mean Accuracy: 68.72. Result ID: 698fcd073a6c314849fbf44e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.8","pv":"0.9"}. This record does not assert independent reproduction. ### EIIL Mean Accuracy: 68.36. Result ID: 698fcd073a6c314849fbf455. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.8","pv":"0.8"}. This record does not assert independent reproduction. ### EIIL Mean Accuracy: 64.89. Result ID: 698fcd073a6c314849fbf453. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.7","pv":"0.8"}. This record does not assert independent reproduction. ### EIIL Mean Accuracy: 61.99. Result ID: 698fcd073a6c314849fbf456. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.9","pv":"0.9"}. This record does not assert independent reproduction. ### ERM Mean Accuracy: 60.61. Result ID: 698fcd073a6c314849fbf450. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.9","pv":"0.9"}. This record does not assert independent reproduction. ### ERM Mean Accuracy: 59.65. Result ID: 698fcd073a6c314849fbf44d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.7","pv":"0.8"}. This record does not assert independent reproduction. ### ERM Mean Accuracy: 55.9. Result ID: 698fcd073a6c314849fbf44f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.8","pv":"0.8"}. This record does not assert independent reproduction. ### ERM Mean Accuracy: 52.85. Result ID: 698fcd073a6c314849fbf451. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.9","pv":"0.8"}. This record does not assert independent reproduction. ### EIIL Mean Accuracy: 50.77. Result ID: 698fcd073a6c314849fbf454. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.8","pv":"0.9"}. This record does not assert independent reproduction. ### HRM Mean Accuracy: 50.01. Result ID: 698fcd073a6c314849fbf45b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.8","pv":"0.8"}. This record does not assert independent reproduction. ### HRM Mean Accuracy: 50. Result ID: 698fcd073a6c314849fbf458. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.7","pv":"0.9"}. This record does not assert independent reproduction. ### HRM Mean Accuracy: 50. Result ID: 698fcd073a6c314849fbf45a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.8","pv":"0.9"}. This record does not assert independent reproduction. ### HRM Mean Accuracy: 50. Result ID: 698fcd073a6c314849fbf45c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.9","pv":"0.9"}. This record does not assert independent reproduction. ### HRM Mean Accuracy: 49.99. Result ID: 698fcd073a6c314849fbf45d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.9","pv":"0.8"}. This record does not assert independent reproduction. ### HRM Mean Accuracy: 49.98. Result ID: 698fcd073a6c314849fbf459. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.7","pv":"0.8"}. This record does not assert independent reproduction. ### EIIL Mean Accuracy: 38.41. Result ID: 698fcd073a6c314849fbf452. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Env Partition":"No","ps(t)":"0.999, 0.7","pv":"0.9"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.