# Modular arithmetic prediction on MNIST modular arithmetic Seen operations (test)

Source: [Modular arithmetic prediction on MNIST modular arithmetic Seen operations (test)](<https://www.sota2.com/research/sota/modular-arithmetic-prediction-on-mnist-modular-arithmetic-seen-operations-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-02T10:56:53.621Z

Evaluation of model performance on the test split of the MNIST modular arithmetic dataset, specifically focusing on predicting the result of seen modular arithmetic operations, measured by Seen Op Acc.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Modular arithmetic prediction |
| Dataset (including any stated split) | MNIST modular arithmetic Seen operations (test) |
| Metric | Seen Op Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Seen Op Accuracy](<https://www.sota2.com/research/sota/modular-arithmetic-prediction-on-mnist-modular-arithmetic-seen-operations-test.md?metric=Seen%20Op%20Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Seen Op Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| ResNet18 | 99.46 | Not recorded | 6a1e6410dbd7150506f856a7 |
| ResNet w/ multi-frequency rotation (MFR) | 99.45 | Not recorded | 6a1e6410dbd7150506f856a7 |
| ResNet18 w/ compositional consistency loss | 99.29 | Not recorded | 6a1e6410dbd7150506f856a7 |
| ResNet18 w/ multi-frequency rotation (MFR) | 99.18 | Not recorded | 6a1e6410dbd7150506f856a7 |
| ResNet18 w/ single-frequency rotation (SFR) | 98.94 | Not recorded | 6a1e6410dbd7150506f856a7 |
| ResNet w/ single-frequency rotation (SFR) | 98.93 | Not recorded | 6a1e6410dbd7150506f856a7 |
| ResNet18 | 98.44 | Not recorded | 6a1e6410dbd7150506f856a7 |
| MLP | 97.94 | Not recorded | 6a1e6410dbd7150506f856a7 |
| MLP w/ compositional consistency loss | 97.93 | Not recorded | 6a1e6410dbd7150506f856a7 |
| MLP w/ single-frequency rotation (SFR) | 97.73 | Not recorded | 6a1e6410dbd7150506f856a7 |
| MLP | 97.37 | Not recorded | 6a1e6410dbd7150506f856a7 |
| MLP w/ multi-frequency rotation (MFR) | 97.23 | Not recorded | 6a1e6410dbd7150506f856a7 |
| MLP w/ multi-frequency rotation (MFR) | 97.06 | Not recorded | 6a1e6410dbd7150506f856a7 |
| MLP w/ single-frequency rotation (SFR) | 94.31 | Not recorded | 6a1e6410dbd7150506f856a7 |

### ResNet18

Seen Op Accuracy: 99.46. Result ID: 6a1eb69ffbc373592c19b728.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62321e209131ce9f8328.md>)

Recorded evaluation configuration: {"Backbone":"ResNet18","Training Objective":"JEPA","Embedding type":"additive"}. This record does not assert independent reproduction.

### ResNet w/ multi-frequency rotation (MFR)

Seen Op Accuracy: 99.45. Result ID: 6a1eb69ffbc373592c19b731.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

Recorded evaluation configuration: {"Backbone":"ResNet","Training Objective":"BRo-JEPA","Rotation type (SFR/MFR)":"MFR","Embedding type":"block rotation"}. This record does not assert independent reproduction.

### ResNet18 w/ compositional consistency loss

Seen Op Accuracy: 99.29. Result ID: 6a1eb69ffbc373592c19b729.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f061e209131cea43581.md>)

Recorded evaluation configuration: {"Backbone":"ResNet18","Training Objective":"JEPA","Compositional consistency loss":"true","Embedding type":"additive"}. This record does not assert independent reproduction.

### ResNet18 w/ multi-frequency rotation (MFR)

Seen Op Accuracy: 99.18. Result ID: 6a1eb69ffbc373592c19b72d.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71271e209131cea4f8df.md>)

Recorded evaluation configuration: {"Backbone":"ResNet18","Training Objective":"Supervised","Rotation type (SFR/MFR)":"MFR","Embedding type":"block rotation"}. This record does not assert independent reproduction.

### ResNet18 w/ single-frequency rotation (SFR)

Seen Op Accuracy: 98.94. Result ID: 6a1eb69ffbc373592c19b72c.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71271e209131cea4f8df.md>)

Recorded evaluation configuration: {"Backbone":"ResNet18","Training Objective":"Supervised","Rotation type (SFR/MFR)":"SFR","Embedding type":"block rotation"}. This record does not assert independent reproduction.

### ResNet w/ single-frequency rotation (SFR)

Seen Op Accuracy: 98.93. Result ID: 6a1eb69ffbc373592c19b730.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

Recorded evaluation configuration: {"Backbone":"ResNet","Training Objective":"BRo-JEPA","Rotation type (SFR/MFR)":"SFR","Embedding type":"block rotation"}. This record does not assert independent reproduction.

### ResNet18

Seen Op Accuracy: 98.44. Result ID: 6a1eb69ffbc373592c19b725.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62321e209131ce9f8328.md>)

Recorded evaluation configuration: {"Backbone":"ResNet18","Training Objective":"Supervised","Embedding type":"additive"}. This record does not assert independent reproduction.

### MLP

Seen Op Accuracy: 97.94. Result ID: 6a1eb69ffbc373592c19b726.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

Recorded evaluation configuration: {"Backbone":"MLP","Training Objective":"JEPA","Embedding type":"additive"}. This record does not assert independent reproduction.

### MLP w/ compositional consistency loss

Seen Op Accuracy: 97.93. Result ID: 6a1eb69ffbc373592c19b727.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f061e209131cea43581.md>)

Recorded evaluation configuration: {"Backbone":"MLP","Training Objective":"JEPA","Compositional consistency loss":"true","Embedding type":"additive"}. This record does not assert independent reproduction.

### MLP w/ single-frequency rotation (SFR)

Seen Op Accuracy: 97.73. Result ID: 6a1eb69ffbc373592c19b72a.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

Recorded evaluation configuration: {"Backbone":"MLP","Training Objective":"Supervised","Rotation type (SFR/MFR)":"SFR","Embedding type":"block rotation"}. This record does not assert independent reproduction.

### MLP

Seen Op Accuracy: 97.37. Result ID: 6a1eb69ffbc373592c19b724.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

Recorded evaluation configuration: {"Backbone":"MLP","Training Objective":"Supervised","Embedding type":"additive"}. This record does not assert independent reproduction.

### MLP w/ multi-frequency rotation (MFR)

Seen Op Accuracy: 97.23. Result ID: 6a1eb69ffbc373592c19b72f.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

Recorded evaluation configuration: {"Backbone":"MLP","Training Objective":"BRo-JEPA","Rotation type (SFR/MFR)":"MFR","Embedding type":"block rotation"}. This record does not assert independent reproduction.

### MLP w/ multi-frequency rotation (MFR)

Seen Op Accuracy: 97.06. Result ID: 6a1eb69ffbc373592c19b72b.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

Recorded evaluation configuration: {"Backbone":"MLP","Training Objective":"Supervised","Rotation type (SFR/MFR)":"MFR","Embedding type":"block rotation"}. This record does not assert independent reproduction.

### MLP w/ single-frequency rotation (SFR)

Seen Op Accuracy: 94.31. Result ID: 6a1eb69ffbc373592c19b72e.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1e6410dbd7150506f856a7.md>)

Recorded evaluation configuration: {"Backbone":"MLP","Training Objective":"BRo-JEPA","Rotation type (SFR/MFR)":"SFR","Embedding type":"block rotation"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
