# Domain Adaptation on CMNIST v1 (test)

Source: [Domain Adaptation on CMNIST v1 (test)](<https://www.sota2.com/research/sota/domain-adaptation-on-cmnist-v1-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:34:26.837Z

Evaluation of Domain Adaptation performance on the CMNIST v1 dataset using the test split.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Domain Adaptation |
| Dataset (including any stated split) | CMNIST v1 (test) |
| Metric | Accuracy (Shift 1.0) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 9 of 9 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy (Shift 1.0)](<https://www.sota2.com/research/sota/domain-adaptation-on-cmnist-v1-test.md?metric=Accuracy%20(Shift%201.0)>): Higher is better; unit: PERCENT.

- [Accuracy (Shift 0.9)](<https://www.sota2.com/research/sota/domain-adaptation-on-cmnist-v1-test.md?metric=Accuracy%20(Shift%200.9)>): Higher is better; unit: PERCENT.

- [Accuracy (Shift 0.8)](<https://www.sota2.com/research/sota/domain-adaptation-on-cmnist-v1-test.md?metric=Accuracy%20(Shift%200.8)>): Higher is better; unit: PERCENT.

- [Accuracy (Shift 0.7)](<https://www.sota2.com/research/sota/domain-adaptation-on-cmnist-v1-test.md?metric=Accuracy%20(Shift%200.7)>): Higher is better; unit: PERCENT.

- [Accuracy (Shift 0.6)](<https://www.sota2.com/research/sota/domain-adaptation-on-cmnist-v1-test.md?metric=Accuracy%20(Shift%200.6)>): Higher is better; unit: PERCENT.

- [Accuracy (Shift 0.5)](<https://www.sota2.com/research/sota/domain-adaptation-on-cmnist-v1-test.md?metric=Accuracy%20(Shift%200.5)>): Higher is better; unit: PERCENT.

- [Accuracy (Shift -0.6)](<https://www.sota2.com/research/sota/domain-adaptation-on-cmnist-v1-test.md?metric=Accuracy%20(Shift%20-0.6)>): Higher is better; unit: PERCENT.

- [Accuracy (Shift -0.7)](<https://www.sota2.com/research/sota/domain-adaptation-on-cmnist-v1-test.md?metric=Accuracy%20(Shift%20-0.7)>): Higher is better; unit: PERCENT.

- [Accuracy (Shift -0.8)](<https://www.sota2.com/research/sota/domain-adaptation-on-cmnist-v1-test.md?metric=Accuracy%20(Shift%20-0.8)>): Higher is better; unit: PERCENT.

- [Accuracy (Shift -0.9)](<https://www.sota2.com/research/sota/domain-adaptation-on-cmnist-v1-test.md?metric=Accuracy%20(Shift%20-0.9)>): Higher is better; unit: PERCENT.

- [Accuracy (Shift -1.0)](<https://www.sota2.com/research/sota/domain-adaptation-on-cmnist-v1-test.md?metric=Accuracy%20(Shift%20-1.0)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy (Shift 1.0) | Result date | Report paper |
| --- | --- | --- | --- |
| ERM+PL (all) | 100 | Not recorded | 68fa711d1e209131cea4f2e7 |
| SFB | 100 | Not recorded | 68fa711d1e209131cea4f2e7 |
| IRM+PL (all) | 99.6 | Not recorded | 68fa711d1e209131cea4f2e7 |
| ERM+T3A | 98.1 | Not recorded | 68fa711d1e209131cea4f2e7 |
| ERM+PL (last) | 97.6 | Not recorded | 68fa711d1e209131cea4f2e7 |
| ERM | 97.5 | Not recorded | 68fa711d1e209131cea4f2e7 |
| IRM+T3A | 72.3 | Not recorded | 68fa711d1e209131cea4f2e7 |
| IRM+PL (last) | 70.8 | Not recorded | 68fa711d1e209131cea4f2e7 |
| IRM | 70.6 | Not recorded | 68fa711d1e209131cea4f2e7 |

### ERM+PL (all)

Accuracy (Shift 1.0): 100. Result ID: 6991b1ae3a6c31484909f33f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa711d1e209131cea4f2e7.md>)

Recorded evaluation configuration: {"Algorithm":"ERM","Adaptation":"PL","Updated layers":"all"}. This record does not assert independent reproduction.

### SFB

Accuracy (Shift 1.0): 100. Result ID: 6991b1ae3a6c31484909f344.

[Reporting paper](<https://www.sota2.com/research/paper/68fa711d1e209131cea4f2e7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa711d1e209131cea4f2e7.md>)

[Implementation](<https://github.com/cianeastwood/sfb>)

Recorded evaluation configuration: {"Algorithm":"SFB"}. This record does not assert independent reproduction.

### IRM+PL (all)

Accuracy (Shift 1.0): 99.6. Result ID: 6991b1ae3a6c31484909f343.

[Reporting paper](<https://www.sota2.com/research/paper/68fa711d1e209131cea4f2e7.md>)

Recorded evaluation configuration: {"Algorithm":"IRM","Adaptation":"PL","Updated layers":"all"}. This record does not assert independent reproduction.

### ERM+T3A

Accuracy (Shift 1.0): 98.1. Result ID: 6991b1ae3a6c31484909f33d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa711d1e209131cea4f2e7.md>)

Recorded evaluation configuration: {"Algorithm":"ERM","Adaptation":"T3A"}. This record does not assert independent reproduction.

### ERM+PL (last)

Accuracy (Shift 1.0): 97.6. Result ID: 6991b1ae3a6c31484909f33e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa711d1e209131cea4f2e7.md>)

Recorded evaluation configuration: {"Algorithm":"ERM","Adaptation":"PL","Updated layers":"last"}. This record does not assert independent reproduction.

### ERM

Accuracy (Shift 1.0): 97.5. Result ID: 6991b1ae3a6c31484909f33c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa711d1e209131cea4f2e7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67d21e209131cea18b07.md>)

[Implementation](<https://github.com/facebookresearch/DomainBed>)

Recorded evaluation configuration: {"Algorithm":"ERM"}. This record does not assert independent reproduction.

### IRM+T3A

Accuracy (Shift 1.0): 72.3. Result ID: 6991b1ae3a6c31484909f341.

[Reporting paper](<https://www.sota2.com/research/paper/68fa711d1e209131cea4f2e7.md>)

Recorded evaluation configuration: {"Algorithm":"IRM","Adaptation":"T3A"}. This record does not assert independent reproduction.

### IRM+PL (last)

Accuracy (Shift 1.0): 70.8. Result ID: 6991b1ae3a6c31484909f342.

[Reporting paper](<https://www.sota2.com/research/paper/68fa711d1e209131cea4f2e7.md>)

Recorded evaluation configuration: {"Algorithm":"IRM","Adaptation":"PL","Updated layers":"last"}. This record does not assert independent reproduction.

### IRM

Accuracy (Shift 1.0): 70.6. Result ID: 6991b1ae3a6c31484909f340.

[Reporting paper](<https://www.sota2.com/research/paper/68fa711d1e209131cea4f2e7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6cf81e209131cea36f38.md>)

Recorded evaluation configuration: {"Algorithm":"IRM"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
