# Continual Test-Time Adaptation on CCC Hard

Source: [Continual Test-Time Adaptation on CCC Hard](<https://www.sota2.com/research/sota/continual-test-time-adaptation-on-ccc-hard>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-15T07:34:59.594Z

Evaluation of Continual Test-Time Adaptation performance on the CCC Hard subset of the CCC dataset, reporting Error percentage.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Continual Test-Time Adaptation |
| Dataset (including any stated split) | CCC Hard |
| Metric | Error (%) |
| Unit | PERCENT |
| Direction | Lower is better |
| Results loaded | 32 of 32 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Error (%)](<https://www.sota2.com/research/sota/continual-test-time-adaptation-on-ccc-hard.md?metric=Error%20(%25)>): Lower is better; unit: PERCENT.

## Recorded results

| Method | Error (%) | Result date | Report paper |
| --- | --- | --- | --- |
| ROID | 75.98 | Not recorded | 6a06a899dbc836b87d82a05e |
| ROID | 75.98 | Not recorded | 6a06a899dbc836b87d82a05e |
| RMEMSAFE, no ASR | 76.36 | Not recorded | 6a06a899dbc836b87d82a05e |
| RMEMSAFE, no ASR | 76.36 | Not recorded | 6a06a899dbc836b87d82a05e |
| ROID + RDumb | 76.5 | Not recorded | 6a06a899dbc836b87d82a05e |
| ROID + RDumb | 76.5 | Not recorded | 6a06a899dbc836b87d82a05e |
| ETA + ASR | 80.11 | Not recorded | 6a06a899dbc836b87d82a05e |
| ETA + ASR | 80.11 | Not recorded | 6a06a899dbc836b87d82a05e |
| EATA + ASR | 80.58 | Not recorded | 6a06a899dbc836b87d82a05e |
| EATA + ASR | 80.58 | Not recorded | 6a06a899dbc836b87d82a05e |
| RMEMSAFE + ASR | 83.18 | Not recorded | 6a06a899dbc836b87d82a05e |
| RMEMSAFE+ASR (ours) | 83.18 | Not recorded | 6a06a899dbc836b87d82a05e |
| RMEMSAFE + ASR | 83.81 | Not recorded | 6a06a899dbc836b87d82a05e |
| RMEMSAFE+ASR (ours) | 83.81 | Not recorded | 6a06a899dbc836b87d82a05e |
| ROID + ASR | 84.04 | Not recorded | 6a06a899dbc836b87d82a05e |
| ROID + ASR | 84.04 | Not recorded | 6a06a899dbc836b87d82a05e |
| ROID + ASR | 84.56 | Not recorded | 6a06a899dbc836b87d82a05e |
| ROID + ASR | 84.56 | Not recorded | 6a06a899dbc836b87d82a05e |
| ROID | 86.07 | Not recorded | 6a06a899dbc836b87d82a05e |
| ROID | 86.07 | Not recorded | 6a06a899dbc836b87d82a05e |
| Source | 86.58 | Not recorded | 6a06a899dbc836b87d82a05e |
| Source | 86.58 | Not recorded | 6a06a899dbc836b87d82a05e |
| RMEMSAFE, no ASR | 86.6 | Not recorded | 6a06a899dbc836b87d82a05e |
| RMEMSAFE, no ASR | 86.6 | Not recorded | 6a06a899dbc836b87d82a05e |
| ROID + RDumb | 86.77 | Not recorded | 6a06a899dbc836b87d82a05e |
| ROID + RDumb | 86.77 | Not recorded | 6a06a899dbc836b87d82a05e |
| EATA + ASR | 88.89 | Not recorded | 6a06a899dbc836b87d82a05e |
| EATA + ASR | 88.89 | Not recorded | 6a06a899dbc836b87d82a05e |
| ETA + ASR | 89.74 | Not recorded | 6a06a899dbc836b87d82a05e |
| ETA + ASR | 89.74 | Not recorded | 6a06a899dbc836b87d82a05e |
| Source | 98.67 | Not recorded | 6a06a899dbc836b87d82a05e |
| Source | 98.67 | Not recorded | 6a06a899dbc836b87d82a05e |

### ROID

Error (%): 75.98. Result ID: 6a06cc9b47f34ce924ee1042.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71071e209131cea4eb6f.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### ROID

Error (%): 75.98. Result ID: 6a06cc9b47f34ce924ee108a.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71071e209131cea4eb6f.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### RMEMSAFE, no ASR

Error (%): 76.36. Result ID: 6a06cc9b47f34ce924ee1047.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### RMEMSAFE, no ASR

Error (%): 76.36. Result ID: 6a06cc9b47f34ce924ee108f.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### ROID + RDumb

Error (%): 76.5. Result ID: 6a06cc9b47f34ce924ee1043.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ba1e209131cea582d5.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### ROID + RDumb

Error (%): 76.5. Result ID: 6a06cc9b47f34ce924ee108b.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ba1e209131cea582d5.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### ETA + ASR

Error (%): 80.11. Result ID: 6a06cc9b47f34ce924ee1044.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ca11e209131cea35123.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### ETA + ASR

Error (%): 80.11. Result ID: 6a06cc9b47f34ce924ee108c.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ca11e209131cea35123.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### EATA + ASR

Error (%): 80.58. Result ID: 6a06cc9b47f34ce924ee1045.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ca11e209131cea35123.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### EATA + ASR

Error (%): 80.58. Result ID: 6a06cc9b47f34ce924ee108d.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ca11e209131cea35123.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### RMEMSAFE + ASR

Error (%): 83.18. Result ID: 6a06cc9b47f34ce924ee1048.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### RMEMSAFE+ASR (ours)

Error (%): 83.18. Result ID: 6a06cc9b47f34ce924ee1090.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### RMEMSAFE + ASR

Error (%): 83.81. Result ID: 6a06cc9b47f34ce924ee1040.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

Recorded evaluation configuration: {"Backbone":"ResNet-50"}. This record does not assert independent reproduction.

### RMEMSAFE+ASR (ours)

Error (%): 83.81. Result ID: 6a06cc9b47f34ce924ee1088.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

Recorded evaluation configuration: {"Backbone":"ResNet-50"}. This record does not assert independent reproduction.

### ROID + ASR

Error (%): 84.04. Result ID: 6a06cc9b47f34ce924ee1046.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40833.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### ROID + ASR

Error (%): 84.04. Result ID: 6a06cc9b47f34ce924ee108e.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40833.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### ROID + ASR

Error (%): 84.56. Result ID: 6a06cc9b47f34ce924ee103e.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40833.md>)

Recorded evaluation configuration: {"Backbone":"ResNet-50"}. This record does not assert independent reproduction.

### ROID + ASR

Error (%): 84.56. Result ID: 6a06cc9b47f34ce924ee1086.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40833.md>)

Recorded evaluation configuration: {"Backbone":"ResNet-50"}. This record does not assert independent reproduction.

### ROID

Error (%): 86.07. Result ID: 6a06cc9b47f34ce924ee103a.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71071e209131cea4eb6f.md>)

Recorded evaluation configuration: {"Backbone":"ResNet-50"}. This record does not assert independent reproduction.

### ROID

Error (%): 86.07. Result ID: 6a06cc9b47f34ce924ee1082.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71071e209131cea4eb6f.md>)

Recorded evaluation configuration: {"Backbone":"ResNet-50"}. This record does not assert independent reproduction.

### Source

Error (%): 86.58. Result ID: 6a06cc9b47f34ce924ee1041.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### Source

Error (%): 86.58. Result ID: 6a06cc9b47f34ce924ee1089.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### RMEMSAFE, no ASR

Error (%): 86.6. Result ID: 6a06cc9b47f34ce924ee103f.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

Recorded evaluation configuration: {"Backbone":"ResNet-50"}. This record does not assert independent reproduction.

### RMEMSAFE, no ASR

Error (%): 86.6. Result ID: 6a06cc9b47f34ce924ee1087.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

Recorded evaluation configuration: {"Backbone":"ResNet-50"}. This record does not assert independent reproduction.

### ROID + RDumb

Error (%): 86.77. Result ID: 6a06cc9b47f34ce924ee103b.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ba1e209131cea582d5.md>)

Recorded evaluation configuration: {"Backbone":"ResNet-50"}. This record does not assert independent reproduction.

### ROID + RDumb

Error (%): 86.77. Result ID: 6a06cc9b47f34ce924ee1083.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ba1e209131cea582d5.md>)

Recorded evaluation configuration: {"Backbone":"ResNet-50"}. This record does not assert independent reproduction.

### EATA + ASR

Error (%): 88.89. Result ID: 6a06cc9b47f34ce924ee103d.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ca11e209131cea35123.md>)

Recorded evaluation configuration: {"Backbone":"ResNet-50"}. This record does not assert independent reproduction.

### EATA + ASR

Error (%): 88.89. Result ID: 6a06cc9b47f34ce924ee1085.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ca11e209131cea35123.md>)

Recorded evaluation configuration: {"Backbone":"ResNet-50"}. This record does not assert independent reproduction.

### ETA + ASR

Error (%): 89.74. Result ID: 6a06cc9b47f34ce924ee103c.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ca11e209131cea35123.md>)

Recorded evaluation configuration: {"Backbone":"ResNet-50"}. This record does not assert independent reproduction.

### ETA + ASR

Error (%): 89.74. Result ID: 6a06cc9b47f34ce924ee1084.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ca11e209131cea35123.md>)

Recorded evaluation configuration: {"Backbone":"ResNet-50"}. This record does not assert independent reproduction.

### Source

Error (%): 98.67. Result ID: 6a06cc9b47f34ce924ee1039.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

Recorded evaluation configuration: {"Backbone":"ResNet-50"}. This record does not assert independent reproduction.

### Source

Error (%): 98.67. Result ID: 6a06cc9b47f34ce924ee1081.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a899dbc836b87d82a05e.md>)

Recorded evaluation configuration: {"Backbone":"ResNet-50"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
