# Test-Time Adaptation on Amazon-C

Source: [Test-Time Adaptation on Amazon-C](<https://www.sota2.com/research/sota/test-time-adaptation-on-amazon-c>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-20T08:35:59.580Z

Evaluation of Test-Time Adaptation methods on the Amazon-C dataset, reporting metrics related to semantic consistency, prototype alignment, prediction stability, and computational overhead.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Test-Time Adaptation |
| Dataset (including any stated split) | Amazon-C |
| Metric | Semantic Consistency (PAC) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 5 of 5 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Semantic Consistency (PAC)](<https://www.sota2.com/research/sota/test-time-adaptation-on-amazon-c.md?metric=Semantic%20Consistency%20(PAC)>): Higher is better; unit: PERCENT.

- [Prototype Alignment (PCA-W)](<https://www.sota2.com/research/sota/test-time-adaptation-on-amazon-c.md?metric=Prototype%20Alignment%20(PCA-W)>): Higher is better; unit: PERCENT.

- [Prediction Stability](<https://www.sota2.com/research/sota/test-time-adaptation-on-amazon-c.md?metric=Prediction%20Stability>): Higher is better; unit: PERCENT.

- [Selection Rate](<https://www.sota2.com/research/sota/test-time-adaptation-on-amazon-c.md?metric=Selection%20Rate>): Higher is better; unit: PERCENT.

- [Relative Speed](<https://www.sota2.com/research/sota/test-time-adaptation-on-amazon-c.md?metric=Relative%20Speed>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Semantic Consistency (PAC) | Result date | Report paper |
| --- | --- | --- | --- |
| SAR | 20.8 | Not recorded | 69e5b30a7d0172140ec7df99 |
| EATA | 18.6 | Not recorded | 69e5b30a7d0172140ec7df99 |
| ProtoTTA | 18.2 | Not recorded | 69e5b30a7d0172140ec7df99 |
| Tent | 18.1 | Not recorded | 69e5b30a7d0172140ec7df99 |
| Unadapted | 17.9 | Not recorded | 69e5b30a7d0172140ec7df99 |

### SAR

Semantic Consistency (PAC): 20.8. Result ID: 69e5e56c47f34ce924cc1aba.

[Reporting paper](<https://www.sota2.com/research/paper/69e5b30a7d0172140ec7df99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e961e209131cea40e77.md>)

Recorded evaluation configuration: {"Backbone":"ProtoLens (LN + Attention Biases)"}. This record does not assert independent reproduction.

### EATA

Semantic Consistency (PAC): 18.6. Result ID: 69e5e56c47f34ce924cc1abc.

[Reporting paper](<https://www.sota2.com/research/paper/69e5b30a7d0172140ec7df99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ca11e209131cea35123.md>)

Recorded evaluation configuration: {"Backbone":"ProtoLens (LN + Attention Biases)"}. This record does not assert independent reproduction.

### ProtoTTA

Semantic Consistency (PAC): 18.2. Result ID: 69e5e56c47f34ce924cc1abd.

[Reporting paper](<https://www.sota2.com/research/paper/69e5b30a7d0172140ec7df99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e5b30a7d0172140ec7df99.md>)

Recorded evaluation configuration: {"Backbone":"ProtoLens (LN + Attention Biases)"}. This record does not assert independent reproduction.

### Tent

Semantic Consistency (PAC): 18.1. Result ID: 69e5e56c47f34ce924cc1abb.

[Reporting paper](<https://www.sota2.com/research/paper/69e5b30a7d0172140ec7df99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69941e209131cea22d2b.md>)

Recorded evaluation configuration: {"Backbone":"ProtoLens (LN + Attention Biases)"}. This record does not assert independent reproduction.

### Unadapted

Semantic Consistency (PAC): 17.9. Result ID: 69e5e56c47f34ce924cc1ab9.

[Reporting paper](<https://www.sota2.com/research/paper/69e5b30a7d0172140ec7df99.md>)

Recorded evaluation configuration: {"Backbone":"ProtoLens (LN + Attention Biases)"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
