# ReLU Approximation on SST-2 RoBERTa tokenized vectors (test)

Source: [ReLU Approximation on SST-2 RoBERTa tokenized vectors (test)](<https://www.sota2.com/research/sota/relu-approximation-on-sst-2-roberta-tokenized-vectors-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-25T08:58:33.523Z

Evaluation of the model's ability to approximate ReLU functions using the test split of the SST-2 dataset, specifically utilizing RoBERTa tokenized vector representations, measured by Mean Squared Error (MSE).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | ReLU approximation |
| Dataset (including any stated split) | SST-2 RoBERTa tokenized vectors (test) |
| Metric | MSE |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 5 of 5 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [MSE](<https://www.sota2.com/research/sota/relu-approximation-on-sst-2-roberta-tokenized-vectors-test.md?metric=MSE>): Lower is better; unit: SCALAR.

## Recorded results

| Method | MSE | Result date | Report paper |
| --- | --- | --- | --- |
| Kernel Polynomial | 0.002 | Not recorded | 6a13d7a36f71c5ae7dc9e9dd |
| X Squared | 0.016 | Not recorded | 6a13d7a36f71c5ae7dc9e9dd |
| FasterCryptoNets | 0.037 | Not recorded | 6a13d7a36f71c5ae7dc9e9dd |
| Chebyshev - 5 | 0.629 | Not recorded | 6a13d7a36f71c5ae7dc9e9dd |
| Chebyshev - 3 | 1.641 | Not recorded | 6a13d7a36f71c5ae7dc9e9dd |

### Kernel Polynomial

MSE: 0.002. Result ID: 6a140f1ffbc373592c0b66ef.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7a36f71c5ae7dc9e9dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a13d7a36f71c5ae7dc9e9dd.md>)

Recorded evaluation configuration: {"Model":"RoBERTa"}. This record does not assert independent reproduction.

### X Squared

MSE: 0.016. Result ID: 6a140f1ffbc373592c0b66f0.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7a36f71c5ae7dc9e9dd.md>)

Recorded evaluation configuration: {"Model":"RoBERTa"}. This record does not assert independent reproduction.

### FasterCryptoNets

MSE: 0.037. Result ID: 6a140f1ffbc373592c0b66f1.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7a36f71c5ae7dc9e9dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa651b1e209131cea085ab.md>)

Recorded evaluation configuration: {"Model":"RoBERTa"}. This record does not assert independent reproduction.

### Chebyshev - 5

MSE: 0.629. Result ID: 6a140f1ffbc373592c0b66f3.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7a36f71c5ae7dc9e9dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70901e209131cea4bdab.md>)

Recorded evaluation configuration: {"Model":"RoBERTa"}. This record does not assert independent reproduction.

### Chebyshev - 3

MSE: 1.641. Result ID: 6a140f1ffbc373592c0b66f2.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7a36f71c5ae7dc9e9dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70901e209131cea4bdab.md>)

Recorded evaluation configuration: {"Model":"RoBERTa"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
