# Feature Space Preservation on C4

Source: [Feature Space Preservation on C4](<https://www.sota2.com/research/sota/feature-space-preservation-on-c4>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-25T12:56:18.627Z

Evaluation of model performance on the C4 dataset focusing on Feature Space Preservation, typically measured using Cosine Similarity.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Feature Space Preservation |
| Dataset (including any stated split) | C4 |
| Metric | Cosine Similarity |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 32 of 32 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Cosine Similarity](<https://www.sota2.com/research/sota/feature-space-preservation-on-c4.md?metric=Cosine%20Similarity>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Cosine Similarity | Result date | Report paper |
| --- | --- | --- | --- |
| BF16 | 100 | Not recorded | 69c36be70636e5bf4afc6327 |
| BF16 | 100 | Not recorded | 69c36be70636e5bf4afc6327 |
| BF16 | 100 | Not recorded | 69c36be70636e5bf4afc6327 |
| BF16 | 100 | Not recorded | 69c36be70636e5bf4afc6327 |
| FAAR+2FA | 98.71 | Not recorded | 69c36be70636e5bf4afc6327 |
| GPTQ | 98.63 | Not recorded | 69c36be70636e5bf4afc6327 |
| MR-GPTQ | 98.47 | Not recorded | 69c36be70636e5bf4afc6327 |
| GPTQ+4/6 | 98.42 | Not recorded | 69c36be70636e5bf4afc6327 |
| FAAR+2FA | 98.39 | Not recorded | 69c36be70636e5bf4afc6327 |
| 4/6 | 98.28 | Not recorded | 69c36be70636e5bf4afc6327 |
| FAAR+2FA | 98.21 | Not recorded | 69c36be70636e5bf4afc6327 |
| Strong Baseline | 98.11 | Not recorded | 69c36be70636e5bf4afc6327 |
| RTN | 98.03 | Not recorded | 69c36be70636e5bf4afc6327 |
| MR-GPTQ | 98.02 | Not recorded | 69c36be70636e5bf4afc6327 |
| GPTQ | 97.95 | Not recorded | 69c36be70636e5bf4afc6327 |
| 4/6 | 97.91 | Not recorded | 69c36be70636e5bf4afc6327 |
| Strong Baseline | 97.82 | Not recorded | 69c36be70636e5bf4afc6327 |
| GPTQ+4/6 | 97.55 | Not recorded | 69c36be70636e5bf4afc6327 |
| FAAR+2FA | 97.5 | Not recorded | 69c36be70636e5bf4afc6327 |
| MR-GPTQ | 97.41 | Not recorded | 69c36be70636e5bf4afc6327 |
| GPTQ+4/6 | 97.34 | Not recorded | 69c36be70636e5bf4afc6327 |
| 4/6 | 97.33 | Not recorded | 69c36be70636e5bf4afc6327 |
| Strong Baseline | 97.21 | Not recorded | 69c36be70636e5bf4afc6327 |
| GPTQ+4/6 | 97.14 | Not recorded | 69c36be70636e5bf4afc6327 |
| RTN | 97.11 | Not recorded | 69c36be70636e5bf4afc6327 |
| RTN | 97.11 | Not recorded | 69c36be70636e5bf4afc6327 |
| MR-GPTQ | 97.02 | Not recorded | 69c36be70636e5bf4afc6327 |
| GPTQ | 96.88 | Not recorded | 69c36be70636e5bf4afc6327 |
| GPTQ | 96.01 | Not recorded | 69c36be70636e5bf4afc6327 |
| Strong Baseline | 95.87 | Not recorded | 69c36be70636e5bf4afc6327 |
| 4/6 | 95.61 | Not recorded | 69c36be70636e5bf4afc6327 |
| RTN | 94.27 | Not recorded | 69c36be70636e5bf4afc6327 |

### BF16

Cosine Similarity: 100. Result ID: 69c3da4f47f34ce924ad26d7.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"1B"}. This record does not assert independent reproduction.

### BF16

Cosine Similarity: 100. Result ID: 69c3da4f47f34ce924ad26d8.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"8B"}. This record does not assert independent reproduction.

### BF16

Cosine Similarity: 100. Result ID: 69c3da4f47f34ce924ad26d9.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"1.7B"}. This record does not assert independent reproduction.

### BF16

Cosine Similarity: 100. Result ID: 69c3da4f47f34ce924ad26da.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"8B"}. This record does not assert independent reproduction.

### FAAR+2FA

Cosine Similarity: 98.71. Result ID: 69c3da4f47f34ce924ad26f6.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"8B"}. This record does not assert independent reproduction.

### GPTQ

Cosine Similarity: 98.63. Result ID: 69c3da4f47f34ce924ad26e2.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ecc1e209131cea4235d.md>)

Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"8B"}. This record does not assert independent reproduction.

### MR-GPTQ

Cosine Similarity: 98.47. Result ID: 69c3da4f47f34ce924ad26e6.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c321e209131cea8cf3e.md>)

Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"8B"}. This record does not assert independent reproduction.

### GPTQ+4/6

Cosine Similarity: 98.42. Result ID: 69c3da4f47f34ce924ad26ee.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"8B"}. This record does not assert independent reproduction.

### FAAR+2FA

Cosine Similarity: 98.39. Result ID: 69c3da4f47f34ce924ad26f4.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"8B"}. This record does not assert independent reproduction.

### 4/6

Cosine Similarity: 98.28. Result ID: 69c3da4f47f34ce924ad26e8.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/692e733cd6b0dd334293298d.md>)

Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"8B"}. This record does not assert independent reproduction.

### FAAR+2FA

Cosine Similarity: 98.21. Result ID: 69c3da4f47f34ce924ad26f5.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"1.7B"}. This record does not assert independent reproduction.

### Strong Baseline

Cosine Similarity: 98.11. Result ID: 69c3da4f47f34ce924ad26f0.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"8B"}. This record does not assert independent reproduction.

### RTN

Cosine Similarity: 98.03. Result ID: 69c3da4f47f34ce924ad26dc.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"8B"}. This record does not assert independent reproduction.

### MR-GPTQ

Cosine Similarity: 98.02. Result ID: 69c3da4f47f34ce924ad26e5.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c321e209131cea8cf3e.md>)

Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"1.7B"}. This record does not assert independent reproduction.

### GPTQ

Cosine Similarity: 97.95. Result ID: 69c3da4f47f34ce924ad26e1.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ecc1e209131cea4235d.md>)

Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"1.7B"}. This record does not assert independent reproduction.

### 4/6

Cosine Similarity: 97.91. Result ID: 69c3da4f47f34ce924ad26ea.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/692e733cd6b0dd334293298d.md>)

Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"8B"}. This record does not assert independent reproduction.

### Strong Baseline

Cosine Similarity: 97.82. Result ID: 69c3da4f47f34ce924ad26f2.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"8B"}. This record does not assert independent reproduction.

### GPTQ+4/6

Cosine Similarity: 97.55. Result ID: 69c3da4f47f34ce924ad26ec.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"8B"}. This record does not assert independent reproduction.

### FAAR+2FA

Cosine Similarity: 97.5. Result ID: 69c3da4f47f34ce924ad26f3.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"1B"}. This record does not assert independent reproduction.

### MR-GPTQ

Cosine Similarity: 97.41. Result ID: 69c3da4f47f34ce924ad26e4.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c321e209131cea8cf3e.md>)

Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"8B"}. This record does not assert independent reproduction.

### GPTQ+4/6

Cosine Similarity: 97.34. Result ID: 69c3da4f47f34ce924ad26ed.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"1.7B"}. This record does not assert independent reproduction.

### 4/6

Cosine Similarity: 97.33. Result ID: 69c3da4f47f34ce924ad26e7.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/692e733cd6b0dd334293298d.md>)

Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"1B"}. This record does not assert independent reproduction.

### Strong Baseline

Cosine Similarity: 97.21. Result ID: 69c3da4f47f34ce924ad26f1.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"1.7B"}. This record does not assert independent reproduction.

### GPTQ+4/6

Cosine Similarity: 97.14. Result ID: 69c3da4f47f34ce924ad26eb.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"1B"}. This record does not assert independent reproduction.

### RTN

Cosine Similarity: 97.11. Result ID: 69c3da4f47f34ce924ad26dd.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"1.7B"}. This record does not assert independent reproduction.

### RTN

Cosine Similarity: 97.11. Result ID: 69c3da4f47f34ce924ad26de.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"8B"}. This record does not assert independent reproduction.

### MR-GPTQ

Cosine Similarity: 97.02. Result ID: 69c3da4f47f34ce924ad26e3.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c321e209131cea8cf3e.md>)

Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"1B"}. This record does not assert independent reproduction.

### GPTQ

Cosine Similarity: 96.88. Result ID: 69c3da4f47f34ce924ad26e0.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ecc1e209131cea4235d.md>)

Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"8B"}. This record does not assert independent reproduction.

### GPTQ

Cosine Similarity: 96.01. Result ID: 69c3da4f47f34ce924ad26df.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ecc1e209131cea4235d.md>)

Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"1B"}. This record does not assert independent reproduction.

### Strong Baseline

Cosine Similarity: 95.87. Result ID: 69c3da4f47f34ce924ad26ef.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"1B"}. This record does not assert independent reproduction.

### 4/6

Cosine Similarity: 95.61. Result ID: 69c3da4f47f34ce924ad26e9.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/692e733cd6b0dd334293298d.md>)

Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"1.7B"}. This record does not assert independent reproduction.

### RTN

Cosine Similarity: 94.27. Result ID: 69c3da4f47f34ce924ad26db.

[Reporting paper](<https://www.sota2.com/research/paper/69c36be70636e5bf4afc6327.md>)

Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"1B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
