# Feature Space Preservation on WikiText-2 Source: [Feature Space Preservation on WikiText-2]() Collection index: [llms.txt]() Data updated: 2026-03-25T12:56:18.589Z Evaluation of feature space preservation capabilities using the WikiText-2 dataset, measured by Cosine Similarity. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Feature Space Preservation | | Dataset (including any stated split) | WikiText-2 | | Metric | Cosine Similarity | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 32 of 32 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Cosine Similarity](): Higher is better; unit: PERCENT. ## Recorded results | Method | Cosine Similarity | Result date | Report paper | | --- | --- | --- | --- | | BF16 | 100 | Not recorded | 69c36be70636e5bf4afc6327 | | BF16 | 100 | Not recorded | 69c36be70636e5bf4afc6327 | | BF16 | 100 | Not recorded | 69c36be70636e5bf4afc6327 | | BF16 | 100 | Not recorded | 69c36be70636e5bf4afc6327 | | FAAR+2FA | 99.13 | Not recorded | 69c36be70636e5bf4afc6327 | | MR-GPTQ | 99.08 | Not recorded | 69c36be70636e5bf4afc6327 | | FAAR+2FA | 99.02 | Not recorded | 69c36be70636e5bf4afc6327 | | GPTQ | 99.01 | Not recorded | 69c36be70636e5bf4afc6327 | | FAAR+2FA | 98.96 | Not recorded | 69c36be70636e5bf4afc6327 | | 4/6 | 98.92 | Not recorded | 69c36be70636e5bf4afc6327 | | MR-GPTQ | 98.76 | Not recorded | 69c36be70636e5bf4afc6327 | | GPTQ | 98.75 | Not recorded | 69c36be70636e5bf4afc6327 | | GPTQ+4/6 | 98.68 | Not recorded | 69c36be70636e5bf4afc6327 | | GPTQ+4/6 | 98.62 | Not recorded | 69c36be70636e5bf4afc6327 | | Strong Baseline | 98.59 | Not recorded | 69c36be70636e5bf4afc6327 | | 4/6 | 98.5 | Not recorded | 69c36be70636e5bf4afc6327 | | GPTQ+4/6 | 98.49 | Not recorded | 69c36be70636e5bf4afc6327 | | GPTQ | 98.45 | Not recorded | 69c36be70636e5bf4afc6327 | | Strong Baseline | 98.22 | Not recorded | 69c36be70636e5bf4afc6327 | | FAAR+2FA | 98.06 | Not recorded | 69c36be70636e5bf4afc6327 | | RTN | 97.97 | Not recorded | 69c36be70636e5bf4afc6327 | | GPTQ+4/6 | 97.93 | Not recorded | 69c36be70636e5bf4afc6327 | | RTN | 97.92 | Not recorded | 69c36be70636e5bf4afc6327 | | MR-GPTQ | 97.9 | Not recorded | 69c36be70636e5bf4afc6327 | | MR-GPTQ | 97.8 | Not recorded | 69c36be70636e5bf4afc6327 | | GPTQ | 97.78 | Not recorded | 69c36be70636e5bf4afc6327 | | Strong Baseline | 97.78 | Not recorded | 69c36be70636e5bf4afc6327 | | RTN | 97.23 | Not recorded | 69c36be70636e5bf4afc6327 | | 4/6 | 96.94 | Not recorded | 69c36be70636e5bf4afc6327 | | 4/6 | 96.72 | Not recorded | 69c36be70636e5bf4afc6327 | | Strong Baseline | 96.55 | Not recorded | 69c36be70636e5bf4afc6327 | | RTN | 96.08 | Not recorded | 69c36be70636e5bf4afc6327 | ### BF16 Cosine Similarity: 100. Result ID: 69c3da4f47f34ce924ad26b7. [Reporting paper]() Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"1B"}. This record does not assert independent reproduction. ### BF16 Cosine Similarity: 100. Result ID: 69c3da4f47f34ce924ad26b8. [Reporting paper]() Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"8B"}. This record does not assert independent reproduction. ### BF16 Cosine Similarity: 100. Result ID: 69c3da4f47f34ce924ad26b9. [Reporting paper]() Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"1.7B"}. This record does not assert independent reproduction. ### BF16 Cosine Similarity: 100. Result ID: 69c3da4f47f34ce924ad26ba. [Reporting paper]() Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"8B"}. This record does not assert independent reproduction. ### FAAR+2FA Cosine Similarity: 99.13. Result ID: 69c3da4f47f34ce924ad26d6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"8B"}. This record does not assert independent reproduction. ### MR-GPTQ Cosine Similarity: 99.08. Result ID: 69c3da4f47f34ce924ad26c6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"8B"}. This record does not assert independent reproduction. ### FAAR+2FA Cosine Similarity: 99.02. Result ID: 69c3da4f47f34ce924ad26d5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"1.7B"}. This record does not assert independent reproduction. ### GPTQ Cosine Similarity: 99.01. Result ID: 69c3da4f47f34ce924ad26c2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"8B"}. This record does not assert independent reproduction. ### FAAR+2FA Cosine Similarity: 98.96. Result ID: 69c3da4f47f34ce924ad26d4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"8B"}. This record does not assert independent reproduction. ### 4/6 Cosine Similarity: 98.92. Result ID: 69c3da4f47f34ce924ad26ca. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"8B"}. This record does not assert independent reproduction. ### MR-GPTQ Cosine Similarity: 98.76. Result ID: 69c3da4f47f34ce924ad26c5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"1.7B"}. This record does not assert independent reproduction. ### GPTQ Cosine Similarity: 98.75. Result ID: 69c3da4f47f34ce924ad26c1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"1.7B"}. This record does not assert independent reproduction. ### GPTQ+4/6 Cosine Similarity: 98.68. Result ID: 69c3da4f47f34ce924ad26cd. [Reporting paper]() Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"1.7B"}. This record does not assert independent reproduction. ### GPTQ+4/6 Cosine Similarity: 98.62. Result ID: 69c3da4f47f34ce924ad26cc. [Reporting paper]() Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"8B"}. This record does not assert independent reproduction. ### Strong Baseline Cosine Similarity: 98.59. Result ID: 69c3da4f47f34ce924ad26d2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"8B"}. This record does not assert independent reproduction. ### 4/6 Cosine Similarity: 98.5. Result ID: 69c3da4f47f34ce924ad26c8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"8B"}. This record does not assert independent reproduction. ### GPTQ+4/6 Cosine Similarity: 98.49. Result ID: 69c3da4f47f34ce924ad26ce. [Reporting paper]() Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"8B"}. This record does not assert independent reproduction. ### GPTQ Cosine Similarity: 98.45. Result ID: 69c3da4f47f34ce924ad26c0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"8B"}. This record does not assert independent reproduction. ### Strong Baseline Cosine Similarity: 98.22. Result ID: 69c3da4f47f34ce924ad26d1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"1.7B"}. This record does not assert independent reproduction. ### FAAR+2FA Cosine Similarity: 98.06. Result ID: 69c3da4f47f34ce924ad26d3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"1B"}. This record does not assert independent reproduction. ### RTN Cosine Similarity: 97.97. Result ID: 69c3da4f47f34ce924ad26bd. [Reporting paper]() Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"1.7B"}. This record does not assert independent reproduction. ### GPTQ+4/6 Cosine Similarity: 97.93. Result ID: 69c3da4f47f34ce924ad26cb. [Reporting paper]() Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"1B"}. This record does not assert independent reproduction. ### RTN Cosine Similarity: 97.92. Result ID: 69c3da4f47f34ce924ad26be. [Reporting paper]() Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"8B"}. This record does not assert independent reproduction. ### MR-GPTQ Cosine Similarity: 97.9. Result ID: 69c3da4f47f34ce924ad26c3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"1B"}. This record does not assert independent reproduction. ### MR-GPTQ Cosine Similarity: 97.8. Result ID: 69c3da4f47f34ce924ad26c4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"8B"}. This record does not assert independent reproduction. ### GPTQ Cosine Similarity: 97.78. Result ID: 69c3da4f47f34ce924ad26bf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"1B"}. This record does not assert independent reproduction. ### Strong Baseline Cosine Similarity: 97.78. Result ID: 69c3da4f47f34ce924ad26d0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"8B"}. This record does not assert independent reproduction. ### RTN Cosine Similarity: 97.23. Result ID: 69c3da4f47f34ce924ad26bc. [Reporting paper]() Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"8B"}. This record does not assert independent reproduction. ### 4/6 Cosine Similarity: 96.94. Result ID: 69c3da4f47f34ce924ad26c9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Qwen3","Model Size":"1.7B"}. This record does not assert independent reproduction. ### 4/6 Cosine Similarity: 96.72. Result ID: 69c3da4f47f34ce924ad26c7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"1B"}. This record does not assert independent reproduction. ### Strong Baseline Cosine Similarity: 96.55. Result ID: 69c3da4f47f34ce924ad26cf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"1B"}. This record does not assert independent reproduction. ### RTN Cosine Similarity: 96.08. Result ID: 69c3da4f47f34ce924ad26bb. [Reporting paper]() Recorded evaluation configuration: {"Model Architecture":"Llama3","Model Size":"1B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.