# Neighborhood Attention Forward Pass on NATTEN Problem Set 1-dimensional (test) Source: [Neighborhood Attention Forward Pass on NATTEN Problem Set 1-dimensional (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:44:50.698Z Evaluation of the forward pass performance for various neighborhood attention implementations (Naive, GEMM, Fused) compared to standard self-attention mechanisms (FMHA, FAv2) on the test split of the NATTEN Problem Set 1-dimensional dataset. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Neighborhood Attention Forward Pass | | Dataset (including any stated split) | NATTEN Problem Set 1-dimensional (test) | | Metric | FMHA % Matched/Outperformed (NATTEN 1D) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 6 of 6 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [FMHA % Matched/Outperformed (NATTEN 1D)](): Higher is better; unit: PERCENT. - [Naive Attn % Matched/Outperformed (NATTEN 1D)](): Higher is better; unit: PERCENT. - [GEMM Attn % Matched/Outperformed (NATTEN 1D)](): Higher is better; unit: PERCENT. - [Fused Attn % Matched/Outperformed (NATTEN 1D)](): Higher is better; unit: PERCENT. - [FAv2 % Matched/Outperformed (NATTEN 1D)](): Higher is better; unit: PERCENT. ## Recorded results | Method | FMHA % Matched/Outperformed (NATTEN 1D) | Result date | Report paper | | --- | --- | --- | --- | | Fused neighborhood attention | 100 | Not recorded | 68fa757a1e209131cea683c0 | | Fused Neighborhood Attention | 99.9 | Not recorded | 68fa757a1e209131cea683c0 | | GEMM-based Neighborhood Attention | 98.4 | Not recorded | 68fa757a1e209131cea683c0 | | GEMM neighborhood attention | 72 | Not recorded | 68fa757a1e209131cea683c0 | | Naive Neighborhood Attention | 34.6 | Not recorded | 68fa757a1e209131cea683c0 | | Naive neighborhood attention | 21.8 | Not recorded | 68fa757a1e209131cea683c0 | ### Fused neighborhood attention FMHA % Matched/Outperformed (NATTEN 1D): 100. Result ID: 6993b62e3a6c31484917ff8d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Precision":"FP16","Dimensionality":"1D"}. This record does not assert independent reproduction. ### Fused Neighborhood Attention FMHA % Matched/Outperformed (NATTEN 1D): 99.9. Result ID: 6993b62e3a6c31484917ff95. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Precision":"FP32","Pass":"Forward","Hardware":"NVIDIA A100 GPU"}. This record does not assert independent reproduction. ### GEMM-based Neighborhood Attention FMHA % Matched/Outperformed (NATTEN 1D): 98.4. Result ID: 6993b62e3a6c31484917ff94. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Precision":"FP32","Pass":"Forward","Hardware":"NVIDIA A100 GPU"}. This record does not assert independent reproduction. ### GEMM neighborhood attention FMHA % Matched/Outperformed (NATTEN 1D): 72. Result ID: 6993b62e3a6c31484917ff8c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Precision":"FP16","Dimensionality":"1D"}. This record does not assert independent reproduction. ### Naive Neighborhood Attention FMHA % Matched/Outperformed (NATTEN 1D): 34.6. Result ID: 6993b62e3a6c31484917ff93. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Precision":"FP32","Pass":"Forward","Hardware":"NVIDIA A100 GPU"}. This record does not assert independent reproduction. ### Naive neighborhood attention FMHA % Matched/Outperformed (NATTEN 1D): 21.8. Result ID: 6993b62e3a6c31484917ff8b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Precision":"FP16","Dimensionality":"1D"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.