# Neighborhood Attention Forward Pass on NATTEN Problem Set 2-dimensional (test) Source: [Neighborhood Attention Forward Pass on NATTEN Problem Set 2-dimensional (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:44:50.729Z Evaluation of Neighborhood Attention Forward Pass performance on the test split of the NATTEN Problem Set 2-dimensional dataset, comparing various attention mechanisms (Naive, GEMM, Fused, FMHA, FAv2). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Neighborhood Attention Forward Pass | | Dataset (including any stated split) | NATTEN Problem Set 2-dimensional (test) | | Metric | FMHA Match/Outperform Rate (Self Attn) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 6 of 6 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [FMHA Match/Outperform Rate (Self Attn)](): Higher is better; unit: PERCENT. - [Naive Match/Outperform Rate (Neighborhood Attn)](): Higher is better; unit: PERCENT. - [GEMM Match/Outperform Rate (Neighborhood Attn)](): Higher is better; unit: PERCENT. - [Fused Match/Outperform Rate (Neighborhood Attn)](): Higher is better; unit: PERCENT. - [FAv2 Match/Outperform Rate (Self Attn)](): Higher is better; unit: PERCENT. ## Recorded results | Method | FMHA Match/Outperform Rate (Self Attn) | Result date | Report paper | | --- | --- | --- | --- | | Fused Neighborhood Attention | 99.3 | Not recorded | 68fa757a1e209131cea683c0 | | Fused neighborhood attention | 98.6 | Not recorded | 68fa757a1e209131cea683c0 | | GEMM-based Neighborhood Attention | 92.4 | Not recorded | 68fa757a1e209131cea683c0 | | GEMM neighborhood attention | 59.3 | Not recorded | 68fa757a1e209131cea683c0 | | Naive Neighborhood Attention | 52 | Not recorded | 68fa757a1e209131cea683c0 | | Naive neighborhood attention | 32.9 | Not recorded | 68fa757a1e209131cea683c0 | ### Fused Neighborhood Attention FMHA Match/Outperform Rate (Self Attn): 99.3. Result ID: 6993b62e3a6c31484917ff98. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Precision":"FP32","Pass":"Forward","Hardware":"NVIDIA A100 GPU"}. This record does not assert independent reproduction. ### Fused neighborhood attention FMHA Match/Outperform Rate (Self Attn): 98.6. Result ID: 6993b62e3a6c31484917ff90. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Precision":"FP16","Dimensionality":"2D"}. This record does not assert independent reproduction. ### GEMM-based Neighborhood Attention FMHA Match/Outperform Rate (Self Attn): 92.4. Result ID: 6993b62e3a6c31484917ff97. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Precision":"FP32","Pass":"Forward","Hardware":"NVIDIA A100 GPU"}. This record does not assert independent reproduction. ### GEMM neighborhood attention FMHA Match/Outperform Rate (Self Attn): 59.3. Result ID: 6993b62e3a6c31484917ff8f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Precision":"FP16","Dimensionality":"2D"}. This record does not assert independent reproduction. ### Naive Neighborhood Attention FMHA Match/Outperform Rate (Self Attn): 52. Result ID: 6993b62e3a6c31484917ff96. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Precision":"FP32","Pass":"Forward","Hardware":"NVIDIA A100 GPU"}. This record does not assert independent reproduction. ### Naive neighborhood attention FMHA Match/Outperform Rate (Self Attn): 32.9. Result ID: 6993b62e3a6c31484917ff8e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Precision":"FP16","Dimensionality":"2D"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.