ResearchTasksMulti-Head AttentionMulti-Head AttentionFollowBenchmarksDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyDatasetSOTA methodMetricTrendResultsLast updatedT4 GPU Synthetic Performance BenchmarkDeepSeek-V3 + Ours17.79Performance (TFLOPS)2Feb 26, 2026