Biomedical Natural Language Processing on Biomedical NLP Benchmarks
89.5F1 ScoreStripedHyena
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| StripedHyenaArchitecture=SSM-Conv, Key Contribution=Hybrid SSM, Speed (s)=0.11, Memory (MB)=155, Primary Limitation=Fixed pattern2026.01 | 89.5 | — | — | — | — | |
| JambaArchitecture=Hybrid MoE, Key Contribution=SSM+Trans, Speed (s)=0.45, Memory (MB)=210, Primary Limitation=Fixed routing2026.01 | 89 | — | — | — | — | |
| LongformerArchitecture=Sparse Trans, Key Contribution=Long context, Speed (s)=0.45, Memory (MB)=180, Primary Limitation=Weak local2026.01 | 88 | — | — | — | — | |
| BioMambaArchitecture=SSM (Bio), Key Contribution=Domain SSM, Speed (s)=0.092, Memory (MB)=145, Primary Limitation=Short-context2026.01 | 88 | — | — | — | 0.88 | |
| Mamba-2Architecture=SSM, Key Contribution=HW-optimized, Speed (s)=0.085, Memory (MB)=138, Primary Limitation=Limited local2026.01 | 87 | — | — | — | 0.87 | |
| MambaArchitecture=SSM, Key Contribution=Linear scan, Speed (s)=0.1, Memory (MB)=142, Primary Limitation=Short-context2026.01 | 85 | — | — | — | — | |
| BioBERTArchitecture=Transformer, Key Contribution=Biomedical pretrain, Speed (s)=1.9, Memory (MB)=195, Primary Limitation=High latency2026.01 | — | — | — | 0.9 | — | |
| Mistral 7BArchitecture=MoE-Trans, Key Contribution=Efficient MoE, Speed (s)=0.35, Memory (MB)=14000, Primary Limitation=High memory2026.01 | — | — | 0.91 | — | — | |
| MoE-MambaArchitecture=MoE+SSM, Key Contribution=Sparse routing, Speed (s)=0.095, Memory (MB)=165, Primary Limitation=Block routing2026.01 | — | 0.902 | — | — | — |