Genomic sequence classification on Nucleotide Transformer Benchmark Human 500M (test)
0.5653MCCGERM-T
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GERM-TFine-Tuning Method=Full, Base Model=NT-500M-human2025.05 | 0.5653 | -0.48 | — | |
| GERM-T#Bits=16W/16A, Quantization Method=-2025.05 | 0.5653 | -0.0048 | — | |
| NT-500M-humanFine-Tuning Method=Full2025.05 | 0.5605 | — | — | |
| NT-500M-human#Bits=16W/16A, Quantization Method=-2025.05 | 0.5605 | — | — | |
| GERM#Bits=16W/16A, Quantization Method=-2025.05 | 0.5553 | 0.0052 | — | |
| GERMFine-Tuning Method=Full, Base Model=NT-500M-human2025.05 | 0.5552 | 0.53 | — | |
| GERM-TFine-Tuning Method=LoRA, Base Model=NT-500M-human2025.05 | 0.5489 | 1.16 | 2.9 | |
| GERMFine-Tuning Method=LoRA, Base Model=NT-500M-human2025.05 | 0.5432 | 1.73 | 2.16 | |
| GERMFine-Tuning Method=LoftQ, Base Model=NT-500M-human2025.05 | 0.5424 | 1.81 | 2.3 | |
| GERM-T#Bits=8W/8A, Quantization Method=SmoothQuant2025.05 | 0.5419 | 0.0186 | 4.14 | |
| GERMFine-Tuning Method=QLoRA, Base Model=NT-500M-human2025.05 | 0.5378 | 2.27 | 3.13 | |
| GERM#Bits=8W/8A, Quantization Method=-2025.05 | 0.5367 | 0.0238 | 3.35 | |
| GERM-TFine-Tuning Method=LoftQ, Base Model=NT-500M-human2025.05 | 0.5345 | 2.6 | 5.45 | |
| GERM#Bits=8W/8A, Quantization Method=SmoothQuant2025.05 | 0.5318 | 0.0287 | 4.23 | |
| GERM-TFine-Tuning Method=QLoRA, Base Model=NT-500M-human2025.05 | 0.5278 | 3.27 | 6.63 | |
| NT-500M-humanFine-Tuning Method=LoRA2025.05 | 0.5266 | 3.39 | 6.44 | |
| GERM-T#Bits=8W/8A, Quantization Method=OmniQuant2025.05 | 0.5246 | 0.0359 | 7.2 | |
| GERM#Bits=8W/8A, Quantization Method=OmniQuant2025.05 | 0.5245 | 0.036 | 5.55 | |
| GERM#Bits=6W/6A, Quantization Method=SmoothQuant2025.05 | 0.5243 | 0.0362 | 5.58 | |
| NT-500M-humanFine-Tuning Method=LoftQ2025.05 | 0.5189 | 4.16 | 7.42 | |
| GERM#Bits=6W/6A, Quantization Method=OmniQuant2025.05 | 0.5156 | 0.0449 | 7.15 | |
| NT-500M-humanFine-Tuning Method=QLoRA2025.05 | 0.5146 | 4.59 | 8.19 | |
| GERM-T#Bits=6W/6A, Quantization Method=OmniQuant2025.05 | 0.5134 | 0.0471 | 9.18 | |
| NT-500M-human#Bits=8W/8A, Quantization Method=OmniQuant2025.05 | 0.4735 | 0.087 | 15.52 | |
| GERM#Bits=4W/4A, Quantization Method=OmniQuant2025.05 | 0.4645 | 0.096 | 16.35 | |
| GERM-T#Bits=8W/8A, Quantization Method=Outlier2025.05 | 0.4598 | 0.1007 | 18.66 | |
| GERM#Bits=8W/8A, Quantization Method=Outlier2025.05 | 0.4571 | 0.1034 | 17.68 | |
| NT-500M-human#Bits=6W/6A, Quantization Method=OmniQuant2025.05 | 0.4363 | 0.1242 | 22.16 | |
| GERM-T#Bits=6W/6A, Quantization Method=Outlier2025.05 | 0.4338 | 0.1267 | 23.26 | |
| GERM#Bits=8W/8A, Quantization Method=Outlier2025.05 | 0.4138 | 0.1467 | 25.48 | |
| GERM-T#Bits=8W/8A, Quantization Method=-2025.05 | 0.4071 | 0.1534 | 27.99 | |
| GERM-T#Bits=6W/6A, Quantization Method=SmoothQuant2025.05 | 0.3867 | 0.1738 | 31.59 | |
| NT-500M-human#Bits=8W/8A, Quantization Method=SmoothQuant2025.05 | 0.3823 | 0.1782 | 31.79 | |
| NT-500M-human#Bits=8W/8A, Quantization Method=-2025.05 | 0.3466 | 0.2139 | 38.17 | |
| NT-500M-human#Bits=8W/8A, Quantization Method=Outlier2025.05 | 0.3295 | 0.231 | 41.21 | |
| NT-500M-human#Bits=6W/6A, Quantization Method=SmoothQuant2025.05 | 0.2867 | 0.2738 | 48.84 | |
| NT-500M-human#Bits=6W/6A, Quantization Method=Outlier2025.05 | 0.2665 | 0.294 | 52.45 | |
| GERM#Bits=4W/4A, Quantization Method=SmoothQuant2025.05 | 0.2496 | 0.3109 | 55.05 | |
| GERM-T#Bits=4W/4A, Quantization Method=OmniQuant2025.05 | 0.2357 | 0.3248 | 58.31 | |
| GERM-T#Bits=4W/4A, Quantization Method=SmoothQuant2025.05 | 0.1057 | 0.4548 | 81.29 | |
| NT-500M-human#Bits=4W/4A, Quantization Method=OmniQuant2025.05 | 0.0534 | 0.5071 | 90.47 | |
| NT-500M-human#Bits=4W/4A, Quantization Method=SmoothQuant2025.05 | 0.0354 | 0.5251 | 93.68 |