Genomic sequence modeling on Nucleotide Transformer (NT) 2.5B multi-species
57.16MCCGERM
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GERMModel=GERM (NT-2.5B-multi), #Bits=16W/16A, Quantization Method=-2025.05 | 57.16 | -0.18 | — | |
| GERMFine-Tuning Method=Full, Backbone=NT-2.5B-multi2025.05 | 57.16 | -0.18 | — | |
| NT-2.5B-multiModel=NT-2.5B-multi, #Bits=16W/16A, Quantization Method=-2025.05 | 56.98 | — | — | |
| NT-2.5B-multiFine-Tuning Method=Full2025.05 | 56.98 | — | — | |
| GERM-TModel=GERM-T (NT-2.5B-multi), #Bits=16W/16A, Quantization Method=-2025.05 | 56.82 | 0.16 | — | |
| GERM-TFine-Tuning Method=Full, Backbone=NT-2.5B-multi2025.05 | 56.82 | 0.16 | — | |
| GERMFine-Tuning Method=LoRA, Backbone=NT-2.5B-multi2025.05 | 55.98 | 1.18 | 2.06 | |
| GERMFine-Tuning Method=LoftQ, Backbone=NT-2.5B-multi2025.05 | 55.8 | 1.36 | 2.38 | |
| GERMFine-Tuning Method=QLoRA, Backbone=NT-2.5B-multi2025.05 | 55.52 | 1.64 | 2.87 | |
| GERM-TFine-Tuning Method=LoRA, Backbone=NT-2.5B-multi2025.05 | 55.24 | 1.58 | 2.78 | |
| GERM-TFine-Tuning Method=LoftQ, Backbone=NT-2.5B-multi2025.05 | 53.74 | 3.08 | 5.42 | |
| NT-2.5B-multiFine-Tuning Method=LoRA2025.05 | 53.5 | 3.48 | 6.11 | |
| GERM-TFine-Tuning Method=QLoRA, Backbone=NT-2.5B-multi2025.05 | 53.32 | 3.5 | 6.16 | |
| NT-2.5B-multiFine-Tuning Method=LoftQ2025.05 | 52.89 | 4.09 | 7.17 | |
| GERMModel=GERM (NT-2.5B-multi), #Bits=6W/6A, Quantization Method=OmniQuant2025.05 | 52.55 | 4.61 | 8.07 | |
| GERM-TModel=GERM-T (NT-2.5B-multi), #Bits=6W/6A, Quantization Method=OmniQuant2025.05 | 52.43 | 4.39 | 7.73 | |
| NT-2.5B-multiFine-Tuning Method=QLoRA2025.05 | 52.29 | 4.69 | 8.19 | |
| GERMModel=GERM (NT-2.5B-multi), #Bits=6W/6A, Quantization Method=Outlier2025.05 | 52.24 | 4.92 | 8.61 | |
| GERM-TModel=GERM-T (NT-2.5B-multi), #Bits=6W/6A, Quantization Method=Outlier2025.05 | 52.14 | 4.68 | 8.24 | |
| GERMModel=GERM (NT-2.5B-multi), #Bits=6W/6A, Quantization Method=SmoothQuant2025.05 | 51.95 | 5.21 | 9.11 | |
| GERM-TModel=GERM-T (NT-2.5B-multi), #Bits=6W/6A, Quantization Method=SmoothQuant2025.05 | 51.61 | 5.21 | 9.17 | |
| NT-2.5B-multiModel=NT-2.5B-multi, #Bits=6W/6A, Quantization Method=Outlier2025.05 | 50.23 | 6.75 | 11.85 | |
| NT-2.5B-multiModel=NT-2.5B-multi, #Bits=6W/6A, Quantization Method=OmniQuant2025.05 | 49.55 | 7.43 | 13.04 | |
| GERMModel=GERM (NT-2.5B-multi), #Bits=4W/4A, Quantization Method=OmniQuant2025.05 | 49.26 | 7.9 | 13.82 | |
| GERMModel=GERM (NT-2.5B-multi), #Bits=4W/4A, Quantization Method=Outlier2025.05 | 49 | 8.16 | 14.28 | |
| GERMModel=GERM (NT-2.5B-multi), #Bits=4W/4A, Quantization Method=SmoothQuant2025.05 | 48.15 | 31.09 | 15.76 | |
| GERM-TModel=GERM-T (NT-2.5B-multi), #Bits=4W/4A, Quantization Method=SmoothQuant2025.05 | 48.12 | 8.7 | 15.31 | |
| GERM-TModel=GERM-T (NT-2.5B-multi), #Bits=4W/4A, Quantization Method=OmniQuant2025.05 | 47.28 | 9.54 | 16.79 | |
| NT-2.5B-multiModel=NT-2.5B-multi, #Bits=6W/6A, Quantization Method=SmoothQuant2025.05 | 47.23 | 9.75 | 17.11 | |
| GERM-TModel=GERM-T (NT-2.5B-multi), #Bits=4W/4A, Quantization Method=Outlier2025.05 | 46.24 | 10.58 | 18.62 | |
| GERMModel=GERM (NT-2.5B-multi), #Bits=6W/6A, Quantization Method=-2025.05 | 45.96 | 11.2 | 19.59 | |
| NT-2.5B-multiModel=NT-2.5B-multi, #Bits=4W/4A, Quantization Method=OmniQuant2025.05 | 43.63 | 13.35 | 23.43 | |
| GERMModel=GERM (NT-2.5B-multi), #Bits=4W/4A, Quantization Method=-2025.05 | 42.48 | 14.68 | 25.68 | |
| NT-2.5B-multiModel=NT-2.5B-multi, #Bits=4W/4A, Quantization Method=Outlier2025.05 | 40.74 | 16.24 | 28.5 | |
| NT-2.5B-multiModel=NT-2.5B-multi, #Bits=4W/4A, Quantization Method=SmoothQuant2025.05 | 35.16 | 21.82 | 38.29 | |
| GERM-TModel=GERM-T (NT-2.5B-multi), #Bits=6W/6A, Quantization Method=-2025.05 | 32.58 | 24.24 | 42.66 | |
| NT-2.5B-multiModel=NT-2.5B-multi, #Bits=6W/6A, Quantization Method=-2025.05 | 18.52 | 38.46 | 67.5 | |
| GERM-TModel=GERM-T (NT-2.5B-multi), #Bits=4W/4A, Quantization Method=-2025.05 | 10.49 | 46.33 | 81.54 | |
| NT-2.5B-multiModel=NT-2.5B-multi, #Bits=4W/4A, Quantization Method=-2025.05 | 1.39 | 55.59 | 97.56 |