Genomic Understanding on GUE (test)
67.77Average ScoreDNABERT-2
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| DNABERT-2Params.=117M, FLOPS=1.00, Trn. Tokens=263B, Further pre-training=Masked Language Modeling on GUE training sets2023.06 | 67.77 | 11 | 10 | |
| NT-2500M-multiParams.=2537M, FLOPS=19.44, Trn. Tokens=300B2023.06 | 66.93 | 7 | 9 | |
| DNABERT-2Params.=117M, FLOPS=1.00, Trn. Tokens=262B, Further pre-training=false2023.06 | 66.8 | 8 | 4 | |
| DNABERT (3-mer)Params.=86M, FLOPS=3.27, Trn. Tokens=122B2023.06 | 61.62 | 2 | 0 | |
| NT-2500M-1000gParams.=2537M, FLOPS=19.44, Trn. Tokens=300B2023.06 | 61.41 | 0 | 1 | |
| DNABERT (4-mer)Params.=86M, FLOPS=3.26, Trn. Tokens=122B2023.06 | 61.14 | 0 | 1 | |
| DNABERT (6-mer)Params.=89M, FLOPS=3.25, Trn. Tokens=122B2023.06 | 60.51 | 0 | 1 | |
| DNABERT (5-mer)Params.=87M, FLOPS=3.26, Trn. Tokens=122B2023.06 | 60.05 | 0 | 1 | |
| NT-500M-1000gParams.=480M, FLOPS=3.19, Trn. Tokens=50B2023.06 | 58.23 | 0 | 1 | |
| NT-500M-humanParams.=480M, FLOPS=3.19, Trn. Tokens=50B2023.06 | 55.43 | 0 | 0 |