Masked Language Modeling on WikiText-103 raw-v1 (test)
2.5869LossDiBARD
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| DiBARDTarget ρ=0.0869, # retuned=33,3382026.05 | 2.5869 | 13.29 | 52.1 | |
| Int4-scale-RTTarget ρ=0.1263, # retuned=30,5222026.05 | 2.6739 | 14.5 | 51.1 | |
| OriginalTarget ρ=1.0000, # retuned=02026.05 | 2.7651 | 15.88 | 49.06 | |
| DiBATarget ρ=0.0869, # retuned=02026.05 | 3.0738 | 21.62 | 44.47 | |
| Int4-PTQTarget ρ=0.1263, # retuned=02026.05 | 3.1223 | 22.7 | 41.79 | |
| Int2-PTQTarget ρ=0.0638, # retuned=02026.05 | 13.131 | 504,318.34 | 0.23 |