Natural Language Inference on XNLI (Custom Language Set)
73.51Accuracy (en)FXT λ1
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| FXT λ1Compression Rate=3x, Model Size=small-sized, λ=12025.07 | 73.51 | 70.22 | 66.47 | 62.42 | 67.11 | 56.99 | 66.12 | |
| FXT λ3Compression Rate=3x, Model Size=small-sized, λ=32025.07 | 73.35 | 70.22 | 66.75 | 62.36 | 67.82 | 57.33 | 66.31 | |
| FIXEDCompression Rate=3x, Model Size=small-sized2025.07 | 73.25 | 69.84 | 66.47 | 61.59 | 67.52 | 57.09 | 65.96 | |
| FXT λ2Compression Rate=3x, Model Size=small-sized, λ=22025.07 | 73.21 | 70.84 | 66.97 | 62.16 | 66.71 | 57.58 | 66.25 | |
| BPECompression Rate=3x, Model Size=small-sized2025.07 | 73.09 | 69.9 | 65.95 | 61.48 | 68 | 54.11 | 65.42 | |
| BINOMIALCompression Rate=3x, Model Size=small-sized2025.07 | 72.87 | 70.28 | 65.93 | 62.26 | 66.11 | 54.79 | 65.37 |