Next Utterance Prediction on Persona-Chat (val)
77.01Accuracyfull-precision
Evaluation Results
| Method | Links | |
|---|---|---|
| full-precisionBits (W-E-A)=full-prec., Size (MB)=474.92022.03 | 77.01 | |
| QuantGPTBits (W-E-A)=4-4-8, Size (MB)=62.42022.03 | 76.57 | |
| QuantGPTBits (W-E-A)=8-8-8, Size (MB)=121.42022.03 | 76.12 | |
| LAQBits (W-E-A)=8-8-8, Size (MB)=121.42022.03 | 76.02 | |
| LSQBits (W-E-A)=8-8-8, Size (MB)=121.42022.03 | 75.28 | |
| QuantGPTBits (W-E-A)=2-2-8, Size (MB)=33.02022.03 | 74.78 | |
| PACTBits (W-E-A)=8-8-8, Size (MB)=121.42022.03 | 74.73 | |
| LAQBits (W-E-A)=4-4-8, Size (MB)=62.42022.03 | 71.71 | |
| LAQBits (W-E-A)=2-2-8, Size (MB)=33.02022.03 | 71.36 | |
| LSQBits (W-E-A)=4-4-8, Size (MB)=62.42022.03 | 45.1 | |
| PACTBits (W-E-A)=4-4-8, Size (MB)=62.42022.03 | 25.13 | |
| LSQBits (W-E-A)=2-2-8, Size (MB)=33.02022.03 | 5.54 | |
| PACTBits (W-E-A)=2-2-8, Size (MB)=33.02022.03 | 5.52 |