Question Answering on GoE
83.17AccuracyIn-Squeeze
Evaluation Results
| Method | Links | |
|---|---|---|
| In-Squeezereduction=128 ... -> 1, strategy=Min steps2026.02 | 83.17 | |
| In-Squeezereduction=128 ... -> 1, strategy=Standard2026.02 | 83.15 | |
| Direct Fine-tuningrank=1, training_steps=+0 steps2026.02 | 82.51 | |
| Cont-Squeezereduction=128 -> 1, training_steps=+200 steps2026.02 | 82.16 | |
| Cont-Squeezereduction=128 -> 1, training_steps=+700 steps2026.02 | 81.94 | |
| Direct Fine-tuningrank=1, training_steps=+200 steps2026.02 | 81.84 | |
| Direct Fine-tuningrank=1, training_steps=+700 steps2026.02 | 81.28 | |
| Cont-Squeezereduction=128 -> 1, training_steps=+0 steps2026.02 | 80.23 |