Classification on SuperGLUE (Coverage Loss & Accuracy Loss)
1Coverage LossCalibration Replay
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Calibration ReplayModel=Llama-3 8B, Buffer size (m)=2002026.04 | 1 | 4 | |
| Calibration ReplayModel=Pythia-410M, Buffer size (m)=2002026.04 | 2 | 7 | |
| Calibration ReplayModel=Pythia-1.4B, Buffer size (m)=2002026.04 | 2 | 5 | |
| Calibration ReplayModel=Llama-3 1B, Buffer size (m)=2002026.04 | 2 | 5 | |
| Calibration ReplayModel=Mistral 7B, Buffer size (m)=2002026.04 | 2 | 4 |