Multiple-choice Question Answering on MMLU-ProX T5
25.2AccuracyCOMPASS-ECDA
Evaluation results
| Method | Links | |
|---|---|---|
| COMPASS-ECDABackbone=LLaMA-3.1-Instruct-8B, Number of random seeds=32026.04 | 25.2 | |
| Full RetrainingBackbone=LLaMA-3.1-Instruct-8B, Number of random seeds=32026.04 | 25.1 | |
| Naive Fine-tuningBackbone=LLaMA-3.1-Instruct-8B, Number of random seeds=32026.04 | 24.6 | |
| EWCBackbone=LLaMA-3.1-Instruct-8B, Number of random seeds=32026.04 | 24.1 | |
| Random RehearsalBackbone=LLaMA-3.1-Instruct-8B, Number of random seeds=32026.04 | 23.6 |