Question Answering on BioASQ MRQA Out-of-domain
49.37F1 ScoreFull-FT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Full-FTEvaluation Protocol=Fine-tuning2025.10 | 49.37 | 36.77 | |
| SACCompression Ratio=15x, Evaluation Protocol=Fine-tuning2025.10 | 41.31 | 28.66 | |
| EPLCompression Ratio=15x, Evaluation Protocol=Fine-tuning2025.10 | 40.52 | 28.52 | |
| DASTCompression Ratio=15x, Evaluation Protocol=Fine-tuning2025.10 | 36.57 | 27.06 | |
| 500xCompression Ratio=15x, Evaluation Protocol=Fine-tuning2025.10 | 36.3 | 25.93 | |
| BeaconCompression Ratio=15x, Evaluation Protocol=Fine-tuning2025.10 | 36.07 | 7.65 | |
| ICAECompression Ratio=15x, Evaluation Protocol=Fine-tuning2025.10 | 35.51 | 24.47 | |
| Lingua-2Compression Ratio=5x, Evaluation Protocol=Fine-tuning2025.10 | 27.76 | 19.48 |