Question Answering on TYDIQA (Accuracy, AVERAGE MEAN)
56.62AccuracyTRIM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TRIMBase Model=LLAMA-2-7B, Coreset size=5%, Number of seeds=32025.10 | 56.62 | 48.56 | |
| LESSBase Model=LLAMA-2-7B, Coreset size=5%, Number of seeds=32025.10 | 56.13 | 48.27 | |
| Full-data Fine-tuningBase Model=LLAMA-2-7B, Coreset size=100%, Number of seeds=32025.10 | 54 | 48.99 | |
| TAGCOSBase Model=LLAMA-2-7B, Coreset size=5%, Number of seeds=32025.10 | 53.45 | 46.6 | |
| S2LBase Model=LLAMA-2-7B, Coreset size=5%, Number of seeds=32025.10 | 52.74 | 45.56 | |
| BM25Base Model=LLAMA-2-7B, Coreset size=5%, Number of seeds=32025.10 | 52.7 | 45.41 | |
| RandomBase Model=LLAMA-2-7B, Coreset size=5%, Number of seeds=32025.10 | 52.45 | 45.14 | |
| Pretrained (no Fine-tuning)Base Model=LLAMA-2-7B, Number of seeds=32025.10 | 46.4 | 43.43 | |
| RDSBase Model=LLAMA-2-7B, Coreset size=5%, Number of seeds=32025.10 | 46.1 | 42.17 | |
| DSIRBase Model=LLAMA-2-7B, Coreset size=5%, Number of seeds=32025.10 | 45.62 | 42.02 | |
| CLDBase Model=LLAMA-2-7B, Coreset size=5%, Number of seeds=32025.10 | 45.58 | 42.61 |