Fine-tuning on Average (GSM8k, ViGGO, SQL) (val)
81.1AccuracyFull
Evaluation Results
| Method | Links | |
|---|---|---|
| FullSampling Ratio=100%, Backbone=Llama3-8B, Embeddings=BERT2026.06 | 81.1 | |
| Low-rank SS (ours)Sampling Ratio=25%, Backbone=Llama3-8B, Embeddings=BERT2026.06 | 77.6 | |
| Clustering-based SSSampling Ratio=25%, Backbone=Llama3-8B, Embeddings=BERT2026.06 | 77.5 | |
| Uniform SamplingSampling Ratio=25%, Backbone=Llama3-8B, Embeddings=BERT2026.06 | 76.5 | |
| K-CenterSampling Ratio=25%, Backbone=Llama3-8B, Embeddings=BERT2026.06 | 74.9 | |
| Graph CutSampling Ratio=25%, Backbone=Llama3-8B, Embeddings=BERT2026.06 | 74 | |
| Clustering-based SSSampling Ratio=12.5%, Backbone=Llama3-8B, Embeddings=BERT2026.06 | 71 | |
| Low-rank SS (ours)Sampling Ratio=12.5%, Backbone=Llama3-8B, Embeddings=BERT2026.06 | 70.4 | |
| Uniform SamplingSampling Ratio=12.5%, Backbone=Llama3-8B, Embeddings=BERT2026.06 | 69.2 | |
| Graph CutSampling Ratio=12.5%, Backbone=Llama3-8B, Embeddings=BERT2026.06 | 65.8 | |
| K-CenterSampling Ratio=12.5%, Backbone=Llama3-8B, Embeddings=BERT2026.06 | 63.9 | |
| Low-rank SS (ours)Sampling Ratio=6.25%, Backbone=Llama3-8B, Embeddings=BERT2026.06 | 54.9 | |
| Clustering-based SSSampling Ratio=6.25%, Backbone=Llama3-8B, Embeddings=BERT2026.06 | 54.6 | |
| K-CenterSampling Ratio=6.25%, Backbone=Llama3-8B, Embeddings=BERT2026.06 | 52.3 | |
| Uniform SamplingSampling Ratio=6.25%, Backbone=Llama3-8B, Embeddings=BERT2026.06 | 52 | |
| Graph CutSampling Ratio=6.25%, Backbone=Llama3-8B, Embeddings=BERT2026.06 | 45.7 |