Zero-shot Classification on PIQA, HellaSwag, LAMBADA, ARC-e, ARC-c, SciQ, Race, MMLU
77.7PIQAQwen3 8B
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Qwen3 8BCR=None2026.02 | 77.7 | 74.9 | 64.1 | 80.7 | 56.7 | 95.7 | 40.9 | 73 | 70.5 | |
| ROCKETCR=0.22026.02 | 77.6 | 72.9 | 66 | 75.8 | 53.9 | 94.5 | 41.4 | 67.2 | 68.7 | |
| CoSpaDiCR=0.22026.02 | 76.5 | 68 | 65.6 | 72.2 | 48.9 | 93.2 | 40.7 | 60.8 | 65.7 | |
| ROCKETCR=0.32026.02 | 75.1 | 67.2 | 68 | 72.1 | 47.7 | 92.9 | 41.4 | 62.3 | 65.8 | |
| Llama3.2 1BZero-shot=true2025.09 | 74.5 | 63.7 | 63 | 60.5 | 36.2 | 88.3 | 37.8 | 37 | 57.6 | |
| Llama3.2-1BCR=None, Backbone=Llama3.2-1B2026.02 | 74.5 | 63.7 | 63 | 60.5 | 36.2 | 88.3 | 37.8 | 37 | 57.6 | |
| SVD-LLMCR=0.22026.02 | 73.8 | 63.9 | 62.2 | 68.7 | 45.7 | 90.1 | 40.5 | 54.7 | 62.5 | |
| CoSpaDiCR=0.32026.02 | 72.4 | 60.5 | 62.6 | 63.9 | 41.2 | 88.4 | 39.5 | 51.3 | 60 | |
| ROCKETCR=0.42026.02 | 71 | 58.7 | 63.7 | 65.7 | 40.4 | 86.1 | 41.9 | 52.3 | 60 | |
| COMPOTCR=0.2, Backbone=Llama3.2-1B, Mode=Dynamic2026.02 | 70.6 | 54.6 | 47.6 | 52.5 | 31.1 | 81.6 | 35.7 | 26.7 | 50.1 | |
| SVD-LLMCR=0.32026.02 | 70.4 | 55.2 | 53.8 | 59.3 | 37.1 | 87.2 | 38.4 | 44.8 | 55.8 | |
| COMPOT†CR=0.2, Backbone=Llama3.2-1B, Mode=Static2026.02 | 69.7 | 52.1 | 42.1 | 49.9 | 30.2 | 81.8 | 33.9 | 28.5 | 48.5 | |
| CoSpaDiCR=0.42026.02 | 68.9 | 49 | 49.9 | 49.4 | 29.9 | 82 | 36.8 | 36.6 | 50.3 | |
| ROCKETCR=0.52026.02 | 68.8 | 48.4 | 47.5 | 54.8 | 33 | 81.6 | 38.5 | 37.9 | 51.3 | |
| COMPOTCR=0.3, Backbone=Llama3.2-1B, Mode=Dynamic2026.02 | 67 | 46.8 | 37.9 | 47.1 | 27.1 | 77.3 | 33.1 | 23.8 | 45 | |
| SVD-LLMCR=0.42026.02 | 66.3 | 44.6 | 37.9 | 45 | 28.1 | 77.3 | 35.3 | 29.1 | 45.4 | |
| CoSpaDiData-Aware=true, CR=0.2, Zero-shot=true2025.09 | 66.1 | 42.9 | 38.4 | 39.9 | 26 | 71.6 | 31.7 | 24.8 | 42.7 | |
| CoSpaDiCR=0.2, Backbone=Llama3.2-1B2026.02 | 66.1 | 42.9 | 38.4 | 39.9 | 26 | 71.6 | 31.7 | 24.8 | 42.7 | |
| COMPOT†CR=0.3, Backbone=Llama3.2-1B, Mode=Static2026.02 | 64.2 | 41 | 27.5 | 39.8 | 26 | 73.2 | 31.4 | 23.5 | 40.8 | |
| CoSpaDiCR=0.52026.02 | 63.8 | 39.7 | 32.4 | 41.2 | 26.8 | 70.4 | 33.2 | 28.1 | 42 | |
| COMPOTCR=0.4, Backbone=Llama3.2-1B, Mode=Dynamic2026.02 | 62.9 | 37.5 | 21.3 | 38 | 25.3 | 62.4 | 30.6 | 23 | 37.6 | |
| SVD-LLMData-Aware=true, CR=0.2, Zero-shot=true2025.09 | 62.1 | 36.4 | 24.4 | 36 | 25.1 | 64.9 | 29 | 23 | 37.6 | |
| SVD-LLMCR=0.2, Backbone=Llama3.2-1B2026.02 | 62.1 | 36.4 | 24.4 | 36 | 25.1 | 64.9 | 29 | 23 | 37.6 | |
| SVD-LLMCR=0.52026.02 | 61.5 | 34.9 | 25.1 | 37.4 | 25.3 | 65.1 | 31.6 | 24 | 38.1 | |
| COMPOT†CR=0.4, Backbone=Llama3.2-1B, Mode=Static2026.02 | 57 | 31.1 | 7.9 | 31.7 | 22.1 | 53 | 27 | 23.1 | 31.6 | |
| CoSpaDiData-Aware=true, CR=0.3, Zero-shot=true2025.09 | 56.9 | 32.4 | 18.2 | 31.9 | 22.1 | 56.7 | 28 | 23.1 | 33.7 | |
| CoSpaDiCR=0.3, Backbone=Llama3.2-1B2026.02 | 56.9 | 32.4 | 18.2 | 31.9 | 22.1 | 56.7 | 28 | 23.1 | 33.7 | |
| SVD-LLMData-Aware=true, CR=0.3, Zero-shot=true2025.09 | 55.7 | 30.1 | 9.1 | 30.5 | 21.5 | 45.9 | 25.8 | 23.2 | 30.2 | |
| SVD-LLMCR=0.3, Backbone=Llama3.2-1B2026.02 | 55.7 | 30.1 | 9.1 | 30.5 | 21.5 | 45.9 | 25.8 | 23.2 | 30.2 | |
| CoSpaDiData-Aware=true, CR=0.4, Zero-shot=true2025.09 | 53.5 | 28.2 | 3.8 | 27.8 | 23 | 36.9 | 24 | 23.1 | 27.5 | |
| CoSpaDiCR=0.4, Backbone=Llama3.2-1B2026.02 | 53.5 | 28.2 | 3.8 | 27.8 | 23 | 36.9 | 24 | 23.1 | 27.5 | |
| SVDData-Aware=false, CR=0.4, Zero-shot=true2025.09 | 52.8 | 25.9 | 0 | 23.9 | 21.3 | 19.9 | 22.2 | 26.9 | 24.1 | |
| SVDData-Aware=false, CR=0.3, Zero-shot=true2025.09 | 52.3 | 25.6 | 0 | 24.2 | 23.5 | 19.5 | 21.9 | 27 | 24.3 | |
| SVDData-Aware=false, CR=0.2, Zero-shot=true2025.09 | 52 | 25.7 | 0 | 24.7 | 22.1 | 20 | 21.4 | 25.4 | 23.9 | |
| SVD-LLMData-Aware=true, CR=0.4, Zero-shot=true2025.09 | 51.8 | 27.3 | 1.3 | 26.9 | 22.9 | 32.3 | 24.4 | 23 | 26.2 | |
| SVD-LLMCR=0.4, Backbone=Llama3.2-1B2026.02 | 51.8 | 27.3 | 1.3 | 26.9 | 22.9 | 32.3 | 24.4 | 23 | 26.2 | |
| CoSpaDi†Data-Aware=false, CR=0.2, Zero-shot=true2025.09 | 51.7 | 26.4 | 0 | 25.4 | 25.3 | 21 | 21.8 | 24.1 | 24.5 | |
| CoSpaDi†Data-Aware=false, CR=0.4, Zero-shot=true2025.09 | 51 | 26.3 | 0 | 25.5 | 26.9 | 21.3 | 21.2 | 25.5 | 24.7 | |
| CoSpaDi†Data-Aware=false, CR=0.3, Zero-shot=true2025.09 | 50.5 | 26.3 | 0 | 24.5 | 26.1 | 21.8 | 21.5 | 25.5 | 24.5 |