Few-shot classification on Synthetic Few-shot (P_bursty=0.1, alpha=0)
92ICL AccuracyCoQE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CoQEE=512, L=4, #Param=2.0M2026.03 | 92 | 95.4 | |
| CoQEE=256, L=4, #Param=1.0M2026.03 | 90.3 | 87.9 | |
| Transformer + RegularizationE=64, L=12, #Param=0.9M2026.03 | 53.1 | 98.5 | |
| TransformerE=512, L=8, #Param=2.2M2026.03 | 51 | 99.1 | |
| TransformerE=512, L=4, #Param=2.0M2026.03 | 51 | 99.2 | |
| Transformer + Temporary ForgettingE=64, L=12, #Param=0.9M2026.03 | 51 | 38.5 | |
| TransformerE=256, L=8, #Param=1.2M2026.03 | 50.7 | 78.5 | |
| TransformerE=256, L=4, #Param=1.0M2026.03 | 50.7 | 81.1 | |
| TransformerE=64, L=12, #Param=0.9M2026.03 | 50.5 | 51.5 | |
| TransformerE=256, L=12, #Param=1.4M2026.03 | 50.5 | 75.4 | |
| TransformerE=512, L=12, #Param=2.4M2026.03 | 50.5 | 99 | |
| TransformerE=64, L=4, #Param=0.4M2026.03 | 50.4 | 63.1 | |
| TransformerE=64, L=8, #Param=0.6M2026.03 | 50.3 | 57.9 | |
| Linear TransformerE=64, L=12, #Param=0.8M2026.03 | 50.3 | 53.5 | |
| Transformer + NoiseE=64, L=12, #Param=0.9M2026.03 | 50.1 | 49.9 |