Natural Language Understanding on PIQA (Exact Match)
59.9Exact MatchAdapShot
Evaluation Results
| Method | Links | |
|---|---|---|
| AdapShotBackbone=Qwen2.5-7B2026.05 | 59.9 | |
| Many-shot (256)Backbone=Qwen2.5-7B2026.05 | 56 | |
| Many-shot (512)Backbone=Qwen2.5-7B2026.05 | 52.2 | |
| Many-shot (512)Backbone=LLaMA-3.2 (3B)2026.05 | 47.3 | |
| AdapShotBackbone=LLaMA-3.2 (3B)2026.05 | 46.9 | |
| DBSABackbone=Qwen2.5-7B2026.05 | 40.4 | |
| DBSABackbone=LLaMA-3.2 (3B)2026.05 | 36.8 | |
| Many-shot (256)Backbone=LLaMA-3.2 (3B)2026.05 | 34.5 | |
| Few-shot (8)Backbone=Qwen2.5-7B2026.05 | 31.8 | |
| Zero-shotBackbone=Qwen2.5-7B2026.05 | 29.8 | |
| Few-shot (8)Backbone=LLaMA-3.2 (3B)2026.05 | 19.3 | |
| Zero-shotBackbone=LLaMA-3.2 (3B)2026.05 | 10.7 |