Arithmetic function acquisition on KGFUNC UNSEEN (Accuracy)
79Accuracy (KGFUNC UNSEEN)MIXSD
Evaluation Results
| Method | Links | |
|---|---|---|
| MIXSDModel=Qwen3-4B-It, lambda=0.52026.05 | 79 | |
| BaseModel=Qwen3-4B-It2026.05 | 78.2 | |
| MIXSDModel=Qwen3-4B-It, lambda=0.32026.05 | 67.8 | |
| BaseModel=Qwen3-8B2026.05 | 65.4 | |
| OPSD-NLLModel=Qwen3-4B-It, n=1, T=02026.05 | 56.6 | |
| OPSDModel=Qwen3-4B-It2026.05 | 55.4 | |
| MIXSDModel=Qwen3-4B-It, lambda=02026.05 | 48.4 | |
| MIXSDModel=Qwen3-1.7B, lambda=0.52026.05 | 33.2 | |
| MIXSDModel=Qwen3-8B, lambda=0.52026.05 | 31.6 | |
| BaseModel=Qwen3-1.7B2026.05 | 31.4 | |
| OPSDModel=Qwen3-1.7B2026.05 | 31 | |
| MIXSDModel=Qwen3-8B, lambda=0.32026.05 | 28.6 | |
| MIXSDModel=Qwen3-1.7B, lambda=0.32026.05 | 26.8 | |
| OPSDModel=Qwen3-8B2026.05 | 25.2 | |
| MIXSDModel=Qwen3-1.7B, lambda=02026.05 | 19.6 | |
| OPSD-NLLModel=Qwen3-8B, n=1, T=02026.05 | 12.4 | |
| OPSD-NLLModel=Qwen3-1.7B, n=1, T=02026.05 | 10.8 | |
| MIXSDModel=Qwen3-8B, lambda=02026.05 | 6.4 | |
| SFTModel=Qwen3-8B2026.05 | 2.4 | |
| SFTModel=Qwen3-4B-It2026.05 | 1.4 | |
| SFTModel=Qwen3-1.7B2026.05 | 0.4 |