Reasoning on SIQA (leave-one-out setup)
82.4Average AccuracyFrom scratch
Evaluation Results
| Method | Links | |
|---|---|---|
| From scratchModel=Gemma-3 4B, Setup=LoRA2026.03 | 82.4 | |
| Mashup LearningModel=Gemma-3 4B, Setup=LoRA2026.03 | 82.2 | |
| Mashup LearningModel=Gemma-2 2B, Setup=LoRA2026.03 | 81.7 | |
| From scratchModel=Gemma-2 2B, Setup=LoRA2026.03 | 81.5 | |
| Mashup LearningModel=Gemma-3 4B, Setup=Full FT2026.03 | 81 | |
| Mashup LearningModel=Gemma-2 2B, Setup=Full FT2026.03 | 79.5 | |
| From scratchModel=Gemma-3 4B, Setup=Full FT2026.03 | 79.5 | |
| From scratchModel=Gemma-2 2B, Setup=Full FT2026.03 | 79 | |
| From scratchModel=Gemma-3 1B, Setup=LoRA2026.03 | 74.2 | |
| Mashup LearningModel=Gemma-3 1B, Setup=LoRA2026.03 | 74.1 | |
| Mashup LearningModel=Gemma-3 1B, Setup=Full FT2026.03 | 73.3 | |
| From scratchModel=Gemma-3 1B, Setup=Full FT2026.03 | 73 |