Physical Interaction Question Answering on PIQA (Zero-shot)
67.5Zero-shot AccuracyDLR + CoLA
Evaluation results
| Method | Links | |
|---|---|---|
| DLR + CoLAEvaluation protocol=Zero-shot, Fine-tuning stage=Alpaca-cleaned SFT, Model scale=1B2026.06 | 67.5 | |
| Full-RankEvaluation protocol=Zero-shot, Fine-tuning stage=Alpaca-cleaned SFT, Model scale=1B2026.06 | 66.74 | |
| CoLAEvaluation protocol=Zero-shot, Fine-tuning stage=Alpaca-cleaned SFT, Model scale=1B2026.06 | 66.49 |