Accuracy on Physical IQA (PIQA)
69.85AccuracyTRANSFORMER
Evaluation Results
| Method | Links | |
|---|---|---|
| TRANSFORMEREvaluation Protocol=Zero-shot, Number of Parameters=1.3B, Training Tokens=30B2026.05 | 69.85 | |
| RESFORMEREvaluation Protocol=Zero-shot, Number of Parameters=1.3B, Training Tokens=30B2026.05 | 69.36 | |
| SATFORMEREvaluation Protocol=Zero-shot, Number of Parameters=1.3B, Training Tokens=30B2026.05 | 68.49 | |
| SATFORMEREvaluation Protocol=Zero-shot, Number of Parameters=760M, Training Tokens=20B2026.05 | 68.34 | |
| MUDDFORMEREvaluation Protocol=Zero-shot, Number of Parameters=760M, Training Tokens=20B2026.05 | 68.28 | |
| DENSEFORMEREvaluation Protocol=Zero-shot, Number of Parameters=760M, Training Tokens=20B2026.05 | 68.17 | |
| HYPERCONNECTIONSEvaluation Protocol=Zero-shot, Number of Parameters=760M, Training Tokens=20B2026.05 | 67.84 | |
| TRANSFORMEREvaluation Protocol=Zero-shot, Number of Parameters=760M, Training Tokens=20B2026.05 | 67.14 | |
| RESFORMEREvaluation Protocol=Zero-shot, Number of Parameters=760M, Training Tokens=20B2026.05 | 66.87 | |
| SATFORMEREvaluation Protocol=Zero-shot, Number of Parameters=340M, Training Tokens=10B2026.05 | 65.89 | |
| MUDDFORMEREvaluation Protocol=Zero-shot, Number of Parameters=340M, Training Tokens=10B2026.05 | 65.72 | |
| DENSEFORMEREvaluation Protocol=Zero-shot, Number of Parameters=340M, Training Tokens=10B2026.05 | 65.4 | |
| TRANSFORMEREvaluation Protocol=Zero-shot, Number of Parameters=340M, Training Tokens=10B2026.05 | 65.07 | |
| HYPERCONNECTIONSEvaluation Protocol=Zero-shot, Number of Parameters=340M, Training Tokens=10B2026.05 | 64.85 | |
| RESFORMEREvaluation Protocol=Zero-shot, Number of Parameters=340M, Training Tokens=10B2026.05 | 64.74 | |
| SATFORMEREvaluation Protocol=Zero-shot, Number of Parameters=130M, Training Tokens=5B2026.05 | 61.97 | |
| DENSEFORMEREvaluation Protocol=Zero-shot, Number of Parameters=130M, Training Tokens=5B2026.05 | 61.32 | |
| HYPERCONNECTIONSEvaluation Protocol=Zero-shot, Number of Parameters=130M, Training Tokens=5B2026.05 | 61.31 | |
| TRANSFORMEREvaluation Protocol=Zero-shot, Number of Parameters=130M, Training Tokens=5B2026.05 | 61.21 | |
| MUDDFORMEREvaluation Protocol=Zero-shot, Number of Parameters=130M, Training Tokens=5B2026.05 | 60.88 | |
| RESFORMEREvaluation Protocol=Zero-shot, Number of Parameters=130M, Training Tokens=5B2026.05 | 60.07 |