List your company
ResearchFormerly WizWand

Accuracy on Physical IQA (PIQA)

69.85AccuracyTRANSFORMER
59.678862.319464.9667.6006May 5, 2026
Updated 5mo ago

Evaluation results

MethodLinks
TRANSFORMEREvaluation Protocol=Zero-shot, Number of Parameters=1.3B, Training Tokens=30B2026.0569.85
RESFORMEREvaluation Protocol=Zero-shot, Number of Parameters=1.3B, Training Tokens=30B2026.0569.36
SATFORMEREvaluation Protocol=Zero-shot, Number of Parameters=1.3B, Training Tokens=30B2026.0568.49
SATFORMEREvaluation Protocol=Zero-shot, Number of Parameters=760M, Training Tokens=20B2026.0568.34
MUDDFORMEREvaluation Protocol=Zero-shot, Number of Parameters=760M, Training Tokens=20B2026.0568.28
DENSEFORMEREvaluation Protocol=Zero-shot, Number of Parameters=760M, Training Tokens=20B2026.0568.17
HYPERCONNECTIONSEvaluation Protocol=Zero-shot, Number of Parameters=760M, Training Tokens=20B2026.0567.84
TRANSFORMEREvaluation Protocol=Zero-shot, Number of Parameters=760M, Training Tokens=20B2026.0567.14
RESFORMEREvaluation Protocol=Zero-shot, Number of Parameters=760M, Training Tokens=20B2026.0566.87
SATFORMEREvaluation Protocol=Zero-shot, Number of Parameters=340M, Training Tokens=10B2026.0565.89
MUDDFORMEREvaluation Protocol=Zero-shot, Number of Parameters=340M, Training Tokens=10B2026.0565.72
DENSEFORMEREvaluation Protocol=Zero-shot, Number of Parameters=340M, Training Tokens=10B2026.0565.4
TRANSFORMEREvaluation Protocol=Zero-shot, Number of Parameters=340M, Training Tokens=10B2026.0565.07
HYPERCONNECTIONSEvaluation Protocol=Zero-shot, Number of Parameters=340M, Training Tokens=10B2026.0564.85
RESFORMEREvaluation Protocol=Zero-shot, Number of Parameters=340M, Training Tokens=10B2026.0564.74
SATFORMEREvaluation Protocol=Zero-shot, Number of Parameters=130M, Training Tokens=5B2026.0561.97
DENSEFORMEREvaluation Protocol=Zero-shot, Number of Parameters=130M, Training Tokens=5B2026.0561.32
HYPERCONNECTIONSEvaluation Protocol=Zero-shot, Number of Parameters=130M, Training Tokens=5B2026.0561.31
TRANSFORMEREvaluation Protocol=Zero-shot, Number of Parameters=130M, Training Tokens=5B2026.0561.21
MUDDFORMEREvaluation Protocol=Zero-shot, Number of Parameters=130M, Training Tokens=5B2026.0560.88
RESFORMEREvaluation Protocol=Zero-shot, Number of Parameters=130M, Training Tokens=5B2026.0560.07