UX Perception Prediction on LabintheWild-UX
56.28AccuracyPERCEPTUI
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| PERCEPTUISetting=Participant profile2026.06 | 56.28 | 0.71 | 0.072 | 0.703 | |
| PERCEPTUI w/o RPESetting=Participant profile2026.06 | 54.16 | 0.79 | 0.083 | 0.661 | |
| PERCEPTUI w/ generic personaSetting=Generic persona2026.06 | 47.62 | 0.93 | 0.108 | 0.568 | |
| Generic personaSetting=SFT2026.06 | 44.18 | 1.01 | 0.118 | 0.534 | |
| No personaSetting=SFT2026.06 | 42.07 | 1.07 | 0.131 | 0.501 | |
| Claude Opus 4.6Setting=Zero-shot2026.06 | 39.81 | 1.12 | 0.146 | 0.476 | |
| GPT-5Setting=Zero-shot2026.06 | 38.87 | 1.12 | 0.139 | 0.477 | |
| GPT-4oSetting=Zero-shot2026.06 | 38.04 | 1.18 | 0.158 | 0.453 | |
| Gemini-2.5-proSetting=Zero-shot2026.06 | 37.55 | 1.21 | 0.166 | 0.439 | |
| Majority classSetting=-2026.06 | 31.42 | 1.58 | 0.224 | — | |
| PERCEPTUI w/o CRSetting=Participant profile2026.06 | 10.83 | 2.86 | 0.494 | 0.235 |