Personality Prediction on PERSONET-en 1.0 (test)
0.6575AccuracyHuman w/ history
Evaluation Results
| Method | Links | |
|---|---|---|
| Human w/ historyLen=480, Evaluation Subset=true2023.05 | 0.6575 | |
| BERT + hist traitsLen=480, Oracle Information=true2023.05 | 0.5002 | |
| LLAMA + LORA-sftLen=1.6K, Evaluation Subset=true2023.05 | 0.4932 | |
| Longformer + hist traitsLen=2K, Oracle Information=true2023.05 | 0.4811 | |
| Char-Hist-Longformer + Task-oriented Unsupervised TrainingLen=1.6K2023.05 | 0.4585 | |
| Char-Hist-LongformerLen=1.6K2023.05 | 0.4533 | |
| BERT (no-hist) + Task-oriented Unsupervised TrainingLen=4802023.05 | 0.4493 | |
| Char-Hist-Longformer w/ extend-hist + Task-oriented Unsupervised TrainingLen=1.6K2023.05 | 0.4454 | |
| Char-Hist-Longformer w/ extend-histLen=1.6K2023.05 | 0.4344 | |
| BERT (no-hist)Len=4802023.05 | 0.4296 | |
| Longformer (no-hist)Len=4802023.05 | 0.4275 | |
| ChatGPT 0-shotLen=480, Evaluation Subset=true2023.05 | 0.4247 | |
| Longformer (no-hist)Len=2K2023.05 | 0.4242 | |
| Human w/o historyLen=480, Evaluation Subset=true2023.05 | 0.4054 | |
| ChatGPT 0-shotLen=1.6K, Evaluation Subset=true2023.05 | 0.3699 | |
| GPT-davinci 5-shotLen=480, Evaluation Subset=true2023.05 | 0.3151 | |
| Random2023.05 | 0.2 | |
| Char-MajorityOracle Information=true2023.05 | 0.1725 | |
| Frequent Traits2023.05 | 0.1275 |