Personality Prediction on PERSONET-en 1.0 (dev)
69.77AccuracyHuman w/ history
Evaluation results
| Method | Links | |
|---|---|---|
| Human w/ historyLen=480, Evaluation Subset=true2023.05 | 69.77 | |
| BERT + hist traitsLen=480, Oracle Information=true2023.05 | 50.15 | |
| Longformer + hist traitsLen=2K, Oracle Information=true2023.05 | 48.66 | |
| LLAMA + LORA-sftLen=1.6K, Evaluation Subset=true2023.05 | 47.67 | |
| Char-Hist-Longformer + Task-oriented Unsupervised TrainingLen=1.6K2023.05 | 46.39 | |
| BERT (no-hist) + Task-oriented Unsupervised TrainingLen=4802023.05 | 46.18 | |
| Char-Hist-Longformer w/ extend-hist + Task-oriented Unsupervised TrainingLen=1.6K2023.05 | 45.93 | |
| Char-Hist-LongformerLen=1.6K2023.05 | 45.5 | |
| Char-Hist-Longformer w/ extend-histLen=1.6K2023.05 | 45.46 | |
| Longformer (no-hist)Len=4802023.05 | 45.02 | |
| BERT (no-hist)Len=4802023.05 | 45.01 | |
| Longformer (no-hist)Len=2K2023.05 | 45 | |
| Human w/o historyLen=480, Evaluation Subset=true2023.05 | 44.19 | |
| ChatGPT 0-shotLen=1.6K, Evaluation Subset=true2023.05 | 36.05 | |
| GPT-davinci 5-shotLen=480, Evaluation Subset=true2023.05 | 34.88 | |
| ChatGPT 0-shotLen=480, Evaluation Subset=true2023.05 | 33.72 | |
| Random2023.05 | 20 | |
| Char-MajorityOracle Information=true2023.05 | 16.1 | |
| Frequent Traits2023.05 | 14.1 |