List your company
ResearchFormerly WizWand

Personality Prediction on PERSONET-en 1.0 (test)

0.6575AccuracyHuman w/ history
0.10630.24940.39250.5356May 17, 2023
Updated 8mo ago

Evaluation results

MethodLinks
Human w/ historyLen=480, Evaluation Subset=true2023.050.6575
BERT + hist traitsLen=480, Oracle Information=true2023.050.5002
LLAMA + LORA-sftLen=1.6K, Evaluation Subset=true2023.050.4932
Longformer + hist traitsLen=2K, Oracle Information=true2023.050.4811
Char-Hist-Longformer + Task-oriented Unsupervised TrainingLen=1.6K2023.050.4585
Char-Hist-LongformerLen=1.6K2023.050.4533
BERT (no-hist) + Task-oriented Unsupervised TrainingLen=4802023.050.4493
Char-Hist-Longformer w/ extend-hist + Task-oriented Unsupervised TrainingLen=1.6K2023.050.4454
Char-Hist-Longformer w/ extend-histLen=1.6K2023.050.4344
BERT (no-hist)Len=4802023.050.4296
Longformer (no-hist)Len=4802023.050.4275
ChatGPT 0-shotLen=480, Evaluation Subset=true2023.050.4247
Longformer (no-hist)Len=2K2023.050.4242
Human w/o historyLen=480, Evaluation Subset=true2023.050.4054
ChatGPT 0-shotLen=1.6K, Evaluation Subset=true2023.050.3699
GPT-davinci 5-shotLen=480, Evaluation Subset=true2023.050.3151
Random2023.050.2
Char-MajorityOracle Information=true2023.050.1725
Frequent Traits2023.050.1275