Individualistic Value Reasoning on Individualistic Value Reasoning Refined
60.6AccuracyINDIEVALUEREASONER
Evaluation results
| Method | Links | |
|---|---|---|
| INDIEVALUEREASONERProbe setup=p+r, Demonstration setup=mixed+200, Training/Sample size (N)=16002024.10 | 60.6 | |
| INDIEVALUEREASONERProbe setup=p+r, Demonstration setup=mixed+200, Training/Sample size (N)=8002024.10 | 60.23 | |
| INDIEVALUEREASONERProbe setup=r, Demonstration setup=mixed, Training/Sample size (N)=8002024.10 | 59.94 | |
| ResembleTraining/Sample size (N)=all, Selection strategy=top cluster2024.10 | 59.47 | |
| INDIEVALUEREASONERProbe setup=p+r, Demonstration setup=200, Training/Sample size (N)=8002024.10 | 58.84 | |
| INDIEVALUEREASONERProbe setup=p+r, Demonstration setup=mixed, Training/Sample size (N)=8002024.10 | 58.27 | |
| ResembleTraining/Sample size (N)=1600, Selection strategy=top cluster2024.10 | 54.36 | |
| ResembleTraining/Sample size (N)=all, Selection strategy=top 12024.10 | 53.51 | |
| GlobalSelection Strategy=majority vote2024.10 | 48.7 | |
| ResembleTraining/Sample size (N)=1600, Selection strategy=top 12024.10 | 47.55 | |
| INDIEVALUEREASONERProbe setup=p, Demonstration setup=mixed, Training/Sample size (N)=8002024.10 | 44.08 | |
| GPT-4osetup=only demographics2024.10 | 40.69 | |
| Llama-3.1-8Bsetup=200 demo2024.10 | 37.97 | |
| GPT-4osetup=200 demo2024.10 | 35.59 | |
| GPT-4osetup=no demo2024.10 | 33.06 | |
| Random2024.10 | 27.87 |