Individualistic Value Reasoning on Individualistic Value Reasoning All
67.67AccuracyINDIEVALUEREASONER
Evaluation results
| Method | Links | |
|---|---|---|
| INDIEVALUEREASONERProbe setup=p+r, Demonstration setup=mixed+200, Training/Sample size (N)=16002024.10 | 67.67 | |
| INDIEVALUEREASONERProbe setup=p+r, Demonstration setup=mixed+200, Training/Sample size (N)=8002024.10 | 67.26 | |
| ResembleTraining/Sample size (N)=all, Selection strategy=top cluster2024.10 | 66.6 | |
| INDIEVALUEREASONERProbe setup=r, Demonstration setup=mixed, Training/Sample size (N)=8002024.10 | 66.59 | |
| INDIEVALUEREASONERProbe setup=p+r, Demonstration setup=mixed, Training/Sample size (N)=8002024.10 | 66.49 | |
| INDIEVALUEREASONERProbe setup=p+r, Demonstration setup=200, Training/Sample size (N)=8002024.10 | 66.14 | |
| ResembleTraining/Sample size (N)=1600, Selection strategy=top cluster2024.10 | 62.38 | |
| ResembleTraining/Sample size (N)=all, Selection strategy=top 12024.10 | 61.67 | |
| INDIEVALUEREASONERProbe setup=p, Demonstration setup=mixed, Training/Sample size (N)=8002024.10 | 58.84 | |
| GlobalSelection Strategy=majority vote2024.10 | 56.83 | |
| ResembleTraining/Sample size (N)=1600, Selection strategy=top 12024.10 | 56.6 | |
| GPT-4osetup=only demographics2024.10 | 50.5 | |
| GPT-4osetup=200 demo2024.10 | 49.52 | |
| Llama-3.1-8Bsetup=200 demo2024.10 | 46.16 | |
| GPT-4osetup=no demo2024.10 | 43.93 | |
| Random2024.10 | 36.62 |