Approximating Human Responses on Pew Research Center ATP Survey Wave 34
0.057WDHuman
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Human2024.07 | 0.057 | 0.418 | 78.4 | |
| Anthology (NA)Model=Llama-3-70B, Persona Conditioning=Anthology (NA), Persona Matching=greedy2024.07 | 0.227 | 1.07 | 70.8 | |
| Anthology (NA)Model=Llama-3-70B, Persona Conditioning=Anthology (NA), Persona Matching=max weight2024.07 | 0.229 | 1.287 | 69.3 | |
| Anthology (DP)Model=Mixtral-8x22B, Persona Conditioning=Anthology (DP), Persona Matching=n/a2024.07 | 0.236 | 1.095 | 68.4 | |
| QAModel=Llama-3-70B, Persona Conditioning=QA, Persona Matching=n/a2024.07 | 0.238 | 1.183 | 68.1 | |
| Anthology (DP)Model=Llama-3-70B, Persona Conditioning=Anthology (DP), Persona Matching=n/a2024.07 | 0.244 | 1.497 | 65.2 | |
| Anthology (NA)Model=Mixtral-8x22B, Persona Conditioning=Anthology (NA), Persona Matching=greedy2024.07 | 0.247 | 0.851 | 71.5 | |
| BioModel=Llama-3-70B, Persona Conditioning=Bio, Persona Matching=n/a2024.07 | 0.254 | 1.107 | 67.3 | |
| Anthology (NA)Model=Mixtral-8x22B, Persona Conditioning=Anthology (NA), Persona Matching=max weight2024.07 | 0.257 | 0.869 | 72.6 | |
| BioModel=Mixtral-8x22B, Persona Conditioning=Bio, Persona Matching=n/a2024.07 | 0.26 | 1.075 | 69.8 | |
| QAModel=Mixtral-8x22B, Persona Conditioning=QA, Persona Matching=n/a2024.07 | 0.347 | 1.008 | 68.7 |