List your company
ResearchFormerly WizWand

Approximating human responses on Pew Research Center ATP Survey Wave 99

0.081WDHuman
0.068440.153220.2380.32278Jul 9, 2024
Updated 5mo ago

Evaluation results

MethodLinks
Human2024.070.0810.3270.83
Anthology (DP)Model=Mixtral-8x22B, Persona Conditioning=Anthology (DP), Persona Matching=n/a2024.070.2151.4220.604
BioModel=Mixtral-8x22B, Persona Conditioning=Bio, Persona Matching=n/a2024.070.2371.0920.687
Anthology (NA)Model=Llama-3-70B, Persona Conditioning=Anthology (NA), Persona Matching=greedy2024.070.2880.7650.744
BioModel=Llama-3-70B, Persona Conditioning=Bio, Persona Matching=n/a2024.070.2960.8090.733
Anthology (DP)Model=Llama-3-70B, Persona Conditioning=Anthology (DP), Persona Matching=n/a2024.070.3021.140.669
Anthology (NA)Model=Mixtral-8x22B, Persona Conditioning=Anthology (NA), Persona Matching=greedy2024.070.320.9510.71
QAModel=Llama-3-70B, Persona Conditioning=QA, Persona Matching=n/a2024.070.3270.7670.74
Anthology (NA)Model=Llama-3-70B, Persona Conditioning=Anthology (NA), Persona Matching=max weight2024.070.3270.6860.756
Anthology (NA)Model=Mixtral-8x22B, Persona Conditioning=Anthology (NA), Persona Matching=max weight2024.070.3530.8430.729
QAModel=Mixtral-8x22B, Persona Conditioning=QA, Persona Matching=n/a2024.070.3951.0860.684