List your company
ResearchFormerly WizWand

Approximating human responses on Pew Research Center ATP Survey Wave 92

0.091WDHuman
0.077480.168740.260.35126Jul 9, 2024
Updated 5mo ago

Evaluation results

MethodLinks
Human2024.070.0910.4110.641
Anthology (NA)Model=Llama-3-70B, Persona Conditioning=Anthology (NA), Persona Matching=greedy2024.070.3130.9730.65
Anthology (NA)Model=Llama-3-70B, Persona Conditioning=Anthology (NA), Persona Matching=max weight2024.070.3371.0450.637
BioModel=Llama-3-70B, Persona Conditioning=Bio, Persona Matching=n/a2024.070.3481.0730.588
BioModel=Mixtral-8x22B, Persona Conditioning=Bio, Persona Matching=n/a2024.070.3590.8510.667
QAModel=Llama-3-70B, Persona Conditioning=QA, Persona Matching=n/a2024.070.3711.0320.664
Anthology (DP)Model=Mixtral-8x22B, Persona Conditioning=Anthology (DP), Persona Matching=n/a2024.070.3780.5310.624
Anthology (NA)Model=Mixtral-8x22B, Persona Conditioning=Anthology (NA), Persona Matching=greedy2024.070.3920.9810.627
Anthology (NA)Model=Mixtral-8x22B, Persona Conditioning=Anthology (NA), Persona Matching=max weight2024.070.4080.8460.61
Anthology (DP)Model=Llama-3-70B, Persona Conditioning=Anthology (DP), Persona Matching=n/a2024.070.4190.9650.636
QAModel=Mixtral-8x22B, Persona Conditioning=QA, Persona Matching=n/a2024.070.4290.9110.599