List your company
ResearchFormerly WizWand

Approximating Human Responses on Pew Research Center ATP Survey Wave 34

0.057WDHuman
0.04540.12370.2020.2803Jul 9, 2024
Updated 5mo ago

Evaluation results

MethodLinks
Human2024.070.0570.41878.4
Anthology (NA)Model=Llama-3-70B, Persona Conditioning=Anthology (NA), Persona Matching=greedy2024.070.2271.0770.8
Anthology (NA)Model=Llama-3-70B, Persona Conditioning=Anthology (NA), Persona Matching=max weight2024.070.2291.28769.3
Anthology (DP)Model=Mixtral-8x22B, Persona Conditioning=Anthology (DP), Persona Matching=n/a2024.070.2361.09568.4
QAModel=Llama-3-70B, Persona Conditioning=QA, Persona Matching=n/a2024.070.2381.18368.1
Anthology (DP)Model=Llama-3-70B, Persona Conditioning=Anthology (DP), Persona Matching=n/a2024.070.2441.49765.2
Anthology (NA)Model=Mixtral-8x22B, Persona Conditioning=Anthology (NA), Persona Matching=greedy2024.070.2470.85171.5
BioModel=Llama-3-70B, Persona Conditioning=Bio, Persona Matching=n/a2024.070.2541.10767.3
Anthology (NA)Model=Mixtral-8x22B, Persona Conditioning=Anthology (NA), Persona Matching=max weight2024.070.2570.86972.6
BioModel=Mixtral-8x22B, Persona Conditioning=Bio, Persona Matching=n/a2024.070.261.07569.8
QAModel=Mixtral-8x22B, Persona Conditioning=QA, Persona Matching=n/a2024.070.3471.00868.7