List your company
ResearchFormerly WizWand

PMI ranking estimation on GoEmotions (500 held-out pairs)

0.66Spearman RhoDecomposed PMI (emp.)
0.10880.25190.3950.5381May 20, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Decomposed PMI (emp.)Model=Claude Sonnet 4, Evaluation Type=Empirical marginal (oracle upper bound)2026.050.66
InfoNCE (emp.)Model=Claude Sonnet 4, Evaluation Type=Empirical marginal (oracle upper bound)2026.050.61
Decomposed PMI (emp.)Model=GPT-5.2, Evaluation Type=Empirical marginal (oracle upper bound)2026.050.56
PromptNCE (emp.)Model=Claude Sonnet 4, Evaluation Type=Empirical marginal (oracle upper bound)2026.050.55
InfoNCE (emp.)Model=GPT-5.2, Evaluation Type=Empirical marginal (oracle upper bound)2026.050.53
PromptNCE (emp.)Model=GPT-5.2, Evaluation Type=Empirical marginal (oracle upper bound)2026.050.49
PromptNCEModel=Claude Sonnet 4, Evaluation Type=Zero-shot2026.050.47
MarginalNCEModel=Claude Sonnet 4, Evaluation Type=Zero-shot2026.050.45
Decomposed PMIModel=GPT-5.2, Evaluation Type=Zero-shot2026.050.44
PromptNCEModel=GPT-5.2, Evaluation Type=Zero-shot2026.050.43
MarginalNCEModel=GPT-5.2, Evaluation Type=Zero-shot2026.050.41
Decomposed PMIModel=Claude Sonnet 4, Evaluation Type=Zero-shot2026.050.4
Direct PMIModel=GPT-5.2, Evaluation Type=Zero-shot2026.050.35
Direct PMIModel=Claude Sonnet 4, Evaluation Type=Zero-shot2026.050.34
InfoNCEModel=Claude Sonnet 4, Evaluation Type=Zero-shot2026.050.18
InfoNCEModel=GPT-5.2, Evaluation Type=Zero-shot2026.050.13