List your company
ResearchFormerly WizWand

PMI ranking estimation on Words (500 held-out pairs)

0.89Spearman RhoDecomposed PMI (emp.)
0.30760.45880.610.7612May 20, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Decomposed PMI (emp.)Model=Claude Sonnet 4, Evaluation Type=Empirical marginal (oracle upper bound)2026.050.89
InfoNCE (emp.)Model=Claude Sonnet 4, Evaluation Type=Empirical marginal (oracle upper bound)2026.050.89
InfoNCE (emp.)Model=GPT-5.2, Evaluation Type=Empirical marginal (oracle upper bound)2026.050.87
PromptNCE (emp.)Model=GPT-5.2, Evaluation Type=Empirical marginal (oracle upper bound)2026.050.85
PromptNCE (emp.)Model=Claude Sonnet 4, Evaluation Type=Empirical marginal (oracle upper bound)2026.050.85
Decomposed PMI (emp.)Model=GPT-5.2, Evaluation Type=Empirical marginal (oracle upper bound)2026.050.82
PromptNCEModel=GPT-5.2, Evaluation Type=Zero-shot2026.050.74
PromptNCEModel=Claude Sonnet 4, Evaluation Type=Zero-shot2026.050.69
MarginalNCEModel=GPT-5.2, Evaluation Type=Zero-shot2026.050.64
MarginalNCEModel=Claude Sonnet 4, Evaluation Type=Zero-shot2026.050.64
Decomposed PMIModel=Claude Sonnet 4, Evaluation Type=Zero-shot2026.050.63
Decomposed PMIModel=GPT-5.2, Evaluation Type=Zero-shot2026.050.57
Direct PMIModel=Claude Sonnet 4, Evaluation Type=Zero-shot2026.050.48
Direct PMIModel=GPT-5.2, Evaluation Type=Zero-shot2026.050.36
InfoNCEModel=GPT-5.2, Evaluation Type=Zero-shot2026.050.35
InfoNCEModel=Claude Sonnet 4, Evaluation Type=Zero-shot2026.050.33