List your company
ResearchFormerly WizWand

Coreference Resolution on WSC (Acc@1 & Avg. Perf.)

85.2Accuracy@1DisambiguSLM
67.72872.26476.881.336Apr 25, 2026
Updated 6mo ago

Evaluation results

MethodLinks
DisambiguSLMLLM=GPT, Avg. Cost ($)=0.022026.0485.268.6
DisambiguSLMLLM=LLaMA, Avg. Cost ($)=0.022026.0483.866
DisambiguSLMLLM=DeepSeek, Avg. Cost ($)=0.022026.048366.3
Prompt AgentLLM=GPT, Avg. Cost ($)=2.712026.0482.765
SPOLLM=GPT, Avg. Cost ($)=0.152026.048266.9
Prompt AgentLLM=DeepSeek, Avg. Cost ($)=2.712026.0480.362.7
APELLM=GPT, Avg. Cost ($)=9.072026.0480.264.8
OPROLLM=GPT, Avg. Cost ($)=4.512026.0480.266.6
SPOLLM=DeepSeek, Avg. Cost ($)=0.152026.0480.164.8
SPOLLM=LLaMA, Avg. Cost ($)=0.152026.0479.664
Prompt AgentLLM=LLaMA, Avg. Cost ($)=2.712026.0479.462
RephraseLLM=GPT, Avg. Cost ($)=-2026.0479.161.1
Step-backLLM=GPT, Avg. Cost ($)=-2026.0478.765
TextGradLLM=GPT, Avg. Cost ($)=13.142026.047863.9
OPROLLM=DeepSeek, Avg. Cost ($)=4.512026.0477.963.9
CoTLLM=GPT, Avg. Cost ($)=-2026.0477.863.8
APELLM=DeepSeek, Avg. Cost ($)=9.072026.0477.362.4
OPROLLM=LLaMA, Avg. Cost ($)=4.512026.0476.863.1
Prompt BreederLLM=GPT, Avg. Cost ($)=4.822026.0476.764.5
APELLM=LLaMA, Avg. Cost ($)=9.072026.0476.161.7
TextGradLLM=DeepSeek, Avg. Cost ($)=13.142026.0475.961.6
RephraseLLM=DeepSeek, Avg. Cost ($)=-2026.0475.658.8
Step-backLLM=DeepSeek, Avg. Cost ($)=-2026.0475.162.3
TextGradLLM=LLaMA, Avg. Cost ($)=13.142026.047560.9
CoTLLM=DeepSeek, Avg. Cost ($)=-2026.0474.961.2
Prompt BreederLLM=DeepSeek, Avg. Cost ($)=4.822026.0474.862.2
RephraseLLM=LLaMA, Avg. Cost ($)=-2026.0474.257.93
Prompt BreederLLM=LLaMA, Avg. Cost ($)=4.822026.0474.161.4
Step-backLLM=LLaMA, Avg. Cost ($)=-2026.047461.4
CoTLLM=LLaMA, Avg. Cost ($)=-2026.0473.960.4
Naïve promptingLLM=GPT, Avg. Cost ($)=-2026.0472.461.6
Naïve promptingLLM=DeepSeek, Avg. Cost ($)=-2026.0469.759.2
Naïve promptingLLM=LLaMA, Avg. Cost ($)=-2026.0468.458.2