List your company
ResearchFormerly WizWand

Semantic Textual Similarity on STS12 (test)

65.31Similarity ScoreCayley-Encoder
25.84236.088546.33556.5815Mar 24, 2026
Updated 7mo ago

Evaluation results

MethodLinks
Cayley-EncoderBase Model=Llama3-8B, GNN Variant=GIN2026.0365.31
Cayley-EncoderBase Model=Gemma2-2B, GNN Variant=GCN2026.0364.36
FC-EncoderBase Model=Gemma2-2B, GNN Variant=GCN2026.0361.83
Cayley-EncoderBase Model=Gemma2-2B, GNN Variant=GIN2026.0360.38
Cayley-EncoderBase Model=Pythia-410m, GNN Variant=GCN2026.0357.9
Cayley-EncoderBase Model=Pythia-410m, GNN Variant=GIN2026.0355.97
FC-EncoderBase Model=Llama3-8B, GNN Variant=GCN2026.0355.19
DWAttBase Model=Pythia-410m2026.0352.51
Set-EncoderBase Model=Pythia-410m2026.0352.11
DWAttBase Model=Gemma2-2B2026.0351.86
DWAttBase Model=Llama3-8B2026.0351.47
Best-LayerBase Model=Pythia-410m2026.0350.62
FC-EncoderBase Model=Pythia-410m, GNN Variant=GCN2026.0350.13
Best-LayerBase Model=Llama3-8B2026.0347.21
WeightedBase Model=Pythia-410m2026.0347.12
Cayley-EncoderBase Model=Llama3-8B, GNN Variant=GCN2026.0347.11
Last-LayerBase Model=Pythia-410m2026.0346.96
FC-EncoderBase Model=Gemma2-2B, GNN Variant=GIN2026.0346.48
FC-EncoderBase Model=Pythia-410m, GNN Variant=GIN2026.0344.69
Set-EncoderBase Model=Gemma2-2B2026.0343.97
Best-LayerBase Model=Gemma2-2B2026.0343.02
MLP Last-LayerBase Model=Pythia-410m2026.0342.14
FC-EncoderBase Model=Llama3-8B, GNN Variant=GIN2026.0341.39
Set-EncoderBase Model=Llama3-8B2026.0339.94
WeightedBase Model=Gemma2-2B2026.0335.66
MLP Last-LayerBase Model=Llama3-8B2026.0334.88
Last-LayerBase Model=Gemma2-2B2026.0333.7
WeightedBase Model=Llama3-8B2026.0332.86
Last-LayerBase Model=Llama3-8B2026.0332.65
MLP Last-LayerBase Model=Gemma2-2B2026.0327.36