List your company
ResearchFormerly WizWand

Classification on MTOP Domain (test)

99.16AccuracyCayley-Encoder (GCN)
45.579259.489673.487.3104Mar 24, 2026
Updated 7mo ago

Evaluation results

MethodLinks
Cayley-Encoder (GCN)Base Model=Gemma2-2B2026.0399.16
FC-Encoder (GIN)Base Model=Gemma2-2B2026.0399.07
Cayley-Encoder (GCN)Base Model=Llama3-8B2026.0399.03
FC-Encoder (GCN)Base Model=Llama3-8B2026.0398.99
Cayley-Encoder (GIN)Base Model=Llama3-8B2026.0398.98
Set-EncoderBase Model=Gemma2-2B2026.0398.92
Cayley-Encoder (GIN)Base Model=Gemma2-2B2026.0398.88
FC-Encoder (GCN)Base Model=Gemma2-2B2026.0398.87
Cayley-Encoder (GIN)Base Model=Pythia-410m2026.0398.77
Set-EncoderBase Model=Llama3-8B2026.0398.77
FC-Encoder (GIN)Base Model=Llama3-8B2026.0398.77
FC-Encoder (GIN)Base Model=Pythia-410m2026.0398.68
Cayley-Encoder (GCN)Base Model=Pythia-410m2026.0398.67
FC-Encoder (GCN)Base Model=Pythia-410m2026.0398.65
MLP Last LayerBase Model=Llama3-8B2026.0398.58
DWATTBase Model=Gemma2-2B2026.0398.39
MLP Last LayerBase Model=Gemma2-2B2026.0398.37
DWATTBase Model=Pythia-410m2026.0398.03
DWATTBase Model=Llama3-8B2026.0397.97
Set-EncoderBase Model=Pythia-410m2026.0397.59
MLP Last LayerBase Model=Pythia-410m2026.0396.97
Best Single LayerBase Model=Llama3-8B2026.0389.01
MLP Best LayerBase Model=Pythia-410m2026.0387.25
Best Single LayerBase Model=Gemma2-2B2026.0387.09
WeightedBase Model=Gemma2-2B2026.0385.17
Last LayerBase Model=Llama3-8B2026.0384.42
MLP Best LayerBase Model=Gemma2-2B2026.0384.24
WeightedBase Model=Llama3-8B2026.0383.85
Best Single LayerBase Model=Pythia-410m2026.0383.78
Last LayerBase Model=Pythia-410m2026.0380.88
Last LayerBase Model=Gemma2-2B2026.0380.79
WeightedBase Model=Pythia-410m2026.0379.79
MLP Best LayerBase Model=Llama3-8B2026.0347.64