Classification on MTOPIntent (test)
96.46AccuracyCayley-Encoder (GIN)
Evaluation Results
| Method | Links | |
|---|---|---|
| Cayley-Encoder (GIN)Base Model=Llama3-8B2026.03 | 96.46 | |
| Cayley-Encoder (GIN)Base Model=Gemma2-2B2026.03 | 96.43 | |
| FC-Encoder (GCN)Base Model=Llama3-8B2026.03 | 96.19 | |
| Cayley-Encoder (GCN)Base Model=Gemma2-2B2026.03 | 95.97 | |
| Cayley-Encoder (GCN)Base Model=Llama3-8B2026.03 | 95.9 | |
| FC-Encoder (GIN)Base Model=Llama3-8B2026.03 | 95.65 | |
| Set-EncoderBase Model=Llama3-8B2026.03 | 95.43 | |
| FC-Encoder (GCN)Base Model=Gemma2-2B2026.03 | 95.34 | |
| FC-Encoder (GCN)Base Model=Pythia-410m2026.03 | 95.04 | |
| Cayley-Encoder (GIN)Base Model=Pythia-410m2026.03 | 94.72 | |
| FC-Encoder (GIN)Base Model=Gemma2-2B2026.03 | 94.47 | |
| Set-EncoderBase Model=Gemma2-2B2026.03 | 94.37 | |
| FC-Encoder (GIN)Base Model=Pythia-410m2026.03 | 94.32 | |
| Cayley-Encoder (GCN)Base Model=Pythia-410m2026.03 | 94.19 | |
| MLP Last LayerBase Model=Gemma2-2B2026.03 | 92.73 | |
| DWATTBase Model=Llama3-8B2026.03 | 92.41 | |
| Set-EncoderBase Model=Pythia-410m2026.03 | 92.21 | |
| MLP Last LayerBase Model=Llama3-8B2026.03 | 92.09 | |
| DWATTBase Model=Pythia-410m2026.03 | 91.66 | |
| DWATTBase Model=Gemma2-2B2026.03 | 90.93 | |
| MLP Last LayerBase Model=Pythia-410m2026.03 | 83.75 | |
| Best Single LayerBase Model=Llama3-8B2026.03 | 78.17 | |
| Best Single LayerBase Model=Gemma2-2B2026.03 | 75.36 | |
| MLP Best LayerBase Model=Gemma2-2B2026.03 | 73.69 | |
| Last LayerBase Model=Llama3-8B2026.03 | 73.39 | |
| WeightedBase Model=Gemma2-2B2026.03 | 73.2 | |
| WeightedBase Model=Llama3-8B2026.03 | 71.78 | |
| Best Single LayerBase Model=Pythia-410m2026.03 | 71.18 | |
| MLP Best LayerBase Model=Pythia-410m2026.03 | 70.79 | |
| Last LayerBase Model=Gemma2-2B2026.03 | 68.02 | |
| Last LayerBase Model=Pythia-410m2026.03 | 66.97 | |
| WeightedBase Model=Pythia-410m2026.03 | 61.68 | |
| MLP Best LayerBase Model=Llama3-8B2026.03 | 60.04 |