Syntax on CoLA
59.71MCCBackbone
Evaluation results
| Method | Links | |
|---|---|---|
| BackboneBackbone Model=Qwen-2.5-7B, Evaluation Protocol=0-shot2026.01 | 59.71 | |
| GTCABackbone Model=Llama-3-8B, Evaluation Protocol=0-shot2026.01 | 56.69 | |
| GTCABackbone Model=Qwen-2.5-7B, Evaluation Protocol=0-shot2026.01 | 56.59 | |
| LoRA-onlyBackbone Model=Llama-3-8B, Evaluation Protocol=0-shot2026.01 | 53.68 | |
| BackboneBackbone Model=Llama-3-8B, Evaluation Protocol=0-shot2026.01 | 53.57 | |
| LoRA-onlyBackbone Model=Qwen-2.5-7B, Evaluation Protocol=0-shot2026.01 | 53.31 | |
| Direct-JointBackbone Model=Qwen-2.5-7B, Evaluation Protocol=0-shot2026.01 | 52.75 | |
| Direct-JointBackbone Model=Llama-3-8B, Evaluation Protocol=0-shot2026.01 | 52.46 |