Sarcasm detection on CSC (test)
85.57AccuracyDPUA
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| DPUABackbone=Qwen-3-Instruct (8B)2026.05 | 85.57 | 82.18 | 0.1461 | 0.7047 | |
| DPUABackbone=LLaMa-3.1-Instruct (8B)2026.05 | 85.57 | 80.48 | 0.1259 | 0.761 | |
| w/ SFTBackbone=LLaMa-3.1-Instruct (8B)2026.05 | 85.12 | 79.92 | 0.3134 | 0.472 | |
| w/ GRPOBackbone=LLaMa-3.1-Instruct (8B)2026.05 | 85.12 | 80.27 | 0.2988 | 0.446 | |
| w/ GRPO*Backbone=LLaMa-3.1-Instruct (8B)2026.05 | 84.97 | 79.68 | 0.1371 | 0.7212 | |
| w/ GRPOBackbone=Qwen-3-Instruct (8B)2026.05 | 84.59 | 81.79 | 0.218 | 0.6285 | |
| w/ SFTBackbone=Qwen-3-Instruct (8B)2026.05 | 84.38 | 81.6 | 0.2164 | 0.6113 | |
| w/ GRPO*Backbone=Qwen-3-Instruct (8B)2026.05 | 84.08 | 81.45 | 0.1508 | 0.6704 | |
| w/ SFT*Backbone=Qwen-3-Instruct (8B)2026.05 | 84.04 | 80.31 | 0.1575 | 0.6625 | |
| w/ SFT*Backbone=LLaMa-3.1-Instruct (8B)2026.05 | 83.33 | 76.41 | 0.1339 | 0.7258 | |
| few-shotBackbone=Qwen-3-Instruct (8B)2026.05 | 55.84 | 54.66 | 0.4523 | 0.3731 | |
| few-shotBackbone=LLaMa-3.1-Instruct (8B)2026.05 | 55.61 | 56.08 | 0.4458 | 0.2514 | |
| zero-shotBackbone=LLaMa-3.1-Instruct (8B)2026.05 | 52.83 | 52.23 | 0.3936 | 0.1985 | |
| zero-shotBackbone=Qwen-3-Instruct (8B)2026.05 | 48.51 | 48.5 | 0.4231 | 0.3439 |