2-Way Classification on BEA Shared Task 2 Track 4 (Unseen Questions) 2026 (Evaluation)
0.49Quadratic Weighted KappaBaseline prompting Gemini 3 Flash
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Baseline prompting Gemini 3 Flashmodel=Gemini 3 Flash, mode=baseline prompting2026.05 | 0.49 | 78.9 | 12 | |
| Roleplaying Gemini 3 Flashmodel=Gemini 3 Flash, mode=Roleplaying2026.05 | 0.432 | 76.6 | 28 | |
| SVM + TF-IDF (2-10)gramsclassifier=SVM, features=TF-IDF (2-10)grams2026.05 | 0.341 | 73.6 | 38 |