Help-Seeking classification on RelianceScope student logs (chat, code-edit, and copy)
80.7F1 (Passive)gemini-1.5-flash-preview
Evaluation results
| Method | Links | ||
|---|---|---|---|
| gemini-1.5-flash-previewPrompting=9-Shot+CoT2026.02 | 80.7 | 72 | |
| gemini-1.5-pro-previewPrompting=Zero-Shot2026.02 | 76.3 | 70.7 | |
| gemini-1.5-flash-previewPrompting=9-Shot2026.02 | 76.2 | 69.3 | |
| qwen2.5:8bPrompting=Zero-Shot2026.02 | 75.1 | 54 | |
| qwen2.5:8bPrompting=9-Shot2026.02 | 75 | 56 | |
| gemini-1.5-pro-previewPrompting=9-Shot2026.02 | 73.6 | 64 | |
| qwen2.5:8bPrompting=3-Shot2026.02 | 73.3 | 54 | |
| gemini-1.5-pro-previewPrompting=3-Shot2026.02 | 72.3 | 67.3 | |
| gemini-1.5-pro-previewPrompting=9-Shot+CoT2026.02 | 70.2 | 62.7 | |
| gemini-1.5-flash-previewPrompting=3-Shot2026.02 | 70 | 66.7 | |
| gemini-1.5-flash-previewPrompting=Zero-Shot2026.02 | 66.7 | 60.7 | |
| qwen2.5:8bPrompting=9-Shot+CoT2026.02 | 53.3 | 46 |