Scam Detection on CSID (test)
98AccuracySCRIPTMIND-FT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SCRIPTMIND-FTbackbone=EEVE-Korean-Instruct-10.8B, fine-tuned=true2026.01 | 98 | 98 | 1 | 1 | |
| SCRIPTMIND-FTbackbone=EXAONE-3.5-2.4B-Instruct, fine-tuned=true2026.01 | 94 | 94 | 6 | 1 | |
| SCRIPTMIND-FTbackbone=Llama-3.2-1B-Instruct, fine-tuned=true2026.01 | 91 | 92 | 6 | 2 | |
| chatgpt-4o-latestzero-shot=true2026.01 | 90 | 91 | 10 | 0 | |
| SCRIPTMIND-FTbackbone=SOLAR-10.7B-Instruct, fine-tuned=true2026.01 | 85 | 82 | 0 | 15 | |
| SCRIPTMIND-FTbackbone=Llama-3.1-8B-Instruct, fine-tuned=true2026.01 | 80 | 76 | 1 | 19 | |
| SCRIPTMIND-FTbackbone=Midm-2.0-Mini-Instruct, fine-tuned=true2026.01 | 74 | 67 | 3 | 23 | |
| SCRIPTMIND-FTbackbone=Midm-2.0-Base-Instruct, fine-tuned=true2026.01 | 73 | 64 | 0 | 26 | |
| EEVE-Korean-Instruct-10.8Bzero-shot=true2026.01 | 71 | 74 | 21 | 9 | |
| gemini-2.0-flashzero-shot=true2026.01 | 70 | 77 | 29 | 0 | |
| claude-3-5-haikuzero-shot=true2026.01 | 67 | 75 | 33 | 0 | |
| SOLAR-10.7B-Instructzero-shot=true2026.01 | 64 | 72 | 33 | 3 | |
| EXAONE-3.0-7.8B-Instructzero-shot=true2026.01 | 64 | 72 | 32 | 4 | |
| EXAONE-3.5-2.4B-Instructzero-shot=true2026.01 | 58 | 65 | 31 | 11 | |
| Llama-3.2-1B-Instructzero-shot=true2026.01 | 55 | 56 | 24 | 21 | |
| Midm-2.0-Base-Instructzero-shot=true2026.01 | 55 | 60 | 28 | 17 | |
| Llama-3.1-8B-Instructzero-shot=true2026.01 | 50 | 67 | 50 | 0 | |
| Midm-2.0-Mini-Instructzero-shot=true2026.01 | 48 | 44 | 23 | 29 |