Reasoning length evaluation on 20 attack prompts
7,745Avg LengthRECUR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RECURModel=QWQ-32B2026.02 | 7,745 | 15,537 | |
| RECURModel=O1-HIGH2026.02 | 6,552 | 21,549 | |
| RECURModel=DS-QWEN-14B2026.02 | 6,089 | 14,834 | |
| RECURModel=DS-LLAMA-8B2026.02 | 5,884 | 15,674 | |
| RECURModel=DS-V3.22026.02 | 5,306 | 10,999 | |
| AUTODOSModel=QWQ-32B2026.02 | 4,833 | 11,329 | |
| RECURModel=GEMINI-2.52026.02 | 4,461 | 64,440 | |
| OVERTHINKModel=O1-HIGH2026.02 | 3,942 | 13,824 | |
| GCGModel=DS-V3.22026.02 | 3,771 | 10,933 | |
| OVERTHINKModel=GEMINI-2.52026.02 | 3,735 | 19,735 | |
| GCGModel=QWQ-32B2026.02 | 3,445 | 16,301 | |
| RECURModel=O1-MEDIUM2026.02 | 3,434 | 9,565 | |
| RECURModel=GROK-4-FAST2026.02 | 3,226 | 8,639 | |
| GCGModel=DS-QWEN-14B2026.02 | 3,146 | 16,305 | |
| LOOPLLMModel=QWQ-32B2026.02 | 2,640 | 16,334 | |
| OVERTHINKModel=GROK-4-FAST2026.02 | 2,271 | 5,186 | |
| AUTODOSModel=DS-LLAMA-8B2026.02 | 2,048 | 4,470 | |
| LOOPLLMModel=DS-LLAMA-8B2026.02 | 1,944 | 16,326 | |
| AUTODOSModel=DS-QWEN-14B2026.02 | 1,885 | 5,366 | |
| GCGModel=O1-HIGH2026.02 | 1,801 | 2,688 | |
| BASELINEModel=QWQ-32B2026.02 | 1,796 | 4,459 | |
| AUTODOSModel=GEMINI-2.52026.02 | 1,320 | 2,493 | |
| OVERTHINKModel=QWQ-32B2026.02 | 1,277 | 1,688 | |
| OVERTHINKModel=O1-MEDIUM2026.02 | 1,256 | 1,984 | |
| GCGModel=DS-LLAMA-8B2026.02 | 1,211 | 3,407 | |
| AUTODOSModel=O1-HIGH2026.02 | 1,108 | 1,597 | |
| GCGModel=O1-MEDIUM2026.02 | 960 | 1,984 | |
| LOOPLLMModel=GEMINI-2.52026.02 | 867 | 1,296 | |
| LOOPLLMModel=O1-HIGH2026.02 | 838 | 2,944 | |
| BASELINEModel=GEMINI-2.52026.02 | 752 | 2,264 | |
| LOOPLLMModel=O1-MEDIUM2026.02 | 704 | 1,408 | |
| LOOPLLMModel=DS-QWEN-14B2026.02 | 698 | 1,981 | |
| LOOPLLMModel=DS-V3.22026.02 | 689 | 2,833 | |
| BASELINEModel=O1-HIGH2026.02 | 649 | 3,089 | |
| OVERTHINKModel=DS-LLAMA-8B2026.02 | 629 | 1,003 | |
| BASELINEModel=DS-LLAMA-8B2026.02 | 616 | 2,298 | |
| OVERTHINKModel=DS-V3.22026.02 | 594 | 939 | |
| AUTODOSModel=O1-MEDIUM2026.02 | 582 | 1,337 | |
| OVERTHINKModel=DS-QWEN-14B2026.02 | 580 | 840 | |
| AUTODOSModel=DS-V3.22026.02 | 558 | 1,554 | |
| BASELINEModel=DS-V3.22026.02 | 553 | 1,923 | |
| LOOPLLMModel=GROK-4-FAST2026.02 | 530 | 1,640 | |
| BASELINEModel=DS-QWEN-14B2026.02 | 521 | 1,012 | |
| BASELINEModel=O1-MEDIUM2026.02 | 425 | 970 | |
| BASELINEModel=GROK-4-FAST2026.02 | 417 | 2,136 | |
| GCGModel=GROK-4-FAST2026.02 | 371 | 481 | |
| AUTODOSModel=GROK-4-FAST2026.02 | 332 | 555 | |
| GCGModel=GEMINI-2.52026.02 | 222 | 861 |