Reasoning on Security Domain 20 tasks (test)
0.04Total Cost (USD)Force Weak
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Force Weak2026.01 | 0.04 | 0.002 | 69.2 | |
| CASTER2026.01 | 0.1 | 0.005 | 23.1 | |
| Force Strong2026.01 | 0.13 | 0.006 | — |
Loading the SOTA2 catalog…
| Method | Links | |||
|---|---|---|---|---|
| Force Weak2026.01 | 0.04 | 0.002 | 69.2 | |
| CASTER2026.01 | 0.1 | 0.005 | 23.1 | |
| Force Strong2026.01 | 0.13 | 0.006 | — |