Active Alignment on Security Lens (test)
1.55MAE (X)On-device (3)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| On-device (3)Oracle lenses=3, Sampling=dense2026.01 | 1.55 | 1.3 | 2.15 | 1.76 | 1.85 | 1.58 | |
| DA3Simulated tolerance perturbations=true2026.01 | 2.03 | 2.02 | 2.03 | 1.8 | 2.03 | 1.92 | |
| DA3Simulated tolerance perturbations=false2026.01 | 2.37 | 2.03 | 2.82 | 2.21 | 2.6 | 2.13 | |
| On-device (1)Oracle lenses=1, Sampling=dense2026.01 | 2.4 | 1.99 | 2.24 | 1.73 | 2.32 | 1.87 | |
| On-device (2)Oracle lenses=2, Sampling=dense2026.01 | 2.52 | 2.01 | 1.86 | 1.45 | 2.19 | 1.79 | |
| SimulationSimulated tolerance perturbations=false2026.01 | 3.04 | 2.63 | 6.07 | 4.75 | 4.55 | 4.13 | |
| SimulationSimulated tolerance perturbations=true2026.01 | 3.36 | 4.31 | 4.8 | 4.87 | 4.08 | 4.65 | |
| On-device* (1)Oracle lenses=1, Sampling=large steps (sparse)2026.01 | 17.01 | 10.63 | 24.04 | 14.36 | 20.52 | 13.11 |