Smartphone Tasks
Benchmarks
TaskDatasetSOTA resultTrendResults
40 diverse smartphone tasks Total
95.8Target Attack Success Rate (Tasr)
16
40 diverse smartphone tasks Persuade subcategory
100Target ASR
16
40 diverse smartphone tasks Generate subcategory
75Target ASR
16
40 diverse smartphone tasks Execute
100TASR
16