Linux Privilege Escalation Benchmark 1.0 (test)
91Overall Success RateHuman
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| HumanCategory=Baseline with Guidance, Guidance=true, Treatments=false2026.04 | 91 | — | — | — | — | 1 | 2 | — | — | — | — | — | — | |
| Llama3.1 70BCategory=Including our Treatments and using Guidance, Guidance=true, Treatments=true2026.04 | 83 | 14 | 4 | 3 | 2 | 2 | 17 | 5 | 4 | — | 7 | 19 | — | |
| HumanCategory=Baseline, Guidance=false, Treatments=false2026.04 | 75 | 16 | 2 | 3 | 4 | — | — | 5 | 4 | 5 | 5 | 14 | — | |
| GPT-4o miniCategory=Including our Treatments and using Guidance, Guidance=true, Treatments=true2026.04 | 75 | 15 | 2 | 6 | 3 | 3 | 15 | 5 | 3 | — | 18 | — | — | |
| GPT-4-turboCategory=Baseline with Guidance, Guidance=true, Treatments=false2026.04 | 67 | 2 | 2 | 18 | 36 | 2 | 5 | 3 | 5 | — | — | — | — | |
| GPT-4oCategory=Secondary Baseline with Guidance, Guidance=true, Treatments=false2026.04 | 67 | 3 | 2 | 2 | 4 | 4 | 5 | 7 | — | — | 15 | — | — | |
| Qwen2.5 7BCategory=Including our Treatments and using Guidance, Guidance=true, Treatments=true2026.04 | 67 | 23 | 6 | 14 | 6 | 4 | — | 17 | 13 | — | — | 24 | — | |
| Llama3.1 8BCategory=Including our Treatments and using Guidance, Guidance=true, Treatments=true2026.04 | 67 | 14 | 6 | 18 | 7 | 11 | — | 23 | 21 | — | 14 | — | — | |
| GPT-4oCategory=Secondary Baseline, Guidance=false, Treatments=false2026.04 | 42 | 12 | 4 | 10 | 11 | — | — | 9 | — | — | — | — | — | |
| GPT-4o miniCategory=Including our Treatments, Guidance=false, Treatments=true2026.04 | 42 | — | 9 | 8 | 17 | 22 | 16 | — | — | — | — | — | — | |
| WhiteRabbitNeoCategory=Including our Treatments and using Guidance, Guidance=true, Treatments=true2026.04 | 42 | 13 | 4 | 10 | 11 | 4 | — | — | — | — | — | — | — | |
| GPT-4-turboCategory=Baseline, Guidance=false, Treatments=false2026.04 | 33 | 4 | 3 | 24 | 2 | — | — | — | — | — | — | — | — | |
| Llama3.1 70BCategory=Secondary Baseline with Guidance, Guidance=true, Treatments=false2026.04 | 33 | — | 3 | — | 2 | 8 | — | 13 | — | — | — | — | — | |
| WhiteRabbitNeoCategory=Secondary Baseline with Guidance, Guidance=true, Treatments=false2026.04 | 25 | 2 | 3 | — | — | 2 | — | — | — | — | — | — | — | |
| GPT-4o miniCategory=Secondary Baseline with Guidance, Guidance=true, Treatments=false2026.04 | 25 | 16 | 15 | — | — | 17 | — | — | — | — | — | — | — | |
| Llama3.1 70BCategory=Including our Treatments, Guidance=false, Treatments=true2026.04 | 25 | — | 5 | 5 | 25 | — | — | — | — | — | — | — | — | |
| Llama3 8BCategory=Baseline with Guidance, Guidance=true, Treatments=false2026.04 | 17 | — | — | — | 4 | 8 | — | — | — | — | — | — | — | |
| Llama3.1 70BCategory=Secondary Baseline, Guidance=false, Treatments=false2026.04 | 17 | — | 3 | 18 | — | — | — | — | — | — | — | — | — | |
| Llama3.1 8BCategory=Secondary Baseline with Guidance, Guidance=true, Treatments=false2026.04 | 17 | — | — | — | — | 3 | — | — | 32 | — | — | — | — | |
| Qwen2.5 7BCategory=Including our Treatments, Guidance=false, Treatments=true2026.04 | 17 | — | 10 | 4 | — | — | — | — | — | — | — | — | — | |
| Llama3.1 8BCategory=Including our Treatments, Guidance=false, Treatments=true2026.04 | 17 | — | 14 | — | — | 9 | — | — | — | — | — | — | — | |
| WhiteRabbitNeoCategory=Including our Treatments, Guidance=false, Treatments=true2026.04 | 17 | 2 | 4 | — | — | — | — | — | — | — | — | — | — | |
| Qwen2.5 7BCategory=Secondary Baseline, Guidance=false, Treatments=false2026.04 | 8 | — | — | — | — | 7 | — | — | — | — | — | — | — | |
| Llama3.1 8BCategory=Secondary Baseline, Guidance=false, Treatments=false2026.04 | 8 | — | — | — | — | 6 | — | — | — | — | — | — | — | |
| GPT-4o miniCategory=Secondary Baseline, Guidance=false, Treatments=false2026.04 | 8 | — | 7 | — | — | — | — | — | — | — | — | — | — | |
| WhiteRabbitNeoCategory=Secondary Baseline, Guidance=false, Treatments=false2026.04 | 8 | — | 7 | — | — | — | — | — | — | — | — | — | — | |
| Qwen2.5 7BCategory=Secondary Baseline with Guidance, Guidance=true, Treatments=false2026.04 | 8 | — | — | — | — | 1 | — | — | — | — | — | — | — | |
| Llama3 8BCategory=Baseline, Guidance=false, Treatments=false2026.04 | 0 | — | — | — | — | — | — | — | — | — | — | — | — |