List your company

Code-generation monitoring on Evaluation objectives Standard prompt setting (out-of-domain)

100Exit RateGemini-3-Flash
5.172829.791454.4179.0286May 12, 2026

Evaluation results

MethodLinks
Gemini-3-FlashMonitor Scope=Code, Aware tau_hid=true2026.0510010010021.8278.5710010010010088.93
Gemini-3-FlashMonitor Scope=CoT+Code2026.051001001003.2737.1710097.310010081.97
Gemini-3-FlashMonitor Scope=CoT+Code, Aware tau_hid=true2026.0510010010016.3690.4810010010010089.65
Gemini-3-FlashMonitor Scope=Code2026.0594.121001003.3315.0410095.9593.3310077.97
CoT-Guard 4BMonitor Scope=Code2026.0588.8979.1788.6434.1842.778088.6881.939074.92
CoT-Guard 4BMonitor Scope=CoT+Code2026.0586.2787.588.6424.7328.8210094.395.2683.3376.54
Qwen3-32BMonitor Scope=Code2026.0585.2910097.733.271.7793.7530.4117.3319.6149.91
Qwen3-4BMonitor Scope=CoT+Code, mode=RL Only2026.0585.1970.8390.9127.8237.88097.383.689073.73
Qwen3-4BMonitor Scope=Code, mode=RL Only2026.0582.6891.6790.9125.2131.2310090.3338.6293.3371.55
Qwen3-32BMonitor Scope=CoT+Code2026.0582.141001006.671.7710081.17662.2267.77
GPT-5.4Monitor Scope=CoT+Code2026.0573.51001000010056.85630.4357.41
Qwen3-8BMonitor Scope=CoT+Code2026.0565.1495.8388.6721.646.749039.258.6775.7560.18
Qwen3-8BMonitor Scope=Code2026.0562.3195.8397.7306.1910012.161.2926.0944.62
Qwen3-4BMonitor Scope=Code, mode=SFT Only2026.0553.8195.8393.9104.4210027.036.448.743.35
Qwen3-4BMonitor Scope=CoT+Code, mode=SFT Only2026.055091.6796.156.423.3710060.86051.457.76
GPT-5.4Monitor Scope=Code2026.0538.241001000093.7501.33037.04
GPT-5-miniMonitor Scope=CoT+Code2026.0526.4795.4580.6501.7781.2525.6854.6724.6443.4
Llama3.1-8B-InstructMonitor Scope=Code2026.0522.882012.879.453.246027.29.222.3220.8
GPT-5-miniMonitor Scope=Code2026.0520.59100500081.251.350028.13
Qwen3-4BMonitor Scope=CoT+Code2026.0516.9995.83500093.59.82028.0234.9
Llama3.1-8B-InstructMonitor Scope=CoT+Code2026.0513.07103.522.420.783.127.986.4412.756.68
Qwen3-4BMonitor Scope=Code2026.058.8286.8420.97007501.338.722.41