List your company

Forensic Detection on FakeClass FakeBench (qualitative setting)

99.5Detection Rate (Fake)FakeScope
8.532.12555.7579.375Mar 31, 2025

Evaluation results

MethodLinks
FakeScopeBackbone=mPLUG-Owl22025.0399.599.8799.7399.6310010099.6710010010098.6710097.679999.68
FakeScopeBackbone=LLaVA-v1.52025.0398.6797.9398.6797.9399.6798.679999.6796.679799.331009898.6798.3
Human (Best)2025.039793——1001001001001001001001001009387.5
Human (Overall)2025.0376.9172.12——95.4758.8287.0795.963.9682.9179.4177.6670.6945.5974.51
InstructBLIPBackbone=Vicuna-7B2025.0367.847.6765.2350.2380.6765.336671.336870.3360.336170.6764.3357.73
GPT-4VType=Proprietary, teacher2025.0359.8796.276.3379.73956666.6781.3336.674945.6744.33615378.03
mPLUG-Owl2Backbone=LaMA2-7B, Status=baseline2025.0349.693.9771.8771.756.33107275.3319.33325655645671.78
Human (Worst)2025.034313——50046.1577.7833.3316.6741.677.1414.29055
Random guess2025.0342.2758.0351.848.540.333651.6733.673844.6732.3347.6737.6760.6750.15
LLaVA-v1.5Backbone=Vicuna-7B, Status=baseline2025.033877.455.7759.6344.3317.3345.3355.332328.3339.67004157.7
GeminiProType=Proprietary2025.0335.8399.2761.2773.8345.3315.6747.3352.6719.332835.3335.67413867.5
InternLM-XC.2-vlBackbone=InternLM2-7B2025.0332.1792.3360.464.15412.6743.33491920.3329.3329.6734.6729.6762.25
Qwen-VLBackbone=Qwen-7B2025.0328.5784.2751.1761.1745.675.673537.678.3314.3331.332146.674056.42
IDEFICS-InstructBackbone=LLaMA-7B2025.0324.9731.97749.9319.6727.3324.3328.3327.672423.6723.67242728.47
Claude3 SonnetType=Proprietary2025.031298.2355.9754.277020.3313.670.672.6715.339.3330.3320.6755.12