List your company
ResearchFormerly WizWand

Financial Safety Evaluation on FinRED R3: Misinformation

97.76ASRGPTFuzzer (Black-box)
-3.910422.484848.8875.2752Jun 18, 2026
Updated 4mo ago

Evaluation results

MethodLinks
GPTFuzzer (Black-box)Target Model=EXAONE, Model Category=General-Purpose sLM2026.0697.76
GPTFuzzer (Black-box)Target Model=qqWen-7B, Model Category=Finance-Specific sLM2026.0697.01
GPTFuzzer (Black-box)Target Model=Qwen2.5, Model Category=General-Purpose sLM2026.0687.01
GPTFuzzer (Black-box)Target Model=Llama3.1, Model Category=General-Purpose sLM2026.0686.57
GCG (White-box)Target Model=Qwen2.5, Model Category=General-Purpose sLM2026.0676.87
GCG (White-box)Target Model=qqWen-7B, Model Category=Finance-Specific sLM2026.0673.13
GPTFuzzer (Black-box)Target Model=FinMA, Model Category=Finance-Specific sLM2026.0671.04
Direct RequestTarget Model=FinMA, Model Category=Finance-Specific sLM2026.0670.15
GCG (White-box)Target Model=FinMA, Model Category=Finance-Specific sLM2026.0666.42
GPTFuzzer (Black-box)Target Model=qqWen-32B, Model Category=Finance-Specific sLM2026.0666.41
GPTFuzzer (Black-box)Target Model=gemma3, Model Category=General-Purpose sLM2026.0664.17
GCG (White-box)Target Model=qqWen-32B, Model Category=Finance-Specific sLM2026.0659.7
GPTFuzzer (Black-box)Target Model=Gemini-Flash, Model Category=API-Based LLM2026.0658.81
AutoDAN-TurboTarget Model=gemma3, Model Category=General-Purpose sLM2026.0654.18
AutoDAN (White-box)Target Model=FinMA, Model Category=Finance-Specific sLM2026.0652.99
GPTFuzzer (Black-box)Target Model=Gemini-Pro, Model Category=API-Based LLM2026.0642.39
TAP (Black-box)Target Model=qqWen-7B, Model Category=Finance-Specific sLM2026.0641.79
AutoDAN-TurboTarget Model=FinMA, Model Category=Finance-Specific sLM2026.0639.55
Direct RequestTarget Model=EXAONE, Model Category=General-Purpose sLM2026.0638.06
AutoDAN-TurboTarget Model=Gemini-Pro, Model Category=API-Based LLM2026.0637.55
TAP (Black-box)Target Model=Qwen2.5, Model Category=General-Purpose sLM2026.0635.07
AutoDAN (White-box)Target Model=qqWen-7B, Model Category=Finance-Specific sLM2026.0634.33
AutoDAN-TurboTarget Model=EXAONE, Model Category=General-Purpose sLM2026.0633.58
Direct RequestTarget Model=Gemini-Flash, Model Category=API-Based LLM2026.0632.09
AutoDAN (White-box)Target Model=Qwen2.5, Model Category=General-Purpose sLM2026.0632.09
Direct RequestTarget Model=qqWen-7B, Model Category=Finance-Specific sLM2026.0631.34
Direct RequestTarget Model=Gemini-Pro, Model Category=API-Based LLM2026.0631.34
GCG (White-box)Target Model=EXAONE, Model Category=General-Purpose sLM2026.0631.34
AutoDAN (White-box)Target Model=qqWen-32B, Model Category=Finance-Specific sLM2026.0631.34
TAP (Black-box)Target Model=FinMA, Model Category=Finance-Specific sLM2026.0629.1
Direct RequestTarget Model=Qwen2.5, Model Category=General-Purpose sLM2026.0627.61
GCG (White-box)Target Model=gemma3, Model Category=General-Purpose sLM2026.0627.61
AutoDAN-TurboTarget Model=qqWen-7B, Model Category=Finance-Specific sLM2026.0627.61
Direct RequestTarget Model=qqWen-32B, Model Category=Finance-Specific sLM2026.0626.87
AutoDAN (White-box)Target Model=EXAONE, Model Category=General-Purpose sLM2026.0626.87
AutoDAN-TurboTarget Model=Qwen2.5, Model Category=General-Purpose sLM2026.0623.88
AutoDAN-TurboTarget Model=qqWen-32B, Model Category=Finance-Specific sLM2026.0623.88
TAP (Black-box)Target Model=EXAONE, Model Category=General-Purpose sLM2026.0620.15
TAP (Black-box)Target Model=qqWen-32B, Model Category=Finance-Specific sLM2026.0620.15
Direct RequestTarget Model=gemma3, Model Category=General-Purpose sLM2026.0619.4
AutoDAN (White-box)Target Model=gemma3, Model Category=General-Purpose sLM2026.0616.42
Direct RequestTarget Model=Llama3.1, Model Category=General-Purpose sLM2026.0615.67
AutoDAN (White-box)Target Model=Llama3.1, Model Category=General-Purpose sLM2026.0614.93
AutoDAN-TurboTarget Model=Gemini-Flash, Model Category=API-Based LLM2026.0614.18
AutoDAN-TurboTarget Model=GPT-5-mini, Model Category=API-Based LLM2026.069.2
GPTFuzzer (Black-box)Target Model=Claude-4, Model Category=API-Based LLM2026.068.96
AutoDAN-TurboTarget Model=GPT-5, Model Category=API-Based LLM2026.068.15
TAP (Black-box)Target Model=GPT-5-mini, Model Category=API-Based LLM2026.067.46
AutoDAN-TurboTarget Model=Claude-4, Model Category=API-Based LLM2026.067.14
GCG (White-box)Target Model=Llama3.1, Model Category=General-Purpose sLM2026.066.72
TAP (Black-box)Target Model=gemma3, Model Category=General-Purpose sLM2026.066.72
AutoDAN-TurboTarget Model=Llama3.1, Model Category=General-Purpose sLM2026.066.72
TAP (Black-box)Target Model=GPT-5, Model Category=API-Based LLM2026.065.22
TAP (Black-box)Target Model=Gemini-Pro, Model Category=API-Based LLM2026.065.22
Direct RequestTarget Model=GPT-5-mini, Model Category=API-Based LLM2026.063.73
GPTFuzzer (Black-box)Target Model=GPT-5-mini, Model Category=API-Based LLM2026.063.73
TAP (Black-box)Target Model=Gemini-Flash, Model Category=API-Based LLM2026.062.99
TAP (Black-box)Target Model=Llama3.1, Model Category=General-Purpose sLM2026.062.24
Direct RequestTarget Model=GPT-5, Model Category=API-Based LLM2026.061.49
GPTFuzzer (Black-box)Target Model=GPT-5, Model Category=API-Based LLM2026.060.75
Direct RequestTarget Model=Claude-4, Model Category=API-Based LLM2026.060
Claude-4Target Model=Claude-4, Model Category=API-Based LLM2026.060