# Financial Compliance Classification on FinGuard-Bench response-level Source: [Financial Compliance Classification on FinGuard-Bench response-level]() Collection index: [llms.txt]() Data updated: 2026-05-29T08:53:09.680Z Evaluation of model performance on the FinGuard-Bench response-level dataset for Financial Compliance Classification, measured using F1 score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Financial Compliance Classification | | Dataset (including any stated split) | FinGuard-Bench response-level | | Metric | F1 Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 12 of 12 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | F1 Score | Result date | Report paper | | --- | --- | --- | --- | | FinGuard | 85.43 | Not recorded | 6a191d76dbd7150506f826e5 | | FinGuard | 84.71 | Not recorded | 6a191d76dbd7150506f826e5 | | Qwen3Guard-Gen-8B | 73.49 | Not recorded | 6a191d76dbd7150506f826e5 | | GPT-5.1 | 64.09 | Not recorded | 6a191d76dbd7150506f826e5 | | Qwen3.5-397B-A17B | 64.08 | Not recorded | 6a191d76dbd7150506f826e5 | | Gemini-3.1-Flash | 52.77 | Not recorded | 6a191d76dbd7150506f826e5 | | PolyGuard-Qwen-7B | 46.08 | Not recorded | 6a191d76dbd7150506f826e5 | | Qwen3.5-9B | 33.67 | Not recorded | 6a191d76dbd7150506f826e5 | | NemoGuard-8B | 29.18 | Not recorded | 6a191d76dbd7150506f826e5 | | LlamaGuard3-8B | 28.87 | Not recorded | 6a191d76dbd7150506f826e5 | | Qwen3-8B | 22.91 | Not recorded | 6a191d76dbd7150506f826e5 | | Qwen3Guard-Gen-8B | 19.42 | Not recorded | 6a191d76dbd7150506f826e5 | ### FinGuard F1 Score: 85.43. Result ID: 6a195282fbc373592c13c451. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"self-play":"true"}. This record does not assert independent reproduction. ### FinGuard F1 Score: 84.71. Result ID: 6a195282fbc373592c13c450. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"self-play":"false"}. This record does not assert independent reproduction. ### Qwen3Guard-Gen-8B F1 Score: 73.49. Result ID: 6a195282fbc373592c13c44e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"strict"}. This record does not assert independent reproduction. ### GPT-5.1 F1 Score: 64.09. Result ID: 6a195282fbc373592c13c44a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Qwen3.5-397B-A17B F1 Score: 64.08. Result ID: 6a195282fbc373592c13c448. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Gemini-3.1-Flash F1 Score: 52.77. Result ID: 6a195282fbc373592c13c449. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### PolyGuard-Qwen-7B F1 Score: 46.08. Result ID: 6a195282fbc373592c13c44d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Qwen3.5-9B F1 Score: 33.67. Result ID: 6a195282fbc373592c13c447. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### NemoGuard-8B F1 Score: 29.18. Result ID: 6a195282fbc373592c13c44c. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LlamaGuard3-8B F1 Score: 28.87. Result ID: 6a195282fbc373592c13c44b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Qwen3-8B F1 Score: 22.91. Result ID: 6a195282fbc373592c13c446. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Qwen3Guard-Gen-8B F1 Score: 19.42. Result ID: 6a195282fbc373592c13c44f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"loose"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.