# Financial Question Answering on FinanceBench Source: [Financial Question Answering on FinanceBench]() Collection index: [llms.txt]() Data updated: 2026-05-27T10:33:13.825Z Evaluation of Financial Question Answering performance on the FinanceBench dataset, measured using the % Cost Saving metric. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Financial Question Answering | | Dataset (including any stated split) | FinanceBench | | Metric | Cost Saving | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 8 of 8 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Cost Saving](): Higher is better; unit: PERCENT. ## Recorded results | Method | Cost Saving | Result date | Report paper | | --- | --- | --- | --- | | BRANE | 89.1 | Not recorded | 6a167adbdbd7150506f80331 | | BRANE | 19.1 | Not recorded | 6a167adbdbd7150506f80331 | | BRANE | 8.1 | Not recorded | 6a167adbdbd7150506f80331 | | CARROT-RoBERTa (Extended) | 2.3 | Not recorded | 6a167adbdbd7150506f80331 | | CARROT-KNN (Extended) | 2.2 | Not recorded | 6a167adbdbd7150506f80331 | | Most Accurate Static (Murakkab) | 0 | Not recorded | 6a167adbdbd7150506f80331 | | Most Accurate Static (Murakkab) | 0 | Not recorded | 6a167adbdbd7150506f80331 | | Most Accurate Static (Murakkab) | 0 | Not recorded | 6a167adbdbd7150506f80331 | ### BRANE Cost Saving: 89.1. Result ID: 6a16c853fbc373592c10a064. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Accuracy Goal":"90%"}. This record does not assert independent reproduction. ### BRANE Cost Saving: 19.1. Result ID: 6a16c853fbc373592c10a060. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Accuracy Goal":"95%"}. This record does not assert independent reproduction. ### BRANE Cost Saving: 8.1. Result ID: 6a16c853fbc373592c10a05e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Accuracy Goal":"100%"}. This record does not assert independent reproduction. ### CARROT-RoBERTa (Extended) Cost Saving: 2.3. Result ID: 6a16c853fbc373592c10a063. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Accuracy Goal":"90%"}. This record does not assert independent reproduction. ### CARROT-KNN (Extended) Cost Saving: 2.2. Result ID: 6a16c853fbc373592c10a062. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Accuracy Goal":"90%"}. This record does not assert independent reproduction. ### Most Accurate Static (Murakkab) Cost Saving: 0. Result ID: 6a16c853fbc373592c10a05d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Accuracy Goal":"100%"}. This record does not assert independent reproduction. ### Most Accurate Static (Murakkab) Cost Saving: 0. Result ID: 6a16c853fbc373592c10a05f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Accuracy Goal":"95%"}. This record does not assert independent reproduction. ### Most Accurate Static (Murakkab) Cost Saving: 0. Result ID: 6a16c853fbc373592c10a061. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Accuracy Goal":"90%"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.