# Crisis Response Generation on Twitter Source: [Crisis Response Generation on Twitter]() Collection index: [llms.txt]() Data updated: 2026-04-03T07:03:59.858Z Evaluation of generative models on the Twitter dataset specifically for generating crisis responses, measured using human-centric quality metrics like Professionalism, Actionability, and Relevance. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Crisis response generation | | Dataset (including any stated split) | Twitter | | Metric | Professionalism | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Professionalism](): Higher is better; unit: PERCENT. - [Actionability](): Higher is better; unit: PERCENT. - [Relevance](): Higher is better; unit: PERCENT. - [Overall Quality](): Higher is better; unit: PERCENT. - [Consistency](): Higher is better; unit: PERCENT. ## Recorded results | Method | Professionalism | Result date | Report paper | | --- | --- | --- | --- | | Fusion w/ Eval & Weight Instruct | 99 | Not recorded | 68fa7b771e209131cea88a7a | | Fusion w/ Eval | 98 | Not recorded | 68fa7b771e209131cea88a7a | | Fusion w/ Eval & Weight Instruct | 97 | Not recorded | 68fa7b771e209131cea88a7a | | RAG | 96 | Not recorded | 68fa7b771e209131cea88a7a | | Fusion w/ Eval & Instruct | 96 | Not recorded | 68fa7b771e209131cea88a7a | | RAG-PE | 94 | Not recorded | 68fa7b771e209131cea88a7a | | Fusion w/o Eval | 93 | Not recorded | 68fa7b771e209131cea88a7a | | Fusion w/ Eval & Instruct | 92 | Not recorded | 68fa7b771e209131cea88a7a | | Fusion w/ Eval | 92 | Not recorded | 68fa7b771e209131cea88a7a | | Instructional Prompt | 87 | Not recorded | 68fa7b771e209131cea88a7a | | RAG | 87 | Not recorded | 68fa7b771e209131cea88a7a | | RAG-PE | 76 | Not recorded | 68fa7b771e209131cea88a7a | | Prompt and Select | 75 | Not recorded | 68fa7b771e209131cea88a7a | | Instructional Prompt | 74 | Not recorded | 68fa7b771e209131cea88a7a | | Fusion w/o Eval | 55 | Not recorded | 68fa7b771e209131cea88a7a | | Prompt and Select | 50 | Not recorded | 68fa7b771e209131cea88a7a | ### Fusion w/ Eval & Weight Instruct Professionalism: 99. Result ID: 69cf655247f34ce924b8b39a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama","Category":"Fusion"}. This record does not assert independent reproduction. ### Fusion w/ Eval Professionalism: 98. Result ID: 69cf655247f34ce924b8b398. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama","Category":"Fusion"}. This record does not assert independent reproduction. ### Fusion w/ Eval & Weight Instruct Professionalism: 97. Result ID: 69cf655247f34ce924b8b3a2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Mistral","Category":"Fusion"}. This record does not assert independent reproduction. ### RAG Professionalism: 96. Result ID: 69cf655247f34ce924b8b394. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama","Category":"Baseline"}. This record does not assert independent reproduction. ### Fusion w/ Eval & Instruct Professionalism: 96. Result ID: 69cf655247f34ce924b8b3a1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Mistral","Category":"Fusion"}. This record does not assert independent reproduction. ### RAG-PE Professionalism: 94. Result ID: 69cf655247f34ce924b8b395. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama","Category":"Baseline"}. This record does not assert independent reproduction. ### Fusion w/o Eval Professionalism: 93. Result ID: 69cf655247f34ce924b8b39f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Mistral","Category":"Baseline"}. This record does not assert independent reproduction. ### Fusion w/ Eval & Instruct Professionalism: 92. Result ID: 69cf655247f34ce924b8b399. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama","Category":"Fusion"}. This record does not assert independent reproduction. ### Fusion w/ Eval Professionalism: 92. Result ID: 69cf655247f34ce924b8b3a0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Mistral","Category":"Fusion"}. This record does not assert independent reproduction. ### Instructional Prompt Professionalism: 87. Result ID: 69cf655247f34ce924b8b39b. [Reporting paper]() Recorded evaluation configuration: {"Model":"Mistral","Category":"Baseline"}. This record does not assert independent reproduction. ### RAG Professionalism: 87. Result ID: 69cf655247f34ce924b8b39c. [Reporting paper]() Recorded evaluation configuration: {"Model":"Mistral","Category":"Baseline"}. This record does not assert independent reproduction. ### RAG-PE Professionalism: 76. Result ID: 69cf655247f34ce924b8b39d. [Reporting paper]() Recorded evaluation configuration: {"Model":"Mistral","Category":"Baseline"}. This record does not assert independent reproduction. ### Prompt and Select Professionalism: 75. Result ID: 69cf655247f34ce924b8b39e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Mistral","Category":"Baseline"}. This record does not assert independent reproduction. ### Instructional Prompt Professionalism: 74. Result ID: 69cf655247f34ce924b8b393. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama","Category":"Baseline"}. This record does not assert independent reproduction. ### Fusion w/o Eval Professionalism: 55. Result ID: 69cf655247f34ce924b8b397. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama","Category":"Baseline"}. This record does not assert independent reproduction. ### Prompt and Select Professionalism: 50. Result ID: 69cf655247f34ce924b8b396. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama","Category":"Baseline"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.