# Crisis response generation on Earthquake and Typhoon cross-crisis scenarios Source: [Crisis response generation on Earthquake and Typhoon cross-crisis scenarios]() Collection index: [llms.txt]() Data updated: 2026-04-03T07:03:59.902Z Evaluation of model performance on generating appropriate crisis responses across combined earthquake and typhoon scenarios, assessed using human evaluation metrics such as Professionalism, Actionability, and Relevance. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Crisis response generation | | Dataset (including any stated split) | Earthquake and Typhoon cross-crisis scenarios generalization Llama-3.1-8B-Instruct | | Metric | Professionalism Score | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 8 of 8 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Professionalism Score](): Higher is better; unit: SCALAR. - [Actionability Score](): Higher is better; unit: SCALAR. - [Relevance Score](): Higher is better; unit: SCALAR. - [Overall Quality Score](): Higher is better; unit: SCALAR. - [Consistency Score](): Higher is better; unit: SCALAR. ## Recorded results | Method | Professionalism Score | Result date | Report paper | | --- | --- | --- | --- | | Fusion w/ Eval & Weight Instruct | 1 | Not recorded | 68fa7b771e209131cea88a7a | | Fusion w/ Eval | 0.98 | Not recorded | 68fa7b771e209131cea88a7a | | Prompt and Select | 0.97 | Not recorded | 68fa7b771e209131cea88a7a | | Fusion w/o Eval | 0.96 | Not recorded | 68fa7b771e209131cea88a7a | | Fusion w/ Eval & Instruct | 0.96 | Not recorded | 68fa7b771e209131cea88a7a | | RAG | 0.94 | Not recorded | 68fa7b771e209131cea88a7a | | Instructional Prompt | 0.93 | Not recorded | 68fa7b771e209131cea88a7a | | RAG-PE | 0.76 | Not recorded | 68fa7b771e209131cea88a7a | ### Fusion w/ Eval & Weight Instruct Professionalism Score: 1. Result ID: 69cf655247f34ce924b8b3aa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.1-8B-Instruct"}. This record does not assert independent reproduction. ### Fusion w/ Eval Professionalism Score: 0.98. Result ID: 69cf655247f34ce924b8b3a8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.1-8B-Instruct"}. This record does not assert independent reproduction. ### Prompt and Select Professionalism Score: 0.97. Result ID: 69cf655247f34ce924b8b3a6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.1-8B-Instruct"}. This record does not assert independent reproduction. ### Fusion w/o Eval Professionalism Score: 0.96. Result ID: 69cf655247f34ce924b8b3a7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.1-8B-Instruct"}. This record does not assert independent reproduction. ### Fusion w/ Eval & Instruct Professionalism Score: 0.96. Result ID: 69cf655247f34ce924b8b3a9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.1-8B-Instruct"}. This record does not assert independent reproduction. ### RAG Professionalism Score: 0.94. Result ID: 69cf655247f34ce924b8b3a4. [Reporting paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.1-8B-Instruct"}. This record does not assert independent reproduction. ### Instructional Prompt Professionalism Score: 0.93. Result ID: 69cf655247f34ce924b8b3a3. [Reporting paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.1-8B-Instruct"}. This record does not assert independent reproduction. ### RAG-PE Professionalism Score: 0.76. Result ID: 69cf655247f34ce924b8b3a5. [Reporting paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.1-8B-Instruct"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.