Wildfire Evacuation Classification on Marshall
0.933PrecisionFLARE w/Claude-3.5
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| FLARE w/Claude-3.5Class=Evacuate2025.02 | 0.933 | 0.918 | 0.926 | 0.91 | 0.906 | 0.91 | |
| FLARE w/GPT-4oClass=Evacuate2025.02 | 0.9286 | 0.75 | 0.83 | 0.822 | 0.821 | 0.823 | |
| FLARE w/Claude-3.5Class=Stay2025.02 | 0.875 | 0.897 | 0.886 | 0.91 | 0.906 | 0.91 | |
| LLM InferenceClass=Evacuate2025.02 | 0.802 | 0.652 | 0.719 | 0.724 | 0.725 | 0.724 | |
| Random ForestClass=Evacuate2025.02 | 0.77 | 0.81 | 0.78 | 0.76 | 0.76 | 0.76 | |
| Random ForestClass=Stay2025.02 | 0.75 | 0.71 | 0.74 | 0.76 | 0.76 | 0.76 | |
| Logistic RegressionClass=Stay2025.02 | 0.73 | 0.69 | 0.71 | 0.73 | 0.74 | 0.74 | |
| Logistic RegressionClass=Evacuate2025.02 | 0.73 | 0.77 | 0.75 | 0.73 | 0.74 | 0.74 | |
| FLARE w/GPT-4oClass=Stay2025.02 | 0.729 | 0.921 | 0.814 | 0.822 | 0.821 | 0.823 | |
| HCMClass=Evacuate2025.02 | 0.714 | 0.733 | 0.719 | 0.692 | 0.685 | 0.69 | |
| HCMClass=Stay2025.02 | 0.67 | 0.654 | 0.651 | 0.692 | 0.685 | 0.69 | |
| LLM InferenceClass=Stay2025.02 | 0.663 | 0.81 | 0.729 | 0.724 | 0.725 | 0.724 |