Wildfire Evacuation Classification on Kincade
98.1PrecisionFLARE w/GPT-4o
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| FLARE w/GPT-4oClass=Evacuate2025.02 | 98.1 | 77.3 | 86.4 | 80.3 | 75 | 82.2 | |
| FLARE w/Claude-3.5Class=Evacuate2025.02 | 96.9 | 93.9 | 95.4 | 92.6 | 88.3 | 92.8 | |
| LLM InferenceClass=Evacuate2025.02 | 87 | 83.4 | 85.2 | 76.7 | 65.2 | 77.5 | |
| HCMClass=Evacuate2025.02 | 82.6 | 97.3 | 71.9 | 81.1 | 48.1 | 76.1 | |
| Logistic RegressionClass=Evacuate2025.02 | 80 | 93 | 86 | 78 | 63 | 74.6 | |
| Random ForestClass=Evacuate2025.02 | 78 | 98 | 87 | 78 | 56 | 71.8 | |
| FLARE w/Claude-3.5Class=Stay2025.02 | 76.5 | 86.7 | 81.3 | 92.6 | 88.3 | 92.8 | |
| Random ForestClass=Stay2025.02 | 75 | 15 | 25 | 78 | 56 | 71.8 | |
| HCMClass=Stay2025.02 | 63.3 | 18.4 | 24.4 | 81.1 | 48.1 | 76.1 | |
| Logistic RegressionClass=Stay2025.02 | 60 | 30 | 40 | 78 | 63 | 74.6 | |
| FLARE w/GPT-4oClass=Stay2025.02 | 48.3 | 93.3 | 63.6 | 80.3 | 75 | 82.2 | |
| LLM InferenceClass=Stay2025.02 | 41.9 | 49.1 | 45.4 | 76.7 | 65.2 | 77.5 |