Crash severity prediction on CPSRMS (test)
73.31AccuracyTransportAgent
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TransportAgentBackbone=Llama-3.3-70B-Instruct, Samples=15552026.01 | 73.31 | 0.678 | |
| OlogitSamples=15552026.01 | 64.6 | 0.419 | |
| CoTBackbone=Llama-3.3-70B-Instruct, Samples=15552026.01 | 63.99 | 0.6063 | |
| k-shot (vanilla LLM)Backbone=Llama-3.3-70B-Instruct, Shots=1-shot, Samples=15552026.01 | 57.56 | 0.5225 | |
| MLPSamples=15552026.01 | 19.3 | 0.081 | |
| MLP + feature selectionSamples=15552026.01 | 19.3 | 0.081 |