Message Parsing on CBRS en
0.0002Avg CostLLaMA-3.2-3B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LLaMA-3.2-3Bmode=zero-shot2026.04 | 0.0002 | 2,683.68 | 68.14 | 2,751.83 | 1.49 | |
| Gemini-2.0mode=zero-shot2026.04 | 0.0003 | 2,744.49 | 137.38 | 2,881.87 | 2.59 | |
| GPT-4o-minimode=zero-shot2026.04 | 0.0004 | 2,221.49 | 114.65 | 2,336.14 | 3.23 | |
| LLaMA-3.1-8Bmode=zero-shot2026.04 | 0.0005 | 2,810.61 | 120.55 | 2,931.16 | 1.19 | |
| Mistral-7Bmode=zero-shot2026.04 | 0.0007 | 3,313.11 | 163.78 | 3,476.89 | 2.2 | |
| Qwen-2.5-7Bmode=zero-shot2026.04 | 0.0009 | 2,913.79 | 139.69 | 3,053.49 | 1.65 | |
| Claude-3-Haikumode=zero-shot2026.04 | 0.001 | 2,825.26 | 198.11 | 3,023.37 | 2.49 | |
| Gemma-2-27Bmode=zero-shot2026.04 | 0.0023 | 2,756.49 | 137.57 | 2,894.06 | 3.32 | |
| LLaMA-3.3-70Bmode=zero-shot2026.04 | 0.0026 | 2,812.09 | 121.07 | 2,933.17 | 3.54 |