Frame Detection on Logistics Frame Detection (test)
90AccuracyGPT-4o
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4oPrompting Strategy=Auto Prompt + RAG (6-shot)2025.12 | 90 | |
| GPT-4o miniPrompting Strategy=Auto Prompt + RAG (6-shot)2025.12 | 88 | |
| LLaMA 3.1 70BPrompting Strategy=Auto Prompt + RAG (6-shot)2025.12 | 87 | |
| Qwen 2.5 72BPrompting Strategy=Auto Prompt + RAG (6-shot)2025.12 | 87 | |
| GPT-4oPrompting Strategy=Auto Prompt + RAG (3-shot)2025.12 | 86 | |
| GPT-4o miniPrompting Strategy=Auto Prompt + RAG (3-shot)2025.12 | 85 | |
| GPT-4oPrompting Strategy=Manual Prompt (6-shot)2025.12 | 84 | |
| GPT-4oPrompting Strategy=Auto Prompt (0-shot)2025.12 | 84 | |
| GPT-4o miniPrompting Strategy=Manual Prompt (6-shot)2025.12 | 83 | |
| GPT-4o miniPrompting Strategy=Auto Prompt (0-shot)2025.12 | 82 | |
| LLaMA 3.1 70BPrompting Strategy=Auto Prompt + RAG (3-shot)2025.12 | 79 | |
| Qwen 2.5 72BPrompting Strategy=Auto Prompt + RAG (3-shot)2025.12 | 79 | |
| Qwen 2.5 72BPrompting Strategy=Auto Prompt (0-shot)2025.12 | 76 | |
| LLaMA 3.1 70BPrompting Strategy=Auto Prompt (0-shot)2025.12 | 74 | |
| Qwen 2.5 72BPrompting Strategy=Manual Prompt (6-shot)2025.12 | 73 | |
| LLaMA 3.1 70BPrompting Strategy=Manual Prompt (6-shot)2025.12 | 72 |