Email Writing on RefuteBench Email Writing 1.0 (test)
98FAGPT-4
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GPT-42024.02 | 98 | 81 | 59 | 70 | 42 | 72.9 | |
| Claude-22024.02 | 95 | 68 | 39 | 54 | 17 | 36.2 | |
| ChatGPT2024.02 | 92 | 47 | 30 | 50 | 11 | 29.3 | |
| LLAMA-2-7B-ChatParameters=7B, Model Type=Chat2024.02 | 84 | 12 | 2 | 4 | 1 | 12.25 | |
| LLAMA-2-13B-ChatParameters=13B, Model Type=Chat2024.02 | 82 | 42 | 2 | 22 | 2 | 17.25 | |
| Mistral-7B-Instruct-v0.2Parameters=7B, Model Type=Instruct2024.02 | 76 | 50 | 31 | 34 | 20 | 35.35 | |
| ALPACA-7BParameters=7B2024.02 | 65 | 25 | 11 | 1 | 0 | 13.1 |