Instruction Following on MQUAKE
82.5AccuracyLLAMA3-8B-INSTRUCT
Evaluation Results
| Method | Links | |
|---|---|---|
| LLAMA3-8B-INSTRUCTAlignment=Context-DPO, Few-shot=5-shot2024.12 | 82.5 | |
| MISTRAL-7B-INSTRUCTAlignment=Context-DPO, Few-shot=5-shot2024.12 | 82.3 | |
| QWEN2-7B-INSTRUCTAlignment=Context-DPO, Few-shot=5-shot2024.12 | 81.8 | |
| LLAMA2-7B-CHATAlignment=Context-DPO, Few-shot=5-shot2024.12 | 80.2 | |
| LLAMA3-8B-INSTRUCTAlignment=Context-DPO, Few-shot=3-shot2024.12 | 79.7 | |
| QWEN2-7B-INSTRUCTAlignment=Context-DPO, Few-shot=3-shot2024.12 | 78.6 | |
| MISTRAL-7B-INSTRUCTAlignment=Context-DPO, Few-shot=3-shot2024.12 | 77.8 | |
| LLAMA2-7B-CHATAlignment=Context-DPO, Few-shot=3-shot2024.12 | 76.5 | |
| LLAMA2-7B-CHATAlignment=Base, Few-shot=5-shot2024.12 | 74.5 | |
| QWEN2-7B-INSTRUCTAlignment=Context-DPO, Few-shot=1-shot2024.12 | 74.4 | |
| MISTRAL-7B-INSTRUCTAlignment=Context-DPO, Few-shot=1-shot2024.12 | 74.2 | |
| LLAMA2-7B-CHATAlignment=Context-DPO, Few-shot=1-shot2024.12 | 72.6 | |
| LLAMA3-8B-INSTRUCTAlignment=Context-DPO, Few-shot=1-shot2024.12 | 71.3 | |
| QWEN2-7B-INSTRUCTAlignment=Base, Few-shot=5-shot2024.12 | 71.3 | |
| LLAMA2-7B-CHATAlignment=Base, Few-shot=3-shot2024.12 | 68.1 | |
| LLAMA3-8B-INSTRUCTAlignment=Base, Few-shot=5-shot2024.12 | 67.9 | |
| LLAMA2-7B-CHATAlignment=Base, Few-shot=1-shot2024.12 | 67.3 | |
| QWEN2-7B-INSTRUCTAlignment=Base, Few-shot=3-shot2024.12 | 64.2 | |
| LLAMA3-8B-INSTRUCTAlignment=Base, Few-shot=3-shot2024.12 | 63.8 | |
| QWEN2-7B-INSTRUCTAlignment=Base, Few-shot=1-shot2024.12 | 61 | |
| MISTRAL-7B-INSTRUCTAlignment=Base, Few-shot=5-shot2024.12 | 58.4 | |
| LLAMA3-8B-INSTRUCTAlignment=Base, Few-shot=1-shot2024.12 | 56.8 | |
| MISTRAL-7B-INSTRUCTAlignment=Base, Few-shot=3-shot2024.12 | 55.9 | |
| MISTRAL-7B-INSTRUCTAlignment=Base, Few-shot=1-shot2024.12 | 53.6 |