Instruction Following on FollowRAG Instruction
42.3FollowRAG Instruction ScoreCaR
Evaluation Results
| Method | Links | |
|---|---|---|
| CaRTraining Dataset=Alpaca, Selection Ratio=10%, Base Model=LLaMA-3-8B2025.02 | 42.3 | |
| CaRTraining Dataset=Alpaca, Selection Ratio=5%, Base Model=LLaMA-3-8B2025.02 | 41.4 | |
| NuggetsTraining Dataset=Alpaca, Selection Ratio=10%, Base Model=LLaMA-3-8B2025.02 | 41.1 | |
| CaRTraining Dataset=Alpaca, Selection Ratio=15%, Base Model=LLaMA-3-8B2025.02 | 41 | |
| NuggetsTraining Dataset=Alpaca, Selection Ratio=5%, Base Model=LLaMA-3-8B2025.02 | 40.6 | |
| NuggetsTraining Dataset=Alpaca, Selection Ratio=15%, Base Model=LLaMA-3-8B2025.02 | 40.6 | |
| IFDTraining Dataset=Alpaca, Selection Ratio=10%, Base Model=LLaMA-3-8B2025.02 | 40.4 | |
| IFDTraining Dataset=Alpaca, Selection Ratio=15%, Base Model=LLaMA-3-8B2025.02 | 40.2 | |
| NOVATraining Dataset=Alpaca, Selection Ratio=15%, Base Model=LLaMA-3-8B2025.02 | 40.1 | |
| IFDTraining Dataset=Alpaca, Selection Ratio=5%, Base Model=LLaMA-3-8B2025.02 | 39.6 | |
| FLAME-DPOfactTraining Dataset=Alpaca, Base Model=LLaMA-3-8B2025.02 | 39.2 | |
| NOVATraining Dataset=Alpaca, Selection Ratio=5%, Base Model=LLaMA-3-8B2025.02 | 39.1 | |
| NOVATraining Dataset=Alpaca-GPT4, Selection Ratio=10%, Base Model=LLaMA-3-8B2025.02 | 39.1 | |
| NOVATraining Dataset=Alpaca, Selection Ratio=10%, Base Model=LLaMA-3-8B2025.02 | 38.8 | |
| VanillaTraining Dataset=Alpaca, Selection Ratio=100%, Base Model=LLaMA-3-8B2025.02 | 38.7 | |
| SELF-EVALTraining Dataset=Alpaca, Base Model=LLaMA-3-8B2025.02 | 38.5 | |
| NuggetsTraining Dataset=Alpaca-GPT4, Selection Ratio=5%, Base Model=LLaMA-3-8B2025.02 | 38.5 | |
| CaRTraining Dataset=Alpaca-GPT4, Selection Ratio=15%, Base Model=LLaMA-3-8B2025.02 | 38.1 | |
| CaRTraining Dataset=Alpaca-GPT4, Selection Ratio=5%, Base Model=LLaMA-3-8B2025.02 | 38 | |
| CaRTraining Dataset=Alpaca-GPT4, Selection Ratio=10%, Base Model=LLaMA-3-8B2025.02 | 38 | |
| NuggetsTraining Dataset=Alpaca-GPT4, Selection Ratio=10%, Base Model=LLaMA-3-8B2025.02 | 38 | |
| NuggetsTraining Dataset=Alpaca-GPT4, Selection Ratio=15%, Base Model=LLaMA-3-8B2025.02 | 38 | |
| IFDTraining Dataset=Alpaca-GPT4, Selection Ratio=15%, Base Model=LLaMA-3-8B2025.02 | 37.9 | |
| NOVATraining Dataset=Alpaca-GPT4, Selection Ratio=5%, Base Model=LLaMA-3-8B2025.02 | 37.8 | |
| IFDTraining Dataset=Alpaca-GPT4, Selection Ratio=10%, Base Model=LLaMA-3-8B2025.02 | 37.8 | |
| NOVATraining Dataset=Alpaca-GPT4, Selection Ratio=15%, Base Model=LLaMA-3-8B2025.02 | 37.5 | |
| FLAME-DPOfactTraining Dataset=Alpaca-GPT4, Base Model=LLaMA-3-8B2025.02 | 37.2 | |
| IFDTraining Dataset=Alpaca-GPT4, Selection Ratio=5%, Base Model=LLaMA-3-8B2025.02 | 37 | |
| VanillaTraining Dataset=Alpaca-GPT4, Selection Ratio=100%, Base Model=LLaMA-3-8B2025.02 | 36.9 | |
| SELF-EVALTraining Dataset=Alpaca-GPT4, Base Model=LLaMA-3-8B2025.02 | 36.5 |