Reading Comprehension on RACE mid
89.9AccuracyFlexora
Evaluation Results
| Method | Links | |
|---|---|---|
| FlexoraBackbone=Qwen1.5-7B2024.08 | 89.9 | |
| FlexoraBackbone=Gemma-7B2024.08 | 89.62 | |
| FlexoraBackbone=Yi-6B2024.08 | 88.72 | |
| Flexora (w/ LoReFT)Backbone Model=Llama3-8B, LoRA Algorithm=LoReFT, Flexora Integration=true2024.08 | 88.36 | |
| Flexora (w/ rsLoRA)Backbone Model=Llama3-8B, LoRA Algorithm=rsLoRA, Flexora Integration=true2024.08 | 88.21 | |
| LoReFTBackbone Model=Llama3-8B, LoRA Algorithm=LoReFT, Flexora Integration=false2024.08 | 88.21 | |
| KALEBackbone=Gemma2 9B, Category=Augmented-based2026.01 | 87.74 | |
| rsLoRABackbone Model=Llama3-8B, LoRA Algorithm=rsLoRA, Flexora Integration=false2024.08 | 87.6 | |
| LoRABackbone=Qwen1.5-7B2024.08 | 87.59 | |
| FlexoraBackbone=Qwen2.5-32B2024.08 | 87.16 | |
| Flexora (w/ DoRA)Backbone Model=Llama3-8B, LoRA Algorithm=DoRA, Flexora Integration=true2024.08 | 87.12 | |
| Chinchillaevaluation_mode=Few-Shot2022.03 | 86.8 | |
| DoRABackbone Model=Llama3-8B, LoRA Algorithm=DoRA, Flexora Integration=false2024.08 | 86.77 | |
| KALEBackbone=Qwen2.5 32B, Category=Augmented-based2026.01 | 86.7 | |
| FlexoraBackbone=Zephyr-7B-beta2024.08 | 86.19 | |
| MoSLoRABackbone Model=Llama3-8B, LoRA Algorithm=MoSLoRA, Flexora Integration=false2024.08 | 86.13 | |
| LoRABackbone Model=Llama3-8B, LoRA Algorithm=LoRA, Flexora Integration=false2024.08 | 85.86 | |
| LoRABackbone=Gemma-7B2024.08 | 85.73 | |
| FlexoraBackbone=Mistral-7B-v0.12024.08 | 85.72 | |
| FlexoraLoRA Rank (r)=162024.08 | 85.62 | |
| Flexora (w/ MoSLoRA)Backbone Model=Llama3-8B, LoRA Algorithm=MoSLoRA, Flexora Integration=true2024.08 | 85.09 | |
| FlexoraBackbone=Llama2-7B2024.08 | 84.89 | |
| FlexoraBackbone=Xuan Yuan-6B2024.08 | 84.89 | |
| Flexora (w/ LoRA)Backbone Model=Llama3-8B, LoRA Algorithm=LoRA, Flexora Integration=true2024.08 | 84.61 | |
| FlexoraBackbone=Llama3-8B2024.08 | 84.61 | |
| FlexoraLoRA Rank (r)=82024.08 | 84.61 | |
| FlexoraFine-tuning Strategy=LoRA, Enhanced=Flexora2024.08 | 84.61 | |
| Flexora(w/ Base Model)Backbone=Meta-Llama-3-8B, Model variant=Base, Adaptation=Flexora2024.08 | 84.61 | |
| Flexora(w/ Instruct Model)Backbone=Meta-Llama-3-8B-Instruct, Model variant=Instruct, Adaptation=Flexora2024.08 | 84.58 | |
| FlexoraLoRA Rank (r)=322024.08 | 84.27 | |
| LoRABackbone=Qwen2.5-32B2024.08 | 84.17 | |
| GPT3MixBackbone=Gemma2 9B, Category=Augmented-based2026.01 | 83.98 | |
| LoRABackbone=Mistral-7B-v0.12024.08 | 83.79 | |
| Random (Greedy)Selection=randomly selected layers, LoRA Rank (r)=82024.08 | 83.77 | |
| VeRALoRA Rank (r)=82024.08 | 83.55 | |
| LoRABackbone=Zephyr-7B-beta2024.08 | 83.45 | |
| AugGPTBackbone=Gemma2 9B, Category=Augmented-based2026.01 | 83.33 | |
| LoRA-SPLoRA Rank (r)=82024.08 | 83.27 | |
| AdaLoRAro=4, LoRA Rank (r)=82024.08 | 83.15 | |
| FlexoraFine-tuning Strategy=Full Fine-Tuning, Enhanced=Flexora2024.08 | 83.13 | |
| DMTBackbone=Gemma2 9B, Category=SFT-based2026.01 | 83.01 | |
| LoRAPruneRatio=0.5, LoRA Rank (r)=82024.08 | 82.96 | |
| FlexoraBackbone=Vicuna-7B-v1.52024.08 | 82.94 | |
| LoRABackbone=Llama3-8B2024.08 | 82.86 | |
| LoRALoRA Rank (r)=82024.08 | 82.86 | |
| LoRAFine-tuning Strategy=LoRA2024.08 | 82.86 | |
| LoRA-FALoRA Rank (r)=82024.08 | 82.79 | |
| KG-SFTBackbone=Gemma2 9B, Category=SFT-based2026.01 | 82.73 | |
| LoRALoRA Rank (r)=322024.08 | 82.36 | |
| Full FTFine-tuning protocol=full parameter fine-tuning2024.08 | 81.92 | |
| Full FTFine-tuning Strategy=Full Fine-Tuning2024.08 | 81.92 | |
| AugGPTBackbone=Qwen2.5 32B, Category=Augmented-based2026.01 | 81.89 | |
| MeanLearnBackbone=Qwen2.5 32B, Category=SFT-based2026.01 | 81.82 | |
| GraphRAGBackbone=Gemma2 9B, Category=Retrieval-based2026.01 | 81.69 | |
| LoRALoRA Rank (r)=162024.08 | 81.63 | |
| FlexoraBackbone=Llama-7B2024.08 | 81.62 | |
| STaRBackbone=Gemma2 9B, Category=Augmented-based2026.01 | 81.55 | |
| Instruct ModelBackbone=Meta-Llama-3-8B-Instruct, Model variant=Instruct2024.08 | 81.36 | |
| StructGPTBackbone=Gemma2 9B, Category=Retrieval-based2026.01 | 81.27 | |
| SDFTBackbone=Gemma2 9B, Category=SFT-based2026.01 | 81.2 | |
| MeanLearnBackbone=Gemma2 9B, Category=SFT-based2026.01 | 81.2 | |
| SFTBackbone=Gemma2 9B, Category=SFT-based2026.01 | 80.78 | |
| GPT3MixBackbone=Qwen2.5 32B, Category=Augmented-based2026.01 | 80.77 | |
| SDFTBackbone=Qwen2.5 32B, Category=SFT-based2026.01 | 80.71 | |
| KG-SFTBackbone=Qwen2.5 32B, Category=SFT-based2026.01 | 80.43 | |
| STaRBackbone=Qwen2.5 32B, Category=Augmented-based2026.01 | 80.43 | |
| LoRABackbone=Yi-6B2024.08 | 80.02 | |
| KALEBackbone=Orca2 7B, Category=Augmented-based2026.01 | 80.02 | |
| DMTBackbone=Qwen2.5 32B, Category=SFT-based2026.01 | 80.01 | |
| TOGBackbone=Gemma2 9B, Category=Retrieval-based2026.01 | 79.53 | |
| SFTBackbone=Qwen2.5 32B, Category=SFT-based2026.01 | 79.39 | |
| LoRABackbone=Llama2-7B2024.08 | 79.32 | |
| CoTBackbone=Gemma2 9B, Category=Prompt-based2026.01 | 79.32 | |
| FlexoraBackbone=Chatglm3-6B2024.08 | 79.18 | |
| MeanLearnBackbone=Orca2 7B, Category=SFT-based2026.01 | 78.76 | |
| VanillaBackbone=Gemma2 9B, Category=Prompt-based2026.01 | 78.62 | |
| AugGPTBackbone=Orca2 7B, Category=Augmented-based2026.01 | 78.55 | |
| StructGPTBackbone=Orca2 7B, Category=Retrieval-based2026.01 | 78.41 | |
| TOGBackbone=Qwen2.5 32B, Category=Retrieval-based2026.01 | 78.34 | |
| LoRABackbone=Xuan Yuan-6B2024.08 | 78.04 | |
| StructGPTBackbone=Qwen2.5 32B, Category=Retrieval-based2026.01 | 77.92 | |
| CoTBackbone=Qwen2.5 32B, Category=Prompt-based2026.01 | 77.64 | |
| GPT3MixBackbone=Orca2 7B, Category=Augmented-based2026.01 | 77.51 | |
| GraphRAGBackbone=Qwen2.5 32B, Category=Retrieval-based2026.01 | 77.37 | |
| LoRA-dropLoRA Rank (r)=82024.08 | 77.3 | |
| DMTBackbone=Orca2 7B, Category=SFT-based2026.01 | 77.3 | |
| STaRBackbone=Orca2 7B, Category=Augmented-based2026.01 | 77.3 | |
| VanillaBackbone=Qwen2.5 32B, Category=Prompt-based2026.01 | 76.95 | |
| KG-SFTBackbone=Orca2 7B, Category=SFT-based2026.01 | 76.9 | |
| SFTBackbone=Orca2 7B, Category=SFT-based2026.01 | 76.88 | |
| KALEBackbone=OLMOE 7B, Category=Augmented-based2026.01 | 75.84 | |
| CoTBackbone=Orca2 7B, Category=Prompt-based2026.01 | 75.84 | |
| GraphRAGBackbone=Orca2 7B, Category=Retrieval-based2026.01 | 75.77 | |
| LoRABackbone=Llama-7B2024.08 | 75.69 | |
| VanillaBackbone=Orca2 7B, Category=Prompt-based2026.01 | 75.49 | |
| GPT3MixBackbone=OLMOE 7B, Category=Augmented-based2026.01 | 75.48 | |
| SDFTBackbone=Orca2 7B, Category=SFT-based2026.01 | 75.14 | |
| Gopherevaluation_mode=Few-Shot2022.03 | 75.1 | |
| KALEBackbone=LlaMA3 8B, Category=Augmented-based2026.01 | 74.12 | |
| TOGBackbone=Orca2 7B, Category=Retrieval-based2026.01 | 74.09 |