Zero-shot QA and Language Modeling on Wiki, BoolQ, RTE, ARC-C, TinyM
13.68Wiki ScoreLoRA
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LoRABackbone=Qwen, Evaluation Protocol=Zero-shot2025.09 | 13.68 | 49.33 | 54.26 | 81.06 | 58 | 60.66 | |
| RLEditBackbone=Llama, Evaluation Protocol=Zero-shot2025.09 | 11.69 | 63.39 | 68.19 | 69.2 | 49 | 62.45 | |
| LoRABackbone=Llama, Evaluation Protocol=Zero-shot2025.09 | 11.63 | 58.5 | 62.29 | 64.76 | 48 | 58.39 | |
| MCEditRL (Ours)Backbone=Llama, Evaluation Protocol=Zero-shot2025.09 | 11.11 | 65.66 | 70.28 | 69.28 | 52 | 64.31 | |
| Pre-editedBackbone=Llama, Evaluation Protocol=Zero-shot2025.09 | 11.05 | 66.54 | 69.16 | 69.37 | 53 | 64.52 | |
| AlphaEditBackbone=Llama, Evaluation Protocol=Zero-shot2025.09 | 11.05 | 65.69 | 69.48 | 69.03 | 52 | 64.05 | |
| FPEditBackbone=Llama, Evaluation Protocol=Zero-shot2025.09 | 11.05 | 66.02 | 70.2 | 69.45 | 52 | 64.42 | |
| MCEditAlpha (Ours)Backbone=Llama, Evaluation Protocol=Zero-shot2025.09 | 11.05 | 66.15 | 69.84 | 69.28 | 54 | 64.82 | |
| RLEditBackbone=Qwen, Evaluation Protocol=Zero-shot2025.09 | 10.35 | 80.86 | 76.79 | 83.96 | 58 | 74.9 | |
| MCEditRL (Ours)Backbone=Qwen, Evaluation Protocol=Zero-shot2025.09 | 10.2 | 80.28 | 77.31 | 84.22 | 59 | 75.2 | |
| AlphaEditBackbone=Qwen, Evaluation Protocol=Zero-shot2025.09 | 9.72 | 80.12 | 77.15 | 84.56 | 59 | 75.21 | |
| FPEditBackbone=Qwen, Evaluation Protocol=Zero-shot2025.09 | 9.72 | 80.12 | 77.03 | 84.81 | 60 | 75.49 | |
| MCEditAlpha (Ours)Backbone=Qwen, Evaluation Protocol=Zero-shot2025.09 | 9.72 | 80.18 | 77.11 | 84.3 | 60 | 75.4 | |
| Pre-editedBackbone=Qwen, Evaluation Protocol=Zero-shot2025.09 | 9.71 | 80.18 | 76.83 | 84.73 | 59 | 75.18 | |
| LoRABackbone=Mistral, Evaluation Protocol=Zero-shot2025.09 | 7.12 | 69.27 | 65.26 | 62.37 | 49 | 61.47 | |
| RLEditBackbone=Mistral, Evaluation Protocol=Zero-shot2025.09 | 5.88 | 79.11 | 75.66 | 73.55 | 61 | 72.33 | |
| MCEditRL (Ours)Backbone=Mistral, Evaluation Protocol=Zero-shot2025.09 | 5.8 | 80.15 | 76.63 | 73.29 | 61 | 72.77 | |
| AlphaEditBackbone=Mistral, Evaluation Protocol=Zero-shot2025.09 | 5.5 | 78.81 | 76.83 | 74.32 | 62 | 72.99 | |
| FPEditBackbone=Mistral, Evaluation Protocol=Zero-shot2025.09 | 5.5 | 78.9 | 76.83 | 74.06 | 62 | 72.95 | |
| MCEditAlpha (Ours)Backbone=Mistral, Evaluation Protocol=Zero-shot2025.09 | 5.5 | 78.96 | 76.87 | 74.15 | 63 | 73.24 | |
| Pre-editedBackbone=Mistral, Evaluation Protocol=Zero-shot2025.09 | 5.49 | 78.81 | 76.79 | 74.32 | 64 | 73.48 |