Multiple-choice question answering on Model-Written Evaluations (MWE) MCQ
88.8Wealth AccSVF
Evaluation results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SVFBackbone=Qwen3-14b2026.02 | 88.8 | 80.2 | 85.4 | 77 | 95.6 | 94 | 73.2 | 75.8 | 96.8 | 92.8 | 75.2 | 61.2 | 81 | 79.6 | 85.1 | 80.1 | |
| SVFBackbone=Llama-2-7b-Chat-hf2026.02 | 86.8 | 87.6 | 83.8 | 77.6 | 96.8 | 96.8 | 82.6 | 78.6 | 96.2 | 88.4 | 74 | 58.8 | 90.2 | 87.6 | 87.2 | 82.2 | |
| REDBackbone=Qwen3-14b2026.02 | 83.4 | 72.2 | 88.2 | 74.8 | 85.4 | 82.2 | 37.2 | 69.8 | 99.2 | 86.6 | 62.6 | 52.2 | 31 | 50.4 | 69.6 | 69.7 | |
| REDBackbone=Llama-2-7b-Chat-hf2026.02 | 81.8 | 73.2 | 77.4 | 75.6 | 92.4 | 50 | 69.4 | 72 | 98.6 | 49.8 | 41.2 | 49.8 | 58.6 | 49.8 | 74.2 | 60 | |
| BiPOBackbone=Qwen3-14b2026.02 | 79.4 | 63.8 | 84.8 | 66 | 81.6 | 78.4 | 42.4 | 40.2 | 96.8 | 83.4 | 67 | 56.4 | 34.4 | 38 | 69.5 | 60.9 | |
| CAA(m)Backbone=Qwen3-14b, Variant=multi-layer2026.02 | 78.2 | 44.6 | 84.2 | 52.6 | 74.4 | 76.6 | 39.4 | 33.2 | 95.6 | 80.2 | 62.6 | 42 | 33.4 | 36.2 | 66.8 | 52.2 | |
| CAA(s)Backbone=Qwen3-14b, Variant=single-layer2026.02 | 76.8 | 42.6 | 87.6 | 53 | 70.2 | 72.6 | 39.2 | 32.8 | 96.4 | 76.6 | 59.6 | 41 | 34 | 36 | 66.3 | 50.7 | |
| ICVBackbone=Qwen3-14b2026.02 | 74.6 | 46.8 | 78.8 | 49.8 | 77.4 | 73.8 | 38.6 | 40.4 | 94.8 | 70.2 | 63.4 | 47.8 | 34.6 | 38.8 | 66 | 52.5 | |
| BaseBackbone=Qwen3-14b2026.02 | 69.2 | — | 75.6 | — | 52.6 | — | 34.4 | — | 94.4 | — | 59.2 | — | 33.2 | — | 59.8 | — | |
| CAA(m)Backbone=Llama-2-7b-Chat-hf, Variant=multi-layer2026.02 | 65.2 | 49.6 | 64.4 | 64.6 | 74.8 | 50.4 | 65.4 | 65.8 | 79.8 | 49.8 | 50.4 | 50.6 | 49.8 | 49.8 | 64.3 | 54.4 | |
| CAA(s)Backbone=Llama-2-7b-Chat-hf, Variant=single-layer2026.02 | 64 | 49.6 | 64.4 | 64.6 | 74.2 | 48.2 | 52.6 | 62.2 | 78.4 | 49.8 | 49.8 | 49.8 | 50.2 | 50.2 | 61.9 | 53.5 | |
| ICVBackbone=Llama-2-7b-Chat-hf2026.02 | 62.4 | 42 | 60 | 46.4 | 59.8 | 48.6 | 47.8 | 44.6 | 64.6 | 50.6 | 50.2 | 50.6 | 49.8 | 49.8 | 56.4 | 47.5 | |
| BiPOBackbone=Llama-2-7b-Chat-hf2026.02 | 62.2 | 67.4 | 68.8 | 68.4 | 90.4 | 50 | 45.8 | 68.4 | 52.2 | 70.2 | 49.8 | 66.4 | 49.8 | 49.8 | 59.9 | 62.9 | |
| BaseBackbone=Llama-2-7b-Chat-hf2026.02 | 59.4 | — | 58 | — | 56.6 | — | 43.6 | — | 48.2 | — | 48.2 | — | 50.2 | — | 52 | — |