Instruction Following on IFEval (Improvement score)
74Improvement ScoreTwo-neuron sign inversion + amplification
Evaluation Results
| Method | Links | |
|---|---|---|
| Two-neuron sign inversion + amplificationModel=E2B2026.06 | 74 | |
| StreamingLLMBackbone=Llama3, Eviction Strategy=fair, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 16.57 | |
| StreamingLLMBackbone=Qwen2, Eviction Strategy=fair, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 15.78 | |
| StreamingLLMBackbone=Llama3, Eviction Strategy=whitelist, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 13.58 | |
| StreamingLLMBackbone=Qwen2, Eviction Strategy=whitelist, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 12.28 | |
| K-NormBackbone=Qwen2, Eviction Strategy=whitelist, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 10.24 | |
| H2OBackbone=Qwen2, Eviction Strategy=whitelist, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 10.04 | |
| SnapKVBackbone=Qwen2, Eviction Strategy=whitelist, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 9.32 | |
| TOVABackbone=Qwen2, Eviction Strategy=whitelist, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 5.18 | |
| SnapKVBackbone=Llama3, Eviction Strategy=whitelist, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 3.39 | |
| SnapKVBackbone=Llama3, Eviction Strategy=fair, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 3.38 | |
| SnapKVBackbone=Qwen2, Eviction Strategy=fair, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 2.16 | |
| K-NormBackbone=Llama3, Eviction Strategy=fair, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 2.01 | |
| TOVABackbone=Qwen2, Eviction Strategy=fair, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 1.88 | |
| TOVABackbone=Llama3, Eviction Strategy=whitelist, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 1.81 | |
| TOVABackbone=Llama3, Eviction Strategy=fair, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 1.3 | |
| H2OBackbone=Llama3, Eviction Strategy=whitelist, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 1.11 | |
| H2OBackbone=Qwen2, Eviction Strategy=fair, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 0.88 | |
| K-NormBackbone=Qwen2, Eviction Strategy=fair, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 0.68 | |
| H2OBackbone=Llama3, Eviction Strategy=fair, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 0.28 | |
| K-NormBackbone=Llama3, Eviction Strategy=whitelist, Compression Ratios={0.1, 0.2, ..., 0.7}2025.09 | 0.19 |