Representation Injection Performance on Llama2-7B evaluation scenarios (test)
85.16AccuracyLTV
Evaluation Results
| Method | Links | |
|---|---|---|
| LTVScenario=5) ICL prompts2025.09 | 85.16 | |
| LTVScenario=2) More Pos., Injection Position (P)={-5,...,-1}, Injection Layers (L)={16}2025.09 | 84.6 | |
| LTVScenario=Baseline, Injection Position (P)={-1}, Injection Layers (L)={16}2025.09 | 82.54 | |
| LTVScenario=3) More layers, Injection Position (P)={-1}, Injection Layers (L)={0,4,8,...}2025.09 | 82.24 | |
| LTVScenario=1) Diff. Pos., Injection Position (P)={4}, Injection Layers (L)={16}2025.09 | 79.34 | |
| FVScenario=5) ICL prompts2025.09 | 73.23 | |
| Vanilla TVScenario=5) ICL prompts2025.09 | 52.82 | |
| FVScenario=Baseline, Injection Position (P)={-1}, Injection Layers (L)={16}2025.09 | 51.81 | |
| LTVScenario=4) More layers & Pos., Injection Position (P)={-5,...}, Injection Layers (L)={0,4,...}2025.09 | 51.6 | |
| FVScenario=3) More layers, Injection Position (P)={-1}, Injection Layers (L)={0,4,8,...}2025.09 | 47.14 | |
| Vanilla TVScenario=Baseline, Injection Position (P)={-1}, Injection Layers (L)={16}2025.09 | 38.26 | |
| FVScenario=2) More Pos., Injection Position (P)={-5,...,-1}, Injection Layers (L)={16}2025.09 | 28.6 | |
| FVScenario=4) More layers & Pos., Injection Position (P)={-5,...}, Injection Layers (L)={0,4,...}2025.09 | 20.44 | |
| Vanilla TVScenario=3) More layers, Injection Position (P)={-1}, Injection Layers (L)={0,4,8,...}2025.09 | 18.85 | |
| Vanilla TVScenario=2) More Pos., Injection Position (P)={-5,...,-1}, Injection Layers (L)={16}2025.09 | 14.16 | |
| Vanilla TVScenario=4) More layers & Pos., Injection Position (P)={-5,...}, Injection Layers (L)={0,4,...}2025.09 | 13.3 | |
| Vanilla TVScenario=1) Diff. Pos., Injection Position (P)={4}, Injection Layers (L)={16}2025.09 | 1.96 | |
| FVScenario=1) Diff. Pos., Injection Position (P)={4}, Injection Layers (L)={16}2025.09 | 1.4 |