List your company
ResearchFormerly WizWand

Task Representation Accuracy on Task Vector Evaluation Suite Llama2-13B (test)

87.69AccuracyLTV
-2.238821.108144.45567.8019Sep 29, 2025
Updated 6mo ago

Evaluation results

MethodLinks
LTVInjection Scenario=2) More Pos., Injection Position (P)={-5,...,-1}2025.0987.69
LTVInjection Scenario=5) ICL prompts2025.0984.99
LTVInjection Scenario=3) More layers, Injection Layer (L)={0,4,8,...}2025.0982.25
LTVInjection Scenario=Baseline, Injection Position (P)={-1}, Injection Layer (L)={20}2025.0980.33
FVInjection Scenario=5) ICL prompts2025.0977.51
LTVInjection Scenario=1) Diff. Pos., Injection Position (P)={4}2025.0971.53
LTVInjection Scenario=4) More layers & Pos., Injection Position (P)={-5,...}, Injection Layer (L)={0,4,...}2025.0951.46
Vanilla TVInjection Scenario=5) ICL prompts2025.0943.84
FVInjection Scenario=2) More Pos., Injection Position (P)={-5,...,-1}2025.0942.25
FVInjection Scenario=Baseline, Injection Position (P)={-1}, Injection Layer (L)={20}2025.0941.59
FVInjection Scenario=3) More layers, Injection Layer (L)={0,4,8,...}2025.0936.97
Vanilla TVInjection Scenario=Baseline, Injection Position (P)={-1}, Injection Layer (L)={20}2025.0927.67
FVInjection Scenario=4) More layers & Pos., Injection Position (P)={-5,...}, Injection Layer (L)={0,4,...}2025.0924.74
Vanilla TVInjection Scenario=3) More layers, Injection Layer (L)={0,4,8,...}2025.0920.46
Vanilla TVInjection Scenario=2) More Pos., Injection Position (P)={-5,...,-1}2025.0916.42
Vanilla TVInjection Scenario=4) More layers & Pos., Injection Position (P)={-5,...}, Injection Layer (L)={0,4,...}2025.0916.07
Vanilla TVInjection Scenario=1) Diff. Pos., Injection Position (P)={4}2025.091.84
FVInjection Scenario=1) Diff. Pos., Injection Position (P)={4}2025.091.22