List your company
ResearchFormerly WizWand

Language Modeling on Tulu3 tydiqa (Evaluation)

1.764PerplexityAdamW-influence (online)
1.747561.858531.96952.08047May 12, 2026
Updated 5mo ago

Evaluation results

MethodLinks
AdamW-influence (online)Backbone=Llama-3.2-1B, Fine-tuning regime=LoRA, Selected Ratio=0.52026.051.764
SGD-influence (online)Backbone=Llama-3.2-1B, Fine-tuning regime=LoRA, Selected Ratio=0.52026.051.81
AdamW-influence (online)Backbone=Llama-3.2-1B, Fine-tuning regime=LoRA, Selected Ratio=0.82026.051.859
AdamW-influence (offline)Backbone=Llama-3.2-1B, Fine-tuning regime=LoRA, Selected Ratio=0.52026.051.868
SGD-influence (online)Backbone=Llama-3.2-1B, Fine-tuning regime=LoRA, Selected Ratio=0.82026.051.872
AdamW-influence (offline)Backbone=Llama-3.2-1B, Fine-tuning regime=LoRA, Selected Ratio=0.82026.051.872
AdamW-influence (online)Backbone=Llama-3.2-1B, Fine-tuning regime=Full, Selected Ratio=0.52026.051.886
TracIN (offline)Backbone=Llama-3.2-1B, Fine-tuning regime=LoRA, Selected Ratio=0.82026.051.91
AdamW-influence (online)Backbone=Llama-3.2-1B, Fine-tuning regime=Full, Selected Ratio=0.82026.051.933
AdamW-influence (offline)Backbone=Llama-3.2-1B, Fine-tuning regime=Full, Selected Ratio=0.82026.051.939
TracIN (offline)Backbone=Llama-3.2-1B, Fine-tuning regime=LoRA, Selected Ratio=0.52026.051.955
AdamW-influence (offline)Backbone=Llama-3.2-1B, Fine-tuning regime=Full, Selected Ratio=0.52026.051.957
SGD-influence (online)Backbone=Llama-3.2-1B, Fine-tuning regime=Full, Selected Ratio=0.52026.052.029
SGD-influence (online)Backbone=Llama-3.2-1B, Fine-tuning regime=Full, Selected Ratio=0.82026.052.055
TracIN (offline)Backbone=Llama-3.2-1B, Fine-tuning regime=Full, Selected Ratio=0.52026.052.152
TracIN (offline)Backbone=Llama-3.2-1B, Fine-tuning regime=Full, Selected Ratio=0.82026.052.175