List your company
ResearchFormerly WizWand

Language Modeling on Alpaca Cleaned (lower-level)

0.835Evaluation LossOnline (R = 10%, G = 5)
0.80361.015551.22751.43945Nov 26, 2025
Updated 4mo ago

Evaluation results

MethodLinks
Online (R = 10%, G = 5)Base LLM=LLAMA-8B, Sample ratio (R)=10%, Generations (G)=52025.110.835
Online (R = 10%, G = 1)Base LLM=LLAMA-8B, Sample ratio (R)=10%, Generations (G)=12025.110.857
Online (R = 5%, G = 1)Base LLM=LLAMA-8B, Sample ratio (R)=5%, Generations (G)=12025.110.887
LESSBase LLM=LLAMA-8B2025.110.892
Offline BDSBase LLM=LLAMA-8B2025.110.893
DSIRBase LLM=LLAMA-8B2025.110.896
Random selectionBase LLM=LLAMA-8B2025.110.901
Direct mixing (ρ = 1)Base LLM=LLAMA-8B2025.110.908
Direct mixing (ρ = 0.5)Base LLM=LLAMA-8B2025.110.908
Online (R = 10%, G = 5)Base LLM=PYTHIA-1B, Sample ratio (R)=10%, Generations (G)=52025.111.37
Online (R = 10%, G = 1)Base LLM=PYTHIA-1B, Sample ratio (R)=10%, Generations (G)=12025.111.41
Online (R = 5%, G = 1)Base LLM=PYTHIA-1B, Sample ratio (R)=5%, Generations (G)=12025.111.46
LESSBase LLM=PYTHIA-1B2025.111.49
Offline BDSBase LLM=PYTHIA-1B2025.111.54
DSIRBase LLM=PYTHIA-1B2025.111.57
Direct mixing (ρ = 0.5)Base LLM=PYTHIA-1B2025.111.58
Random selectionBase LLM=PYTHIA-1B2025.111.61
Direct mixing (ρ = 1)Base LLM=PYTHIA-1B2025.111.62