List your company
ResearchFormerly WizWand

General Language Proficiency on Aggregated (GSM8K, TruthfulQA, TriviaQA, CNN/DM, MMLU)

48.6Average ScoreLoRA Tuning
24.399230.682136.96543.2479Jun 17, 2024
Updated 8mo ago

Evaluation results

MethodLinks
LoRA TuningModel Size=13B, Transfer Source=N/A2024.0648.6
Full Fine-tuningModel Size=13B, Transfer Source=N/A2024.0647.79
OursModel Size=13B, Transfer Source=7B2024.0646.09
Proxy TuningModel Size=13B, Transfer Source=7B2024.0644.43
Full Fine-tuningModel Size=13B, Transfer Source=7B2024.0644.13
OursModel Size=13B, Transfer Source=1.1B2024.0634.86
Proxy TuningModel Size=13B, Transfer Source=1.1B2024.0631.74
Base ModelModel Size=13B, Transfer Source=N/A2024.0629.93
Full Fine-tuningModel Size=13B, Transfer Source=1.1B2024.0625.33