List your company

Average Time Cost on MT-Bench benign prompts

41.56Average Time CostNo defense
38.097661.468884.84108.2112Feb 26, 2024

Evaluation results

MethodLinks
No defenseTarget Model=Vicuna-13B2024.0241.56
ParaphraseTarget Model=Vicuna-13B2024.0245.42
Backtranslation w/ early terminationTarget Model=Vicuna-13B, early termination=true2024.0249.86
Response CheckTarget Model=Vicuna-13B2024.0265.84
Backtranslation w/o early terminationTarget Model=Vicuna-13B, early termination=false2024.0286.91
SmoothLLMTarget Model=Vicuna-13B2024.02128.12