List your company
ResearchFormerly WizWand

Question Answering on TruthfulQA (BLEU)

49BLEU ScoreOriginal
19.8827.443542.56Nov 14, 2024
Updated 5mo ago

Evaluation results

MethodLinks
OriginalBackbone Model=Llama-3.1-8B, Compression Rate=None2024.1149
SVD-LLM V2Backbone Model=Llama-3.1-8B, Compression Rate=20%2024.1146
FiPSBackbone Model=Llama-3.1-8B, Compression Rate=20%2024.1146
SVD-LLMBackbone Model=Llama-3.1-8B, Compression Rate=20%2024.1145
ASVDBackbone Model=Llama-3.1-8B, Compression Rate=20%2024.1137
OriginalBackbone Model=Llama-7B, Compression Rate=None2024.1130
SVD-LLM V2Backbone Model=Llama-7B, Compression Rate=20%2024.1127
FiPSBackbone Model=Llama-7B, Compression Rate=20%2024.1127
SVD-LLMBackbone Model=Llama-7B, Compression Rate=20%2024.1124
ASVDBackbone Model=Llama-7B, Compression Rate=20%2024.1121