LLM Alignment on SHP
89.3DiversityRE-CONTROL + Prompting
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RE-CONTROL + PromptingBackbone=Llama3-8B, Inference time (hour)=0.242024.06 | 89.3 | 60.5 | -4.14 | 77 | |
| PromptingBackbone=Llama3-8B, Inference time (hour)=0.132024.06 | 89.1 | 60.5 | -4.45 | 59.6 | |
| RE-CONTROLBackbone=Llama3-8B, Inference time (hour)=0.212024.06 | 88.3 | 66.9 | -4.39 | 71 | |
| BaseBackbone=Llama3-8B, Inference time (hour)=0.132024.06 | 87.8 | 67.2 | -4.64 | 56.3 | |
| Static REBackbone=Llama3-8B, Inference time (hour)=0.152024.06 | 87.5 | 67.4 | -4.49 | 57 | |
| CD prefix + PromptingBackbone=Llama3-8B, Inference time (hour)=12.742024.06 | 87.2 | 60.3 | -4.25 | 68 | |
| CD prefixBackbone=Llama3-8B, Inference time (hour)=12.162024.06 | 86.2 | 68.5 | -4.41 | 64 | |
| RE-CONTROL + PromptingBackbone=Vicuna-7B, Inference time (hour)=0.232024.06 | 85.4 | 57.1 | -4.63 | 63.6 | |
| RE-CONTROLBackbone=Vicuna-7B, Inference time (hour)=0.212024.06 | 84.9 | 65.2 | -5.38 | 58 | |
| Static REBackbone=Vicuna-7B, Inference time (hour)=0.152024.06 | 84.8 | 65.2 | -5.65 | 49.3 | |
| PromptingBackbone=Vicuna-7B, Inference time (hour)=0.132024.06 | 84.7 | 57 | -4.83 | 56.6 | |
| BaseBackbone=Vicuna-7B, Inference time (hour)=0.132024.06 | 84.5 | 65.7 | -5.68 | 40.3 | |
| CDBackbone=Vicuna-7B, Inference time (hour)=22.162024.06 | 84.5 | 65.5 | -5.65 | 55.6 | |
| CD prefix + PromptingBackbone=Vicuna-7B, Inference time (hour)=14.322024.06 | 84.2 | 57.4 | -4.88 | 56.3 | |
| CD prefixBackbone=Vicuna-7B, Inference time (hour)=14.152024.06 | 83.8 | 66 | -5.62 | 41 |