Helpfulness alignment on HHH alignment
98.6Win Rate (WR)AMBS
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| AMBSBackbone=DeepSeek-7B, Throughput (Tk)=208, Memory Usage (Me)=22, Compute Cost (GP)=72025.09 | 98.6 | 25.2 | 95.5 | 56.3 | |
| AMBSBackbone=LLaMA-2-7B, Throughput (Tk)=189, Memory Usage (Me)=25, Compute Cost (GP)=92025.09 | 98 | 27.3 | 98.9 | 56.5 | |
| AlignXBackbone=DeepSeek-7B, Throughput (Tk)=176, Memory Usage (Me)=28, Compute Cost (GP)=112025.09 | 97.1 | 27.9 | 93.2 | 54.1 | |
| TrinityXBackbone=LLaMA-2-7B, Throughput (Tk)=166, Memory Usage (Me)=29, Compute Cost (GP)=122025.09 | 96.7 | 30 | 98.6 | 55.1 | |
| AMBSBackbone=Mistral-7B, Throughput (Tk)=195, Memory Usage (Me)=24, Compute Cost (GP)=82025.09 | 95.3 | 26.5 | 90.1 | 52.9 | |
| AMBSBackbone=Gemma-7B, Throughput (Tk)=202, Memory Usage (Me)=23, Compute Cost (GP)=72025.09 | 91.5 | 15.3 | 87.2 | 54.4 | |
| TrinityXBackbone=Mistral-7B, Throughput (Tk)=172, Memory Usage (Me)=28, Compute Cost (GP)=112025.09 | 91.2 | 31.1 | 89.4 | 49.8 | |
| AlignXBackbone=LLaMA-2-7B, Throughput (Tk)=158, Memory Usage (Me)=31, Compute Cost (GP)=132025.09 | 91.1 | 29.3 | 91.1 | 51.3 | |
| TrinityXBackbone=DeepSeek-7B, Throughput (Tk)=184, Memory Usage (Me)=26, Compute Cost (GP)=102025.09 | 90 | 30.8 | 91.3 | 50.1 | |
| AMBSBackbone=DeepSeek-7B, Throughput (Tk)=221, Memory Usage (Me)=22, Compute Cost (GP)=52025.09 | 89.9 | 35.6 | 47.5 | 33.9 | |
| AlignXBackbone=Mistral-7B, Throughput (Tk)=164, Memory Usage (Me)=30, Compute Cost (GP)=122025.09 | 88.4 | 28.9 | 87.8 | 49.7 | |
| TrinityXBackbone=Gemma-7B, Throughput (Tk)=178, Memory Usage (Me)=27, Compute Cost (GP)=102025.09 | 88.3 | 32.4 | 85.6 | 47.1 | |
| AlignXBackbone=Gemma-7B, Throughput (Tk)=170, Memory Usage (Me)=29, Compute Cost (GP)=112025.09 | 85.6 | 30.1 | 84.6 | 46.7 | |
| H3FusionBackbone=LLaMA-2-7B, Throughput (Tk)=170, Memory Usage (Me)=28, Compute Cost (GP)=112025.09 | 80 | 28.8 | 41.7 | 30.9 | |
| AMBSBackbone=Mistral-7B, Throughput (Tk)=215, Memory Usage (Me)=24, Compute Cost (GP)=52025.09 | 68.3 | 37.1 | 26.1 | 19.1 | |
| H3FusionBackbone=Mistral-7B, Throughput (Tk)=176, Memory Usage (Me)=27, Compute Cost (GP)=102025.09 | 62.8 | 30.7 | 29.8 | 20.6 | |
| MARL-FocalBackbone=Mistral-7B, Throughput (Tk)=168, Memory Usage (Me)=29, Compute Cost (GP)=112025.09 | 59.7 | 31.6 | 28.1 | 18.7 | |
| RAHFBackbone=Mistral-7B, Throughput (Tk)=187, Memory Usage (Me)=25, Compute Cost (GP)=82025.09 | 57.9 | 41.5 | 24.7 | 13.7 | |
| SteeringBackbone=Mistral-7B, Throughput (Tk)=207, Memory Usage (Me)=29, Compute Cost (GP)=62025.09 | 56.7 | 38.6 | 25 | 14.4 | |
| DExpertsBackbone=Mistral-7B, Throughput (Tk)=174, Memory Usage (Me)=26, Compute Cost (GP)=92025.09 | 55.4 | 38.2 | 24.1 | 13.8 | |
| PPLMBackbone=Mistral-7B, Throughput (Tk)=151, Memory Usage (Me)=28, Compute Cost (GP)=102025.09 | 53.7 | 39.7 | 23.6 | 12.5 | |
| AMBSBackbone=LLaMA-2-7B, Throughput (Tk)=209, Memory Usage (Me)=21, Compute Cost (GP)=92025.09 | 53 | 30 | 88.2 | 37 | |
| BaseBackbone=Mistral-7B, Throughput (Tk)=218, Memory Usage (Me)=22, Compute Cost (GP)=52025.09 | 52.1 | 44.1 | 22.1 | 10 | |
| AMBSBackbone=Gemma-7B, Throughput (Tk)=214, Memory Usage (Me)=23, Compute Cost (GP)=42025.09 | 51.5 | 25.8 | 17.1 | 14.2 | |
| MARL-FocalBackbone=LLaMA-2-7B, Throughput (Tk)=162, Memory Usage (Me)=30, Compute Cost (GP)=122025.09 | 51.3 | 29.8 | 26.4 | 16 | |
| H3FusionBackbone=Gemma-7B, Throughput (Tk)=182, Memory Usage (Me)=26, Compute Cost (GP)=92025.09 | 50.8 | 21.9 | 20.2 | 16.4 | |
| RAHFBackbone=LLaMA-2-7B, Throughput (Tk)=181, Memory Usage (Me)=26, Compute Cost (GP)=122025.09 | 48.7 | 39.6 | 87.4 | 32.2 | |
| MARL-FocalBackbone=Gemma-7B, Throughput (Tk)=174, Memory Usage (Me)=28, Compute Cost (GP)=102025.09 | 47.9 | 22.4 | 18.9 | 14.8 | |
| SteeringBackbone=LLaMA-2-7B, Throughput (Tk)=201, Memory Usage (Me)=22, Compute Cost (GP)=172025.09 | 46.9 | 36.1 | 22.7 | 11.2 | |
| H3FusionBackbone=DeepSeek-7B, Throughput (Tk)=188, Memory Usage (Me)=25, Compute Cost (GP)=92025.09 | 46.5 | 29.6 | 49.9 | 22.3 | |
| DExpertsBackbone=LLaMA-2-7B, Throughput (Tk)=168, Memory Usage (Me)=27, Compute Cost (GP)=102025.09 | 45.6 | 35.4 | 22.1 | 10.8 | |
| RAHFBackbone=Gemma-7B, Throughput (Tk)=193, Memory Usage (Me)=24, Compute Cost (GP)=72025.09 | 43.9 | 28.6 | 16.9 | 10.7 | |
| MARL-FocalBackbone=DeepSeek-7B, Throughput (Tk)=180, Memory Usage (Me)=27, Compute Cost (GP)=102025.09 | 43.6 | 30.2 | 48.7 | 20.7 | |
| SteeringBackbone=Gemma-7B, Throughput (Tk)=213, Memory Usage (Me)=29, Compute Cost (GP)=62025.09 | 43.3 | 26.7 | 16.8 | 11.1 | |
| DExpertsBackbone=Gemma-7B, Throughput (Tk)=179, Memory Usage (Me)=25, Compute Cost (GP)=82025.09 | 42.3 | 26.3 | 16.4 | 10.8 | |
| PPLMBackbone=LLaMA-2-7B, Throughput (Tk)=145, Memory Usage (Me)=29, Compute Cost (GP)=112025.09 | 42.2 | 37.1 | 20.8 | 8.6 | |
| PPLMBackbone=Gemma-7B, Throughput (Tk)=157, Memory Usage (Me)=27, Compute Cost (GP)=92025.09 | 39.9 | 27 | 15.7 | 9.5 | |
| SteeringBackbone=DeepSeek-7B, Throughput (Tk)=219, Memory Usage (Me)=25, Compute Cost (GP)=62025.09 | 39.4 | 38.1 | 45.3 | 15.5 | |
| RAHFBackbone=DeepSeek-7B, Throughput (Tk)=199, Memory Usage (Me)=23, Compute Cost (GP)=72025.09 | 38.4 | 40.3 | 46.7 | 14.9 | |
| DExpertsBackbone=DeepSeek-7B, Throughput (Tk)=185, Memory Usage (Me)=24, Compute Cost (GP)=82025.09 | 38 | 37.3 | 44.9 | 15.2 | |
| BaseBackbone=Gemma-7B, Throughput (Tk)=224, Memory Usage (Me)=21, Compute Cost (GP)=52025.09 | 37.2 | 27.4 | 14.6 | 8.1 | |
| PPLMBackbone=DeepSeek-7B, Throughput (Tk)=163, Memory Usage (Me)=26, Compute Cost (GP)=92025.09 | 35.8 | 39.1 | 44.6 | 13.8 | |
| BaseBackbone=DeepSeek-7B, Throughput (Tk)=230, Memory Usage (Me)=20, Compute Cost (GP)=42025.09 | 21.7 | 42 | 45 | 8.2 | |
| BaseBackbone=LLaMA-2-7B, Throughput (Tk)=212, Memory Usage (Me)=23, Compute Cost (GP)=62025.09 | 12.5 | 42 | 19.3 | -3.4 |