Multi-Robot Task Allocation on LEGO-MRTA (test)
59.78BLEU-4Qwen
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| QwenPEFT (LoRA)=with2024.05 | 59.78 | 66.95 | 55.95 | 64.26 | 77.14 | 71.17 | |
| BlueLMPEFT (LoRA)=with2024.05 | 55.69 | 63.52 | 51.58 | 60.35 | 82.22 | 68.08 | |
| Vicuna1.5PEFT (LoRA)=with2024.05 | 54.71 | 62.64 | 50.47 | 59.36 | 78.12 | 66.79 | |
| MistralPEFT (LoRA)=with2024.05 | 54.17 | 62.07 | 49.4 | 58.62 | 78.2 | 66.65 | |
| BLOOMPEFT (LoRA)=with2024.05 | 54.07 | 61.91 | 49.52 | 58.63 | 77.86 | 64.61 | |
| XVERSEPEFT (LoRA)=with2024.05 | 53.55 | 61.54 | 49.77 | 58.03 | 83.97 | 71.1 | |
| Llama2-ChatPEFT (LoRA)=with2024.05 | 30.53 | 40.65 | 25.48 | 32.91 | 55.73 | 55.51 | |
| MistralPEFT (LoRA)=without2024.05 | 25.87 | 33.32 | 17.99 | 26.32 | 49.62 | 54.8 | |
| QwenPEFT (LoRA)=without2024.05 | 24.82 | 31.44 | 17.69 | 25.66 | 45.71 | 54.96 | |
| BlueLMPEFT (LoRA)=without2024.05 | 22.72 | 30.4 | 14.98 | 23.76 | 48.15 | 47.51 | |
| XVERSEPEFT (LoRA)=without2024.05 | 22.42 | 28.45 | 14.31 | 22.39 | 49.62 | 57.53 | |
| OpenChat3.5PEFT (LoRA)=without2024.05 | 22 | 29.7 | 15.69 | 22.5 | 51.97 | 58.19 | |
| Vicuna1.5PEFT (LoRA)=without2024.05 | 14.11 | 29.3 | 14.21 | 15.48 | 52.67 | 69.69 | |
| FalconPEFT (LoRA)=with2024.05 | 10.3 | 11.33 | 7.41 | 10.2 | 17.65 | 10.81 | |
| Llama2-ChatPEFT (LoRA)=without2024.05 | 10.23 | 18.59 | 7.41 | 10.59 | 21.37 | 47.2 | |
| OpenChat3.5PEFT (LoRA)=with2024.05 | 6.94 | 34.51 | 23.69 | 11.36 | 74.02 | 81.9 | |
| FalconPEFT (LoRA)=without2024.05 | 5.38 | 8.68 | 4.25 | 5.11 | 22.79 | 12.66 | |
| BLOOMPEFT (LoRA)=without2024.05 | 2.88 | 20.49 | 6.5 | 3.78 | 49.62 | 26.3 |