Cooperative Planning on PARTNR Dialog
87Completion RateLLawCo
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LLawCoBackbone=LLaMA-3.1-70B2026.06 | 87 | 75 | 2,526.5 | 16.1 | 1.9 | |
| ReActBackbone=LLaMA-3.1-70B2026.06 | 86 | 73 | 3,295.2 | 15.2 | 0 | |
| CommPARTNRBackbone=LLaMA-3.1-70B2026.06 | 85 | 70 | 3,157.5 | 16.9 | 1.6 | |
| LLawCoBackbone=Qwen-3-14B2026.06 | 84 | 74 | 2,131.8 | 15.1 | 1.6 | |
| RoCoBackbone=LLaMA-3.1-70B2026.06 | 81 | 66 | 2,407.8 | 19.8 | 3 | |
| RoCoBackbone=Qwen-3-14B2026.06 | 81 | 69 | 2,491.8 | 25 | 3 | |
| CommPARTNRBackbone=Qwen-3-14B2026.06 | 81 | 70 | 3,518.5 | 21 | 1.2 | |
| CoELABackbone=LLaMA-3.1-70B2026.06 | 80 | 65 | 2,572 | 17.6 | 4.2 | |
| ReActBackbone=Qwen-3-14B2026.06 | 80 | 64 | 2,563.1 | 15.4 | 0 | |
| LLawCoBackbone=Gemma-3-12B2026.06 | 79 | 61 | 2,741.6 | 16 | 0.9 | |
| ReActBackbone=LLaMA-3.1-8B2026.06 | 77 | 62 | 3,606.2 | 20.7 | 0 | |
| CommPARTNRBackbone=Gemma-3-12B2026.06 | 76 | 60 | 3,282.9 | 20.5 | 0.9 | |
| ReActBackbone=Gemma-3-12B2026.06 | 75 | 59 | 3,547.1 | 17.2 | 0 | |
| LLawCoBackbone=LLaMA-3.1-8B2026.06 | 74 | 57 | 3,456 | 23 | 1.9 | |
| RoCoBackbone=Gemma-3-12B2026.06 | 73 | 56 | 1,837.9 | 21.2 | 3 | |
| CoELABackbone=LLaMA-3.1-8B2026.06 | 72 | 51 | 3,694.3 | 24.4 | 4.7 | |
| CommPARTNRBackbone=LLaMA-3.1-8B2026.06 | 71 | 49 | 3,671.3 | 28.6 | 3.6 | |
| CoELABackbone=Qwen-3-14B2026.06 | 71 | 62 | 3,136.9 | 36 | 7.1 | |
| RoCoBackbone=LLaMA-3.1-8B2026.06 | 69 | 52 | 3,940.8 | 29.1 | 3 | |
| CoELABackbone=Gemma-3-12B2026.06 | 68 | 42 | 3,516.2 | 23.9 | 4.9 |