Action Learning on ALFRED (Q3)
54.8AccuracyAffordance Routing (REIS)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Affordance Routing (REIS)Avg Latency=406.21 ms, Avg Output Tokens=02026.05 | 54.8 | 75.4 | 32.1 | 45.03 | |
| RAG + DirectAvg Latency=1017.83 ms, Avg Output Tokens=02026.05 | 54.6 | 75.1 | 31.91 | 44.79 | |
| CAG + DirectAvg Latency=1027.44 ms, Avg Output Tokens=02026.05 | 54.4 | 74.69 | 31.73 | 44.53 | |
| Base + DirectAvg Latency=327.56 ms, Avg Output Tokens=02026.05 | 50.1 | 79.3 | 12.2 | 21.1 | |
| Base + ReasoningAvg Latency=43.59 sec, Avg Output Tokens=230.82026.05 | 46.7 | 63.2 | 6.3 | 11.5 |