Web Interaction on MiniWoB++ 1.0 (test)
100Choose ListRCI
Evaluation Results
| Method | Links | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RCILLM Backend=GPT-3.52023.03 | 100 | — | — | — | — | — | — | — | — | 100 | 100 | 94 | 72 | 100 | 100 | 62 | 100 | 100 | 100 | 100 | 100 | — | 100 | 100 | — | 100 | 100 | 98 | — | 76 | — | 74 | 100 | 100 | — | 100 | 98 | — | — | 40 | — | — | — | — | — | — | — | — | — | 94 | 100 | — | — | 98 | — | — | — | 98 | 96 | 100 | — | 100 | 100 | 100 | — | — | 100 | 100 | 100 | 20 | — | — | 76 | 68 | 100 | — | 72 | 100 | 86 | — | — | — | — | — | — | — | 100 | — | |
| RCILLM Backend=GPT-42023.03 | 100 | — | — | — | — | — | — | — | — | 100 | 100 | 94 | 96 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | — | 100 | 100 | — | 100 | 100 | 98 | — | 98 | — | 100 | 100 | 100 | — | 100 | 98 | — | — | 40 | — | — | — | — | — | — | — | — | — | 94 | 100 | — | — | 98 | — | — | — | 98 | 96 | 100 | — | 100 | 100 | 100 | — | — | 100 | 100 | 100 | 20 | — | — | 100 | 68 | 100 | — | 96 | 100 | 100 | — | — | — | — | — | — | — | 100 | — | |
| CC-NetLearning Paradigm=SL + RL2023.03 | 99 | — | 0.97 | 0.87 | 0.93 | 0.99 | 0.99 | 0.97 | 0.97 | 100 | 100 | 71 | 95 | 99 | 98 | 98 | 100 | 100 | 100 | 100 | 99 | 0.83 | 94 | 99 | 0.97 | 60 | 100 | 95 | 0.99 | 98 | 0.99 | 98 | 100 | 100 | 1 | 100 | 100 | 0.63 | 0.79 | 85 | 1 | 1 | 0.79 | 1 | 0.98 | 0.99 | 0.99 | 0.97 | 1 | 100 | 100 | 1 | 1 | 100 | 1 | 1 | 1 | 100 | 100 | 100 | 0.98 | 100 | 100 | 97 | 0.97 | 0.88 | 100 | 100 | 100 | 100 | 1 | 1 | 100 | 100 | 100 | 0.88 | 100 | 100 | 99 | 0.99 | 0.94 | 0.97 | 1 | 0.98 | 1 | 0.96 | 100 | 0 | |
| CC-NetLearning Paradigm=RL2023.03 | 99 | — | 1 | 0 | 0.93 | 0.99 | 0.02 | 0.01 | 1 | 100 | 80 | 0 | 12 | 55 | 45 | 88 | 100 | 100 | 100 | 100 | 94 | 0.96 | 48 | 78 | 0.92 | 59 | 2 | 50 | 0.94 | 87 | 0.96 | 91 | 100 | 100 | 1 | 100 | 100 | 0 | 0 | 70 | 1 | 0.19 | 0.95 | 0 | 0 | 0 | 0.23 | 0 | 1 | 0 | 0 | 0 | 1 | 46 | 0.48 | 0 | 0.47 | 58 | 100 | 1 | 0 | 100 | 100 | 89 | 0.97 | 0 | 100 | 100 | 2 | 21 | 0.34 | 1 | 100 | 10 | 0 | 0.69 | 0 | 0 | 94 | 0 | 0 | 0 | 0.68 | 0.98 | 1 | 0 | 1 | 0 | |
| SotALearning Paradigm=RL2023.03 | 99 | — | 1 | 1 | 0.93 | 0.99 | 0.02 | 1 | 1 | 100 | 100 | 0 | 12 | 55 | 100 | 88 | 100 | 100 | 100 | 100 | 100 | 0.96 | 48 | 100 | 1 | 59 | 2 | 50 | 0.94 | 87 | 0.96 | 100 | 100 | 100 | 1 | 100 | 100 | 0 | 0 | 70 | 1 | 0.19 | 0.95 | 0 | 0 | 0 | 0.23 | 0 | 1 | 0 | 0 | 0 | 1 | 46 | 0.48 | 0 | 0.47 | 58 | 100 | 100 | 0 | 100 | 100 | 89 | 0.97 | 0 | 100 | 100 | 2 | 100 | 0.34 | 1 | 100 | 10 | 100 | 0.69 | 0 | 0 | 100 | 0 | 0 | 0 | 0.68 | 0.98 | 1 | 0 | 100 | 0 | |
| SotALearning Paradigm=SL + RL2023.03 | 99 | — | 0.97 | 0.87 | 1 | 0.99 | 0.99 | 0.97 | 0.98 | 100 | 100 | 71 | 95 | 99 | 98 | 98 | 100 | 100 | 100 | 100 | 100 | 0.83 | 94 | 100 | 0.97 | 60 | 100 | 95 | 0.99 | 98 | 0.99 | 98 | 100 | 100 | 1 | 100 | 100 | 0.63 | 0.79 | 85 | 1 | 1 | 0.79 | 1 | 0.98 | 0.99 | 0.99 | 0.97 | 1 | 100 | 100 | 1 | 1 | 100 | 1 | 1 | 1 | 100 | 100 | 100 | 0.98 | 100 | 100 | 97 | 0.97 | 0.88 | 100 | 100 | 100 | 100 | 1 | 1 | 100 | 100 | 100 | 0.88 | 100 | 100 | 99 | 0.99 | 0.94 | 0.97 | 1 | 0.98 | 1 | 0.96 | 100 | 0.28 | |
| WebN T5-3B2023.03 | 26 | — | — | 0 | — | 0.03 | 0 | 0 | — | 100 | 100 | 22 | 54 | 63 | 96 | 0 | 0 | 27 | 24 | 100 | 100 | — | 37 | 87 | 0.51 | 0 | 0 | 53 | — | 12 | — | 18 | 74 | 100 | — | 100 | 100 | — | — | 41 | — | — | — | — | — | — | — | — | — | 33 | 60 | — | — | 23 | — | — | — | 38 | 0 | 97 | — | 98 | 89 | 0 | — | — | 100 | 100 | 49 | 0 | — | — | 88 | 72 | 82 | — | 83 | 88 | 91 | — | — | — | — | — | — | — | 34 | — | |
| OthersLearning Paradigm=SL + RL2023.03 | 26 | — | 0.8 | 1 | 1 | — | — | — | 0.98 | 100 | 100 | 84 | 94 | 64 | 100 | 99 | 100 | 100 | 100 | 100 | 100 | 0.16 | 13 | 100 | 1 | 7 | 99 | 64 | — | — | — | 100 | 100 | 100 | — | 100 | 100 | 0 | 0 | 76 | 0.3 | 0.31 | 0.18 | — | 0.01 | 0.41 | 0.92 | 0.66 | 1 | — | — | — | — | 93 | — | — | — | 99 | 100 | 100 | 0 | 100 | 100 | 90 | 0.31 | 0 | 100 | 100 | 100 | 21 | 0.13 | 0.9 | 100 | — | 100 | 0.78 | 100 | 100 | 100 | 0.16 | 0 | 0 | 0.11 | 0.38 | 0.96 | 0 | 100 | 0.28 | |
| SotALearning Paradigm=SL2023.03 | 26 | — | 0.29 | 0 | 0.8 | 0.42 | 0.26 | 0.12 | 0.36 | 100 | 100 | 22 | 54 | 63 | 96 | 17 | 81 | 82 | 88 | 100 | 100 | 0.52 | 38 | 87 | 0.51 | 1 | 4 | 54 | — | 19 | — | 27 | 100 | 100 | 0.94 | 100 | 100 | 0.01 | 0.04 | 43 | 0.74 | 0.61 | 0.23 | 0.61 | 0.05 | 0.13 | 0.26 | 0.11 | 0.22 | 33 | 60 | 0.01 | 0.3 | 26 | 0.13 | 0 | 0.11 | 38 | 2 | 97 | — | 98 | 99 | 4 | 0.35 | 0.05 | 100 | 100 | 66 | 0 | 0.4 | 0.51 | 89 | 72 | 82 | 0.13 | 83 | 88 | 99 | 0 | 0 | 0.01 | 0.27 | 0.26 | 0.88 | 0.04 | 34 | 0.02 | |
| CC-NetLearning Paradigm=SL2023.03 | 19 | — | 0.29 | 0 | 0.8 | 0.42 | 0.26 | 0.12 | 0.36 | 47 | 78 | 0 | 4 | 36 | 32 | 17 | 81 | 82 | 88 | 95 | 59 | 0.52 | 22 | 21 | 0.15 | 1 | 4 | 11 | 0.61 | 19 | 0.54 | 27 | 95 | 95 | 0.94 | 100 | 56 | 0.01 | 0.04 | 21 | 0.74 | 0.61 | 0.23 | 0.61 | 0.05 | 0.13 | 0.26 | 0.11 | 0.22 | 0 | 0 | 0.01 | 0.3 | 5 | 0.13 | 0 | 0.11 | 9 | 2 | 2 | 0.04 | 39 | 35 | 4 | 0.35 | 0.05 | 96 | 99 | 66 | 20 | 0.4 | 0.51 | 68 | 2 | 0 | 0.13 | 0 | 0 | 32 | 0 | 0 | 0.01 | 0.27 | 0.26 | 0.88 | 0.04 | 15 | 0.02 |