Strategic Decision Making on Rock-Paper-Scissors
48.55Paper Win RateStream
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| StreamBackbone=Yi-34b, # Entropy=0, # Recent=1020, Ndecay=12024.05 | 48.55 | 27.95 | 23.5 | 41.05 | 26.15 | 32.8 | 32.2 | 38.9 | 28.9 | 40.6 | |
| SirLLMBackbone=Yi-34b, # Entropy=1020, # Recent=0, Ndecay=0.82024.05 | 48.45 | 28 | 23.55 | 40.6 | 26.15 | 33.25 | 37.05 | 38.25 | 24.7 | 42.03 | |
| IntervalBackbone=Yi-34b, # Entropy=1020, # Recent=0, Ndecay=12024.05 | 45.4 | 26.05 | 28.55 | 35.45 | 24.3 | 40.25 | 26.2 | 46.15 | 27.65 | 35.68 | |
| RandomBackbone=Vicuna-13b, # Entropy=1020, # Recent=0, Ndecay=12024.05 | 44.02 | 26.63 | 29.35 | 30.43 | 21.7 | 47.97 | 28.32 | 46.43 | 25.25 | 34.26 | |
| StreamBackbone=Yi-6b, # Entropy=0, # Recent=1020, Ndecay=12024.05 | 31.1 | 19.6 | 49.3 | 30.9 | 19.1 | 50 | 46.45 | 31 | 22.55 | 36.15 | |
| SirLLMBackbone=Yi-6b, # Entropy=1020, # Recent=0, Ndecay=0.92024.05 | 30.65 | 19.55 | 49.8 | 30.9 | 19.1 | 50 | 50.45 | 28.05 | 21.5 | 37.33 | |
| RandomBackbone=Yi-34b, # Entropy=1020, # Recent=0, Ndecay=12024.05 | 30.57 | 19.68 | 49.62 | 19.08 | 50.12 | 30.97 | 51.7 | 27.35 | 20.95 | 33.78 | |
| StreamBackbone=Vicuna-13b, # Entropy=0, # Recent=1020, Ndecay=12024.05 | 30.25 | 21.15 | 48.6 | 22.6 | 47.25 | 30.15 | 51.2 | 27.65 | 21.15 | 34.68 | |
| IntervalBackbone=Vicuna-13b, # Entropy=1020, # Recent=0, Ndecay=12024.05 | 29.8 | 22.65 | 47.55 | 21.8 | 45.65 | 32.5 | 50.25 | 27.8 | 21.9 | 33.95 | |
| IntervalBackbone=Vicuna-7b, # Entropy=1020, # Recent=0, Ndecay=12024.05 | 29.15 | 37.95 | 32.9 | 24.4 | 45.8 | 29.8 | 28.25 | 35.05 | 36.7 | 27.27 | |
| StreamBackbone=Vicuna-7b, # Entropy=0, # Recent=1020, Ndecay=12024.05 | 28.75 | 24.05 | 47.2 | 19.8 | 45.9 | 34.3 | 51.2 | 27.7 | 21.1 | 33.25 | |
| SirLLMBackbone=Vicuna-13b, # Entropy=1020, # Recent=0, Ndecay=0.72024.05 | 28.5 | 26.2 | 45.3 | 33.7 | 39.8 | 26.5 | 48.1 | 25.75 | 26.15 | 36.77 | |
| SirLLMBackbone=Vicuna-7b, # Entropy=1020, # Recent=0, Ndecay=0.72024.05 | 26.2 | 32.1 | 41.7 | 27.4 | 30.45 | 42.15 | 48.6 | 29.85 | 21.55 | 34.07 | |
| RandomBackbone=Yi-6b, # Entropy=1020, # Recent=0, Ndecay=12024.05 | 20 | 49.45 | 30.55 | 49.73 | 31.02 | 19.25 | 27.18 | 21.93 | 50.88 | 32.31 | |
| RandomBackbone=Vicuna-7b, # Entropy=1020, # Recent=0, Ndecay=12024.05 | 19.57 | 49.62 | 30.82 | 49.82 | 31.03 | 19.15 | 27.68 | 20.9 | 51.42 | 32.36 | |
| IntervalBackbone=Yi-6b, # Entropy=1020, # Recent=0, Ndecay=12024.05 | 19.45 | 50.15 | 30.4 | 50 | 30.9 | 19.1 | 27.35 | 20.8 | 51.85 | 32.27 |