Target Acquisition on Reacher Quadrant (test)
19.7Target Hit Rate (per min)IDA
Evaluation Results
| Method | Links | |
|---|---|---|
| IDASurrogate pilot type=Expert2024.09 | 19.7 | |
| Pilot-OnlySurrogate pilot type=Expert2024.09 | 19.05 | |
| IDA (FG)Surrogate pilot type=Expert, Goal distribution=Faux goals via Monte Carlo sampling2024.09 | 18.5 | |
| IDA (DS)Surrogate pilot type=Expert, Domain Shift=Q function trained on different goal distribution2024.09 | 17.9 | |
| IDASurrogate pilot type=Laggy2024.09 | 9.2 | |
| IDA (DS)Surrogate pilot type=Laggy, Domain Shift=Q function trained on different goal distribution2024.09 | 8.7 | |
| IDA (FG)Surrogate pilot type=Laggy, Goal distribution=Faux goals via Monte Carlo sampling2024.09 | 8.4 | |
| Pilot-OnlySurrogate pilot type=Laggy2024.09 | 8.38 | |
| IDASurrogate pilot type=Noisy2024.09 | 3.6 | |
| IDA (FG)Surrogate pilot type=Noisy, Goal distribution=Faux goals via Monte Carlo sampling2024.09 | 2.9 | |
| IDA (DS)Surrogate pilot type=Noisy, Domain Shift=Q function trained on different goal distribution2024.09 | 2.8 | |
| Pilot-OnlySurrogate pilot type=Noisy2024.09 | 2.07 | |
| CopilotSurrogate pilot type=Laggy2024.09 | 0.03 | |
| CopilotSurrogate pilot type=Expert2024.09 | 0 | |
| CopilotSurrogate pilot type=Noisy2024.09 | 0 |