Memory capacity for example data-efficient Rainbow? about rainbow HOT 4 CLOSED

I understood it as being at least the capacity of the length they train it for, hence I set both T-max and memory-capacity to 100000 (because this prevents making a 1M transition buffer which won't be used fully).

from rainbow.

Makes sense. It might be more sensible to add an argument that does this explicitly, rather than implicitly? Because if you increase the number of training iterations, you need to know you should also separately increase the memory size.

from rainbow.

Added a note in the readme to explain my reasoning for this. Think knowing about this is better than naively setting --unbounded for a large T-max.

from rainbow.

Makes sense -- that's probably an even better solution.

from rainbow.