DRL training with vectorized environment and asynchronous time-steps about igibson HOT 2 CLOSED

@akmandor You are right that for parallelized environments, as it's implemented in sb3, it's bottlenecked by the slowest environment. It's typically not an issue if all environment steps take approximately the same amount of time (hence there is no real bottleneck). Some other RL packages (non-stable baselines 3) might provide such functionality but I am not entirely sure. Since this is not technically an issue with iGibson but rather RL framework parallelization, I will close the issue for now. Feel free to re-open if you need additional help! Thanks!

from igibson.

Thank you so much for clarifying the issue for me. I might take a look to other available RL libraries, such as RAY's RL-Lib to solve that training bottleneck.

from igibson.