Tried to reset environment which is not done. While the monitor is active ... about rllab HOT 4 CLOSED

Quick solution is to change max_path_length to 200.

Basically the error is because the horizon does not match the one used in the gym environment spec.

from rllab.

Fixed in 4fd25fe.

from rllab.

Hi, I'm getting a similar error when running ddpg on CarRacing-v0:

File "/Users/diqi/iw_s17/rllab/scripts/run_experiment_lite.py", line 136, in
run_experiment(sys.argv)
File "/Users/diqi/iw_s17/rllab/scripts/run_experiment_lite.py", line 120, in run_experiment
method_call(variant_data)
File "examples/ddpg_car.py", line 42, in run_task
algo.train()
File "/Users/diqi/iw_s17/rllab/rllab/algos/ddpg.py", line 229, in train
next_observation, reward, terminal, _ = self.env.step(action)
File "/Users/diqi/iw_s17/rllab/rllab/envs/normalized_env.py", line 86, in step
wrapped_step = self._wrapped_env.step(scaled_action)
File "/Users/diqi/iw_s17/rllab/rllab/envs/gym_env.py", line 116, in step
next_obs, reward, done, info = self.env.step(action)
File "/Users/diqi/anaconda/envs/rllab3/lib/python3.5/site-packages/gym/core.py", line 100, in step
return self._step(action)
File "/Users/diqi/anaconda/envs/rllab3/lib/python3.5/site-packages/gym/wrappers/monitoring.py", line 32, in _step
self._before_step(action)
File "/Users/diqi/anaconda/envs/rllab3/lib/python3.5/site-packages/gym/wrappers/monitoring.py", line 167, in _before_step
self.stats_recorder.before_step(action)
File "/Users/diqi/anaconda/envs/rllab3/lib/python3.5/site-packages/gym/monitoring/stats_recorder.py", line 46, in before_step
raise error.ResetNeeded("Trying to step environment which is currently done. While the monitor is active for {}, you cannot step beyond the end of an episode. Call 'env.reset()' to start the next episode.".format(self.env_id))
gym.error.ResetNeeded: Trying to step environment which is currently done. While the monitor is active for CarRacing-v0, you cannot step beyond the end of an episode. Call 'env.reset()' to start the next episode.

from rllab.

@dqii see #87 (comment)

from rllab.