trpo_gym.py fails when trying CartPole-v0 on mac about rllab HOT 4 OPEN

This is usually not the actual exception. Try looking above that message for the actual error.

from rllab.

I get a similar problem, but it is due to the action spaces not being a Box (see assertion on line 55 of gaussian_mlp_policy.py). Maybe, there should be some conversion function in the GymEnv class? Or better, gaussian_mlp_policy.py should handle Discrete action spaces too if possible?

One possible resource for how this can be done is:

https://github.com/joschu/modular_rl/blob/master/modular_rl/agentzoo.py

from rllab.

@Breakend you should use a CategoricalMLPPolicy for this.

from rllab.

@dementrock Ah, yes. Didn't notice this. I added a pull-request to split the examples so that this becomes more clear. Also added a TF example as part of that pull-request so that people are aware of those possibilities.

from rllab.