CartPoleSwingUp is a custom gym environment, adapted from hardmaru's version.

Swing-up is a more complex version of the popular CartPole gym environment. In swing-up, the cart must first swing the pole to an upright position before balancing it as in normal CartPole.

This adapted version includes a non-continuous version of the environment for use with models such as DQN.

Note: this env currently does not work with the latest versions of gym. I am working to correct this.

Either copy the file containing the environment to your own codebase, or install the repo with pip install git+https://github.com/TTitcombe/CartPoleSwingUp.git. You can then import the code with import CartPoleSwingUp. Once you've imported the environment class, you can simply call env = CartPoleSwingUpEnv(). However, if you do not want to hard-code an environment, I have created a helper function which defaults to gym behaviour if using any other env:

from cartpoleswingup import make

swing_up_env = make("CartPoleSwingUp")
cartpole_env = make("CartPole-v1")