jachiam / cpo Goto Github PK

How does the term

gets converted to the advantage term of

when f = V(π)

I have been struggling for re-implementing this thing using pytorch for a long time, yet still no break through. Does anybody have any suggestions?

The paper mentions in Section 10.3.2 that failure predictor networks are used for experiments other than the Point Gather. Correct me if I am wrong, but I cannot find the implementation of the same in this repository. Can anyone point me to some reference on how they can be incorporated?

Thanks!

Hi, i'm trying to Run CPO in the Point-Gather environment. However, the env can't import well.

To be specific, there is no “MjModel” or anything like it in rllab.mujoco_py.

Is anyone know where is “MjModel”?

anyone run experiment successfully?(e.g. CPO_point_gather.py)
i've been trying for weeks, and bugs constantly occur.
anyone know all the packages(with version) required for this code?

Thanks!