kimoyami / prdc Goto Github PK

Could you please tell the five seeds number?

Dear Yuhang and Yi-Chen,

This is Jianxiong, a PHD student from AIR, Tsinghua University. I recently read the paper corresponding to this repository, and I really like the idea about regularizing offline RL with a point-to-dataset distance. However, I noticed that a similar idea was explored in one of my recent works [1], which seems to have been missed in the literature review section of your paper. Therefore, I would like to bring your attention to my paper [1].

In [1], we also consider incorporating the overall dataset geometry into policy learning. Specifically, we introduce a "state-conditioned distance function" as a regularization term in the policy training process. This distance function is trained using a simple regression loss and serves as an upper bound for the "point-to-centroid of dataset distance." Please refer to our paper for more details.

Overall, I believe that [1] is highly relevant to your work, and it would be greatly appreciated if you could include a citation to this paper in your manuscript.

[1] Li, J., Zhan, X., Xu, H., Zhu, X., Liu, J., & Zhang, Y. Q. When data geometry meets deep function: Generalizing offline reinforcement learning. (ICLR2023) https://arxiv.org/abs/2205.11027

Best regards,
Jianxiong