Would you be willing to share the code used for your training process? about marigold HOT 6 CLOSED

Thanks for your interest in our work. We do have a plan to release training and evaluation code in the future. However, the schedule is not clear yet. Please stay tuned for future updates.
#1 (comment)

from marigold.

I find it can be trained following the structure of the pipeline design, using the HuggingFace text_to_image.py example Here, only changing the UNet part.

I have implemented an unofficial training version using the HuggingFace's diffusers when using the batch size equal 1 or 2, the training takes about 21G VRAM. Not sure whether can reproduce the result or not. Basically, the author says it can be trained on a single RTX4090 is True :)

from marigold.

Thank you for sharing this! I will try it at the earliest opportunity and will share any outcomes here.

from marigold.

I find it can be trained following the structure of the pipeline design, using the HuggingFace text_to_image.py example Here, only changing the UNet part.

I have implemented an unofficial training version using the HuggingFace's diffusers when using the batch size equal 1 or 2, the training takes about 21G VRAM. Not sure whether can reproduce the result or not. Basically, the author says it can be trained on a single RTX4090 is True :)

Have you tried the "Annealed multi-resolution noise" mentioned in the paper? I'm not sure if I set it right in my training.

from marigold.

Ohh, about this point, I did not implement the Annealed multi-resolution noise......

from marigold.

I find it can be trained following the structure of the pipeline design, using the HuggingFace text_to_image.py example Here, only changing the UNet part.

I have implemented an unofficial training version using the HuggingFace's diffusers when using the batch size equal 1 or 2, the training takes about 21G VRAM. Not sure whether can reproduce the result or not. Basically, the author says it can be trained on a single RTX4090 is True :)

Hello, I am sorry to bother you. Firstly, thanks a lot for writing the training pipeline code. I wonder whether you have trained your image2depth diffusion model based on the scripts. Did they perform good training results?
Thank you! :)

from marigold.