Add support for GPU and multiGPU about tgan HOT 7 OPEN

Hi @ManuelAlvarezC, how is this going? I would like to train with TGAN, but that's kinda hard without GPU.

from tgan.

Hi @Baukebrenninkmeijer,

We are currently planning the next steps on the project, so I can't give you an exact answer.
However, we are open to contributions 🙂, so if you are interested, we can discuss here the implementation details.

from tgan.

Hi @ManuelAlvarezC,

This is my first project with tensorpack, so I'm still getting used to working with it.

However, the current code already select the GPU automatically and has the option to pass a gpu='/gpu:0' paramater or alike. I had not seen this when I commented on the issue, so I'm wondering how the issue relates to these options already being available. I also saw code for a multi-GPU setup, which is also mentioned here.

from tgan.

Hi @Baukebrenninkmeijer

This is my first project with tensorpack, so I'm still getting used to working with it.

I'm sure this won't be a big issue.

However, the current code already select the GPU automatically and has the option to pass a gpu='/gpu:0' paramater or alike. I had not seen this when I commented on the issue, so I'm wondering how the issue relates to these options already being available. I also saw code for a multi-GPU setup, which is also mentioned here.

Indeed, most of the code is already there, what is missing is orchestrating everything. I have updated the original issue with the implementation details, so if you are interested, please let me know, so I can assign this issue to you. If you want to start working on it I recommend you take a look at our CONTRIBUTING guide.

from tgan.

Hi Manuel,

is it possible to run TGAN on GPU? I am finding it is running slowly on my CPU.

If I uninstall tensorflow and TGAN and then install tensorflow gpu and reinstall TGAN, will TGAN then automatically train on my GPU? GPU train is already working for other neural nets on my machine,

thanks,

George

from tgan.

@georgeMcMahon TGAN should be independent of your tensorflow installation. Tensorflow should automatically use the GPU if it is available, so make sure this is the case. Check if you have the correct NVIDIA drivers, Cuda toolkit, Cudnn and tensorflow and if tensorflow has access to the gpu.

What library are you using for your other neural nets? Also tensorflow? If so, there might be a version mismatch or something.

Hope this helps!

from tgan.

Hi @georgeMcMahon,

is it possible to run TGAN on GPU?

Yes it is, as @Baukebrenninkmeijer mentions in the comment above this, TGAN is independent of your tensorflow installation.

If I uninstall tensorflow and TGAN and then install tensorflow gpu and reinstall TGAN, will TGAN then automatically train on my GPU?

Yes, I think that this should work. This issue is open not because TGAN not being able to work with tensorflow-gpu but because we want to make it work in the three scenarios (CPU, GPU and multiGPU) out of the box.

from tgan.