Blas SGEMM launch failed when predicting with GPU about trailmap HOT 5 OPEN

Could you try the stackoverflow post below by adding the config.gpu_options?
https://stackoverflow.com/questions/38303974/tensorflow-running-error-with-cublas

One of the comments here (qqwweee/keras-yolo3#332 (comment)) mentioned that he was able to run tensorflow fine on his 1080 ti, but the 2080 ti gives the same error you received. It seems to do something with cuda version. What version of cudnn are you using?

Edit: This may also be useful. Could you try adding those lines and checking your cuda/cudnn versions? tensorflow/tensorflow#25403 (comment)

from trailmap.

Hi,
thanks for your suggesions. It seems that you landed on slightly different stackoverflow posts with your google search than I did.

I tried setting the tensorflow config to allow growth and only use 0.9 percent of the available memory but that did not help.

However, some of the comments seemed to indicate that a newer tensorflow version is required (which supports more recent cuda/cudnn versions). I am using conda as a package manager and I originally installed tensorflow=1.9 as per your readme. After deinstalling tensorflow and installing

conda install tensorflow-gpu=1.12

the above error went away.
However, not all is well... I'm now running into some other problems. I will dig into these some more and open another issue once I have a better grip on what's happening.

from trailmap.

Sorted out the other issue (see #5) and can now confirm that upgrading tensorflow-gpu to 1.12 fixed the tensorflow.python.framework.errors_impl.InternalError: Blas SGEMM launch failed error on the GTX2080Ti.

from trailmap.

Thanks for figuring this out. I had only done testing on tensorflow-gpu 1.9, which had worked fine on our 1080 ti. I will see if tensorflow-gpu 1.12 works well with our 1080 ti. If this is the case, I will update the README to be 1.12.

from trailmap.

I have succesfully used a RTX 2080Ti with tensorflow-GPU=2.1. You just need t o correctly align nvidia driver, CUDA version, cdDNN version and supported tensorflow verison.

from trailmap.