Can't process big size image about dali HOT 8 CLOSED

Update ：
when I use big size images to run DALI+tensorflow model,the GPU utilization will increase up to almost 100%, so I use

config = tf.ConfigProto()
config.gpu_options.per_process_gpu_memory_fraction = 0.7
sess = tf.Session(config=config)

It works.

from dali.

Hi, thanks for posting the issue. Would it be possible to get an image that results in internal error in nvJPEG? This looks like a bug in either nvJPEG or DALI integration of nvJPEG.

On the memory issue - TensorFlow by default takes pretty much all of the available GPU memory and there is not much left for DALI to work with. There is an ongoing work to integrate with TensorFlow's memory manager (so that DALI could use the memory TF allocated), but currently the solution is (as you figured out) to limit the amount of memory that TF uses with per_process_gpu_memory_fraction.

from dali.

Hi @Freed-Wu,

Have you tried to reduce batch size and see if that helps? It seems like out of memory problem.

from dali.

Tracked internally in DALI-138

from dali.

@ptrendx Thanks for your detailed explain , and looking forward to the new version of DALI ~

from dali.

@jxmelody - could you tell us how it works with recent DALI 0.2?

from dali.

If it still crashes. Please reopen.

from dali.

It's an nvJpeg error, and the error code is "8"

I met the error code is "5". Is it a similar error? How to solve it?

RuntimeError: Critical error in pipeline:
Error when executing Mixed operator decoders__Image encountered:
Error in thread 7: nvJPEG error (5): The user-provided allocator functions, for either memory allocation or for releasing the memory, returned a non-zero code.

from dali.