half precision not supported by CPU? about cubert HOT 7 CLOSED

Half precision is not supported by CPU. MKL does not have such half precision BLAS methods.

from cubert.

Half precision is not supported by CPU. MKL does not have such half precision BLAS methods.

how to modify the code to be used with CPU?

from cubert.

Half precision is not supported by CPU. MKL does not have such half precision BLAS methods.

how to modify the code to be used with CPU?

Could you clarify your question? I am not sure what you are asking.

For running on CPU, only single precision (float) is supported. The reason of no half precision is lying on Intel's MKL. They do not support half precision computing. There is nothing we can do now.

from cubert.

For running on CPU, only single precision (float) is supported. The reason of no half precision is lying on Intel's MKL. They do not support half precision computing. There is nothing we can do now.

When I compile the current code base and run the ”cuBERT_benchmark“, I got the error "half precision not supported by CPU". My question is, how to modify the code and make it runnable on CPU? I only need single precision computing.

from cubert.

You can simply change

and change

from cubert.

If you would like to run your own model, you may also need to give

from cubert.

If you would like to run your own model, you may also need to give

cuBERT/benchmark/benchmark_cu.cpp

Line 39 in 8ab0384

Dtype logits[batch_size];

more memory space and change output_type from cuBERT_LOGITS to your own model.

Thanks a lot!

from cubert.