[BUG] `pip install deepspeed==0.13.0` fails about deepspeed HOT 5 CLOSED

Hi @apoorvkh while in the past we have not required torch to be installed before installing DeepSpeed, it has always been required to run DeepSpeed. This "bug" is from a recent PR: #4547

It is problematic adding torch as a requirement to the project because pip will often install the CPU version rather than CUDA/ROCm versions.

We are discussing internally what the proper action is, but I suspect we will restore the previous behavior of not requiring torch at install time and do a 0.13.1 patch release with this update.

from deepspeed.

cc @mrwyattii @jeffra

from deepspeed.

Understood, that would be great -- thank you!

from deepspeed.

This issue is caused by these two piece of reflection codes. The problem is the reflection code should not intend to iterate into directories belongs to other accelerator.

https://github.com/microsoft/DeepSpeed/blob/master/op_builder/__init__.py#L46
https://github.com/microsoft/DeepSpeed/blob/master/op_builder/all_ops.py#L22

There are two possible fixes, one is to skip directories belongs to accelerators with code like:
if module_name not in ['cpu', 'hpu', 'mps', 'npu', 'xpu']:
Another possible fix which is more graceful should be move CUDA OpBuilders into cuda/ directory in op_builder but his might need more global code change.

from deepspeed.

Everything is working well on my end -- thanks again @mrwyattii!

from deepspeed.