Adapter微调报错 about internvl-mmdetseg HOT 12 CLOSED

Dear dev, the model weights of mmseg can also be used for mmdet, right? How about updating the weights information in the readme file in mmdet as well? Or update the information in the readme file which at the top level? It's maybe better for everyone. Thx~

I mean download infomation.

from internvl-mmdetseg.

您好，这个问题看着是deformable_attention没有编译；README的步骤里忘了写要手动编译deformable_attention了，您可以执行这个文件编译一下：https://github.com/OpenGVLab/InternVL-MMDetSeg/blob/main/ops/compile.sh

from internvl-mmdetseg.

您好，这个问题看着是deformable_attention没有编译；README的步骤里忘了写要手动编译deformable_attention了，您可以执行这个文件编译一下：https://github.com/OpenGVLab/InternVL-MMDetSeg/blob/main/ops/compile.sh

您好，我按您给的方法编译成功了deformable_attention，还是有同样的报错，但是Please install MSDeformAttn if you want to use ViT-Adapter这句比之前少了一行，之前是会弹出三行，这次是两行。
[2024-03-27 06:01:25,093] [INFO] [real_accelerator.py:191:get_accelerator] Setting ds_accelerator to cuda (auto detect)
Please install MSDeformAttn if you want to use ViT-Adapter
Please install MSDeformAttn if you want to use ViT-Adapter
2024-03-27 06:01:30,151 - mmseg - INFO - Multi-processing start method is None
2024-03-27 06:01:30,154 - mmseg - INFO - OpenCV num_threads is `128
2024-03-27 06:01:30,228 - mmseg - INFO - Environment info:

后面的报错和之前一样的，定位后看到是adapter_modules.py和vit_adapter.py这两个文件依然找不到这个模块：
Traceback (most recent call last):
File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmcv/mmcv/utils/registry.py", line 69, in build_from_cfg
return obj_cls(**args)
File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmsegmentation/mmseg/models/backbones/vit_adapter.py", line 49, in init
self.interactions = nn.Sequential(*[
File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmsegmentation/mmseg/models/backbones/vit_adapter.py", line 50, in
InteractionBlock(dim=embed_dim, num_heads=deform_num_heads, n_points=n_points,
File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmsegmentation/mmseg/models/backbones/adapter_modules.py", line 165, in init
self.injector = Injector(dim=dim, n_levels=3, num_heads=num_heads, init_values=init_values,
File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmsegmentation/mmseg/models/backbones/adapter_modules.py", line 138, in init
self.attn = MSDeformAttn(d_model=dim, n_levels=n_levels, n_heads=num_heads,
NameError: name 'MSDeformAttn' is not defined

from internvl-mmdetseg.

您试试把ops文件夹软连接到mmsegmentation文件夹下

cd mmsegmentation/
ln -s ../ops ./

from internvl-mmdetseg.

您试试把ops文件夹软连接到mmsegmentation文件夹下

cd mmsegmentation/
ln -s ../ops ./

感谢答复，这个问题已经解决了，但是后面在deepspeed出现了另外的报错，不确定是不是因为我之前更换了版本：

我尝试了不使用deepspeed，在config中改了deepspeed=false后，又出现了如下报错：

from internvl-mmdetseg.

deepspeed新版应该是不兼容的，我有尝试过，您可以退回0.8.0再试试看

from internvl-mmdetseg.

Traceback (most recent call last):
File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmsegmentation/tools/train.py", line 12, in
from mmcv.cnn.utils import revert_sync_batchnorm
File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmcv/mmcv/cnn/init.py", line 14, in
from .builder import MODELS, build_model_from_cfg
File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmcv/mmcv/cnn/builder.py", line 2, in
from ..runner import Sequential
File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmcv/mmcv/runner/init.py", line 3, in
from .base_runner import BaseRunner
File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmcv/mmcv/runner/base_runner.py", line 14, in
import deepspeed
File "/root/anaconda3/envs/internvl-mmdetseg/lib/python3.9/site-packages/deepspeed/init.py", line 17, in
from .runtime.engine import DeepSpeedEngine, DeepSpeedOptimizerCallable, DeepSpeedSchedulerCallable
File "/root/anaconda3/envs/internvl-mmdetseg/lib/python3.9/site-packages/deepspeed/runtime/engine.py", line 93, in
from deepspeed.inference.config import DtypeEnum
File "/root/anaconda3/envs/internvl-mmdetseg/lib/python3.9/site-packages/deepspeed/inference/config.py", line 88, in
class BaseQuantConfig(DeepSpeedConfigModel):
File "/root/anaconda3/envs/internvl-mmdetseg/lib/python3.9/site-packages/pydantic/_internal/_model_construction.py", line 92, in new
private_attributes = inspect_namespace(
File "/root/anaconda3/envs/internvl-mmdetseg/lib/python3.9/site-packages/pydantic/_internal/_model_construction.py", line 384, in inspect_namespace
raise PydanticUserError(
pydantic.errors.PydanticUserError: A non-annotated attribute was detected: enabled = True. All model fields require a type annotation; if enabled is not meant to be a field, you may be able to resolve this error by annotating it as a ClassVar or updating model_config['ignored_types'].

For further information visit https://errors.pydantic.dev/2.6/u/model-field-missing-annotation

from internvl-mmdetseg.

Traceback (most recent call last): File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmsegmentation/tools/train.py", line 12, in from mmcv.cnn.utils import revert_sync_batchnorm File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmcv/mmcv/cnn/init.py", line 14, in from .builder import MODELS, build_model_from_cfg File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmcv/mmcv/cnn/builder.py", line 2, in from ..runner import Sequential File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmcv/mmcv/runner/init.py", line 3, in from .base_runner import BaseRunner File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmcv/mmcv/runner/base_runner.py", line 14, in import deepspeed File "/root/anaconda3/envs/internvl-mmdetseg/lib/python3.9/site-packages/deepspeed/init.py", line 17, in from .runtime.engine import DeepSpeedEngine, DeepSpeedOptimizerCallable, DeepSpeedSchedulerCallable File "/root/anaconda3/envs/internvl-mmdetseg/lib/python3.9/site-packages/deepspeed/runtime/engine.py", line 93, in from deepspeed.inference.config import DtypeEnum File "/root/anaconda3/envs/internvl-mmdetseg/lib/python3.9/site-packages/deepspeed/inference/config.py", line 88, in class BaseQuantConfig(DeepSpeedConfigModel): File "/root/anaconda3/envs/internvl-mmdetseg/lib/python3.9/site-packages/pydantic/_internal/_model_construction.py", line 92, in new private_attributes = inspect_namespace( File "/root/anaconda3/envs/internvl-mmdetseg/lib/python3.9/site-packages/pydantic/_internal/_model_construction.py", line 384, in inspect_namespace raise PydanticUserError( pydantic.errors.PydanticUserError: A non-annotated attribute was detected: enabled = True. All model fields require a type annotation; if enabled is not meant to be a field, you may be able to resolve this error by annotating it as a ClassVar or updating model_config['ignored_types'].

For further information visit https://errors.pydantic.dev/2.6/u/model-field-missing-annotation

您好，我退回0.8.0后是这个报错

from internvl-mmdetseg.

Traceback (most recent call last): File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmsegmentation/tools/train.py", line 12, in from mmcv.cnn.utils import revert_sync_batchnorm File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmcv/mmcv/cnn/init.py", line 14, in from .builder import MODELS, build_model_from_cfg File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmcv/mmcv/cnn/builder.py", line 2, in from ..runner import Sequential File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmcv/mmcv/runner/init.py", line 3, in from .base_runner import BaseRunner File "/mnt/gengxz/projects/InternVL_MMDetSeg/mmcv/mmcv/runner/base_runner.py", line 14, in import deepspeed File "/root/anaconda3/envs/internvl-mmdetseg/lib/python3.9/site-packages/deepspeed/init.py", line 17, in from .runtime.engine import DeepSpeedEngine, DeepSpeedOptimizerCallable, DeepSpeedSchedulerCallable File "/root/anaconda3/envs/internvl-mmdetseg/lib/python3.9/site-packages/deepspeed/runtime/engine.py", line 93, in from deepspeed.inference.config import DtypeEnum File "/root/anaconda3/envs/internvl-mmdetseg/lib/python3.9/site-packages/deepspeed/inference/config.py", line 88, in class BaseQuantConfig(DeepSpeedConfigModel): File "/root/anaconda3/envs/internvl-mmdetseg/lib/python3.9/site-packages/pydantic/_internal/_model_construction.py", line 92, in new private_attributes = inspect_namespace( File "/root/anaconda3/envs/internvl-mmdetseg/lib/python3.9/site-packages/pydantic/_internal/_model_construction.py", line 384, in inspect_namespace raise PydanticUserError( pydantic.errors.PydanticUserError: A non-annotated attribute was detected: enabled = True. All model fields require a type annotation; if enabled is not meant to be a field, you may be able to resolve this error by annotating it as a ClassVar or updating model_config['ignored_types'].
For further information visit https://errors.pydantic.dev/2.6/u/model-field-missing-annotation

您好，我退回0.8.0后是这个报错

这个问题应该已经解决了，我之前没有使用过deepspeed，麻烦您看一下这个训练日志是正常的吗

from internvl-mmdetseg.

应该没问题

from internvl-mmdetseg.

Dear dev, the model weights of mmseg can also be used for mmdet, right? How about updating the weights information in the readme file in mmdet as well? Or update the information in the readme file which at the top level? It's maybe better for everyone. Thx~

from internvl-mmdetseg.

Dear dev, the model weights of mmseg can also be used for mmdet, right? How about updating the weights information in the readme file in mmdet as well? Or update the information in the readme file which at the top level? It's maybe better for everyone. Thx~

I mean download infomation.

Thanks for your advice~

from internvl-mmdetseg.