AttributeError: 'IDisc' object has no attribute 'no_sync' about idisc HOT 2 CLOSED

Hi,

Firstly, thanks a lot for your wonderful work. I'm facing a problem when training the model with 4 GPUs. DataLoader worked well and I got a error like this:

Any suggestions will be appreciated!

Loaded 22441 images. Totally 717 invalid pairs are filtered Loaded 491 images. Totally 206 invalid pairs are filtered -> Local random sampler Start training: Loaded 22441 images. Totally 717 invalid pairs are filtered Loaded 491 images. Totally 206 invalid pairs are filtered -> Local random sampler Start training: Loaded 22441 images. Totally 717 invalid pairs are filtered Loaded 491 images. Totally 206 invalid pairs are filtered -> Local random sampler Start training: Loaded 22441 images. Totally 717 invalid pairs are filtered Loaded 491 images. Totally 206 invalid pairs are filtered -> Local random sampler Start training: Traceback (most recent call last): File "/project/6064028/tmp/code/idisc/scripts/train_DDP.py", line 288, in main_worker(config, args) File "/project/6064028/tmp/code/idisc/scripts/train_DDP.py", line 168, in main_worker with context as fp, model.no_sync() as no_sync: File "/project/6064028/tmp/idisc/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1269, in getattr raise AttributeError("'{}' object has no attribute '{}'".format( AttributeError: 'IDisc' object has no attribute 'no_sync' Traceback (most recent call last): File "/project/6064028/tmp/code/idisc/scripts/train_DDP.py", line 288, in main_worker(config, args) File "/project/6064028/tmp/code/idisc/scripts/train_DDP.py", line 168, in main_worker with context as fp, model.no_sync() as no_sync: File "/project/6064028/tmp/idisc/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1269, in getattr raise AttributeError("'{}' object has no attribute '{}'".format( AttributeError: 'IDisc' object has no attribute 'no_sync'

Hello, I have the same problem and would like to know how you solved it. Could you please tell me?

from idisc.

Hi,
Firstly, thanks a lot for your wonderful work. I'm facing a problem when training the model with 4 GPUs. DataLoader worked well and I got a error like this:
Any suggestions will be appreciated!
Loaded 22441 images. Totally 717 invalid pairs are filtered Loaded 491 images. Totally 206 invalid pairs are filtered -> Local random sampler Start training: Loaded 22441 images. Totally 717 invalid pairs are filtered Loaded 491 images. Totally 206 invalid pairs are filtered -> Local random sampler Start training: Loaded 22441 images. Totally 717 invalid pairs are filtered Loaded 491 images. Totally 206 invalid pairs are filtered -> Local random sampler Start training: Loaded 22441 images. Totally 717 invalid pairs are filtered Loaded 491 images. Totally 206 invalid pairs are filtered -> Local random sampler Start training: Traceback (most recent call last): File "/project/6064028/tmp/code/idisc/scripts/train_DDP.py", line 288, in main_worker(config, args) File "/project/6064028/tmp/code/idisc/scripts/train_DDP.py", line 168, in main_worker with context as fp, model.no_sync() as no_sync: File "/project/6064028/tmp/idisc/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1269, in getattr raise AttributeError("'{}' object has no attribute '{}'".format( AttributeError: 'IDisc' object has no attribute 'no_sync' Traceback (most recent call last): File "/project/6064028/tmp/code/idisc/scripts/train_DDP.py", line 288, in main_worker(config, args) File "/project/6064028/tmp/code/idisc/scripts/train_DDP.py", line 168, in main_worker with context as fp, model.no_sync() as no_sync: File "/project/6064028/tmp/idisc/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1269, in getattr raise AttributeError("'{}' object has no attribute '{}'".format( AttributeError: 'IDisc' object has no attribute 'no_sync'

Hello, I have the same problem and would like to know how you solved it. Could you please tell me?

I've solved this problem. This problem occurs when I don't use distributed training. The device I used is a single machine with multiple GPUs, and slurm is not installed. After I modified the code to DDP training without slurm, the code can work normally. If anyone encounters the same problem, you can refer to it.

from idisc.