GPU Configuration for Training? about segvit HOT 4 CLOSED

Thank you so much for your great work. Could you please provide information about the number and type of GPUs you used for training the models?
a node of 4 A100.

from segvit.

Thank you for your response.
I've been going through your paper and noticed that you used a batch size of 16 for all models. But, when I checked the config files (segvit_vit-l_jax_640x640_160k_ade20k.py), it shows 2 samples per GPU. Given that I'm using 4 A100 GPUs, wouldn't that make the batch size 8?

I'm planning to reference your work and it'd be really helpful if I could get the exact configuration you used. Could you help me out with this?

Thanks in advance!

from segvit.

I believe it refers to a different dataset. In the original answer, we utilized a node with 4 A100 GPUs, with each GPU processing 4 samples in parallel on Pascal dataset due to a smaller crop size. However, if you are training a larger ViT model with a crop size of 640×640, you might require 8 A100 GPUs with 80GB memory, with each GPU handling 2 samples (as done in the current version of SegViT). For the upcoming version, SegViT v2, we will release the code that enables the use of a ViT base model, which will help reduce the cost of reproduction. This release will be available soon.

from segvit.

Thank you so much for your comprehensive response.

from segvit.