with masks test_canonical.sh report error : expected grid and input to have same batch size about codef HOT 11 CLOSED

same error

from codef.

Got same error

from codef.

same error

from codef.

Hi, sorry for the error. I have updated the mask preprocessing script here.

from codef.

Hi, sorry for the error. I have updated the mask preprocessing script here.

NO， Still have this problem,

from codef.

seems still doesn't work

from codef.

I think I have identified the issue. When using masks, multiple canonical images will be generated. Please verify the contents of your result folder after running ./scripts/test_multi.sh, you should find canonical_0.png and canonical_1.png files. Please ensure that all canonical images are placed in the base_control folder.

from codef.

I got canonical_0.png and canonical_1.png, so when I run test video translation step, I need translate both of them using text prompts?

from codef.

I think I have identified the issue. When using masks, multiple canonical images will be generated. Please verify the contents of your result folder after running ./scripts/test_multi.sh, you should find canonical_0.png and canonical_1.png files. Please ensure that all canonical images are placed in the base_control folder.

There will be two faces in the video

from codef.

I got canonical_0.png and canonical_1.png, so when I run test video translation step, I need translate both of them using text prompts?

It depends on your requirements. If you intend to transfer the entire video, you should transfer both canonical images. However, if you only wish to transfer the foreground of the video sequences, you will only need to transfer canonical_0.png.

from codef.

I got canonical_0.png and canonical_1.png, so when I run test video translation step, I need translate both of them using text prompts?

It depends on your requirements. If you intend to transfer the entire video, you should transfer both canonical images. However, if you only wish to transfer the foreground of the video sequences, you will only need to transfer canonical_0.png.

Hello，if I put the thranfered canonical images both "canonical_0_transfered.png" and "canonical_1_transfered.png" to the dir all_sequences/$NAME/$EXP_NAME_control. How will the program distinguish between foreground and background? Is it based on naming or can it be automatically recognized？

from codef.