source images contain not only the first image? about arldm HOT 8 CLOSED

While the second point can be different.
We using the 1st and 2nd raw images to properly generate 3nd image.

from arldm.

You can refer to the Section 3.2 and Figure 2.a of our paper. https://arxiv.org/abs/2211.10950

from arldm.

@KyonP yeah, this line provides all images to the model during training to perform teacher forcing

from arldm.

Oh, I see. 😄

So, when generating the 3rd image from the story sequence, ARLDM is given both 1st and 2nd raw (true) images?
(1st to 3rd raw images to generate 4th image?)

Assuming from your mentioned "teacher forcing," using the 1st and 2nd raw images to properly generate 2nd image, which is given to synthesize 3rd image.

Is my understanding correct?

from arldm.

@KyonP Yeah, exactly!

from arldm.

Thanks. 😅

So, during the generation of the 3rd image (in Figure 2.A), the 2nd raw image is given to the auto-regressive process (long arrow on the right-hand side) to force teaching?

Can you give me a link to where the teacher forcing occurring? Maybe within Unet?

BTW, thank you for your speedy reply, I didn't expect it 😄

from arldm.

@KyonP Yes. And the teacher forcing is implemented through attention mask.

from arldm.

thanks, I will look into it! 👍

from arldm.