Comments (8)
While the second point can be different.
We using the 1st and 2nd raw images to properly generate 3nd image.
from arldm.
You can refer to the Section 3.2 and Figure 2.a of our paper. https://arxiv.org/abs/2211.10950
from arldm.
@KyonP yeah, this line provides all images to the model during training to perform teacher forcing
from arldm.
Oh, I see. 😄
So, when generating the 3rd image from the story sequence, ARLDM is given both 1st and 2nd raw (true) images?
(1st to 3rd raw images to generate 4th image?)
Assuming from your mentioned "teacher forcing," using the 1st and 2nd raw images to properly generate 2nd image, which is given to synthesize 3rd image.
Is my understanding correct?
from arldm.
@KyonP Yeah, exactly!
from arldm.
Thanks. 😅
So, during the generation of the 3rd image (in Figure 2.A), the 2nd raw image is given to the auto-regressive process (long arrow on the right-hand side) to force teaching?
Can you give me a link to where the teacher forcing occurring? Maybe within Unet?
BTW, thank you for your speedy reply, I didn't expect it 😄
from arldm.
@KyonP Yes. And the teacher forcing is implemented through attention mask.
Lines 218 to 221 in 5b03fc4
Which is passed into Unet through:
Line 231 in 5b03fc4
from arldm.
thanks, I will look into it! 👍
from arldm.
Related Issues (20)
- About the image size HOT 8
- Error
- updating Stable Diffusion to 2.1? HOT 3
- Regarding the data of the VIST Dataset HOT 1
- Char-F1 and F-Acc score HOT 1
- is there anyone who runs the code in kaggle?
- StoryDALL-E results HOT 3
- Is the generation text guided? HOT 9
- Training issue. HOT 2
- Implementation about classifier free guidance HOT 8
- Adaptive AR-LDM
- How to scale the model parameters to fit into reasonable GPUs HOT 7
- Training Cannot Start HOT 1
- a problem about google drive
- hello
- License of the codebase
- stuck by hydra when running on slurm cluster HOT 1
- best fid score? HOT 47
- How long will the sample progress end? HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from arldm.