How to train the transformer after training the vqgan model？ about taming-transformers HOT 9 CLOSED

The transformer and gan are trained at the same time.

then how could i use the transformer & gan to generate a image?

you could check out the colab link in readme.

from taming-transformers.

The transformer and gan are trained at the same time.

the 'custom_vqgan.yaml' load the model 'taming.models.vqgan.VQModel', without 'Net2NetTransformer', why transformer is trained at the same time?

from taming-transformers.

i did it by writing a transformer yaml file based on my custom vqgan model.

from taming-transformers.

The transformer and gan are trained at the same time.

then how could i use the transformer & gan to generate a image?

from taming-transformers.

The transformer and gan are trained at the same time.

the 'custom_vqgan.yaml' load the model 'taming.models.vqgan.VQModel', without 'Net2NetTransformer', why transformer is trained at the same time?

So if I want to use my custom data to train using the source code of this project, then I can only train the VQGAN network without the transformer, right? And I can only do image reconstruction and not image generation, is that true?

from taming-transformers.

The transformer and gan are trained at the same time.

the 'custom_vqgan.yaml' load the model 'taming.models.vqgan.VQModel', without 'Net2NetTransformer', why transformer is trained at the same time?

So if I want to use my custom data to train using the source code of this project, then I can only train the VQGAN network without the transformer, right? And I can only do image reconstruction and not image generation, is that true?

VQGAN have two stages, first stage is encoder and decoder, second stage is transformer and decoder for generation, so if you do image reconstruction, i think it's same as vqvae.

from taming-transformers.

我通过编写一个基于我的自定义 VQGAN 模型的 transformer YAML 文件来做到这一点。

@RichardXue123 I would like to see your customized YAML file, can I

from taming-transformers.

我通过编写一个基于我的自定义 VQGAN 模型的 transformer YAML 文件来做到这一点。

@RichardXue123 I would like to see your customized YAML file, can I

custom_transformer.txt

from taming-transformers.

我通过编写一个基于我的自定义 VQGAN 模型的 transformer YAML 文件来做到这一点。

我想看看你定制的YAML文件，我可以吗

custom_transformer.txt

@RichardXue123 thank you very much

from taming-transformers.