Comments (7)
-
Because StarGAN-v2 uses L1 norm for the reconstruction loss. I think that other works that use L1 or L2 norms might be cited in the same line.
-
Well... I think it is not an issue related to the training scheme or objectives if the results at the very last iteration look good. I mean L1 loss does not a problem but the issue might be related to the inference.
It might be ...
i) The checkpoint is not properly loaded (especially batch normalization layer)
ii) The images are not properly processed as the training phase (e.g. resizing size, normalization ... )
from tunit.
-
Because StarGAN-v2 uses L1 norm for the reconstruction loss. I think that other works that use L1 or L2 norms might be cited in the same line.
Are you talking about the style reconstruction loss used in StarGAN-v2? If yes then if we use Style reconstruction loss in TUNIT as a replacement to G's style contrastive loss what behavior do you expect? (Will it have the same problem I am facing? as you mentioned in the paper "By doing so, we avoid the degenerated solution where the encoder
maps all the images to the same style code of the reconstruction loss [5] based on L1 or L2 norm." ) -
Actually my inference looks fine
a) style encoder gives around 99% testing accuracy on the classification task when loaded from the checkpoints
b) images are perfectly processed. :)
from tunit.
@FriedRonaldo BTW the quality of the generated samples at inference are great they only lack the style 😄
from tunit.
-
Yes, the style reconstruction loss. In many cases, the results will be similar because the optimization does not always reach a degenerated solution but the contrastive-based loss can avoid the degenerated solution.
-
I might not understand the issue exactly before. You mean, the outputs reflect the style image very well (If you use a black cat as a style image, then, is the output a black cat?) but the style codes from the different images are the same point. Is it right? The scenario sounds very weird.
After BTW the quality of the generated samples at inference are great they only lack the style
The meaning of "if the results at the very last iteration look good" is not just about the quality but how well the samples reflect the style images.
If you use a black cat as a style image, then, is the output a black cat?
If yes in the training and if not in the inference, more information should be provided to diagnose the issue. Blind diagnosis is somewhat difficult...
from tunit.
Sorry for causing some confusions.
If you use a black cat as a style image, then, is the output a black cat?
Yes (only in training but not inference). As you mentioned during the later iterations of training phase the output reflects the black cat. However during inference the style codes from the different images map to the same point.
I did an experiment where I overfit the model during testing i.e. gave the model a seen content and seen style image which it perfectly generated during training, but surprisingly it failed during inference as well i.e. style code doesn't match the style image however the content is fine.
If yes in the training and if not in the inference, more information should be provided to diagnose the issue. Blind diagnosis is somewhat difficult
Could you please let me know what information should I provide you?
from tunit.
In this case, the problem is just about the inference, so using the style contrastive loss does not solve the problem.
In my experience, there is an issue in the batch normalization layer and if I use "eval()", the model does not work, but without it, the model works well. It might be related to the normalization layer. Or EMA might raise the problems. I recommand to use the generator that is non-EMA version.
Because it is not related to our source code, I am sorry for that I can not help you more.
from tunit.
@FriedRonaldo Thank you for helping me this far and giving some ideas. I will try with your feedback hopefully I can resolve it.
from tunit.
Related Issues (20)
- OOM of training summer2winter HOT 6
- Why the argumentation transform of the orginal image contains colorjitter HOT 6
- Seek the AnimalFaces Dataset HOT 2
- question about the animal faces dataset HOT 1
- FFHQ: IndexError list index out of range HOT 4
- Training on non-square images HOT 1
- It looks like the requirements.txt file needs to be modified. HOT 1
- About custom dataset HOT 1
- afhq dataset error HOT 11
- Validation Error? HOT 8
- About Food-10 dataset settings HOT 5
- Average style vectors? HOT 2
- Why updating the gradients of the guiding network C while training G? HOT 2
- Can TUNIT do few-shot generation? HOT 4
- Training Discriminator vs Generator in TUNIT HOT 2
- pretarined food10 weights HOT 5
- I trained to 65 epochs and found an error:“fid_ema, fid_ema_mean is not defined” HOT 9
- FFHQ results HOT 1
- Own Dataset HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tunit.