abort program aborting about mxfont HOT 4 CLOSED

The bug record

from mxfont.

This is not a bug but a typical unstable GAN training.
We have also often observed similar unstable training as well.

Although the loss is explored from INDP_FACT, we suspect that the unstable training is originated from "cross CE" which potentially increases the classifier weight values -- we couldn't test whether this is true due to the time limitation.
If you want to make your model more stable, then I suggest you remove the "cross CE" in the following lines:

• https://github.com/clovaai/mxfont/blob/main/trainer/fact_trainer.py#L250
• https://github.com/clovaai/mxfont/blob/main/trainer/fact_trainer.py#L265
  It will slightly reduce your final performances but may make the training stable. But, please note that we also don't have exact clue why the unstable training happens.

(+ In practice, we select the "last model" under stable loss values)

from mxfont.

Hi, sorry for the inconvenience.
You can exclude the cross CE loss by setting the weight of cross CE loss to zero.
It can be set by giving --ac_cross_w argument when running train.py like this:

python train.py cfgs/train.yaml --ac_cross_w 0.

from mxfont.

Closing the issue, assuming the answer resolves the problem.
Please re-open the issue as necessary.

from mxfont.