How to evaluate？怎么样得到论文里的结果 about unilm HOT 3 CLOSED

There are two flags implemented for the purpose:

parser.add_argument("--save_best", action='store_true',
                    help="Save best epoch.")
parser.add_argument("--only_eval_best", action='store_true',
                    help="Only evaluate best epoch.")

We used --save_best on the dev set, and then added --only_eval_best for the final evaluation.

from unilm.

@donglixp Hi i am looking how to evaluate after using the decode code of s2sft or question generation on SQUAD ( I finetuned the model before)

from unilm.

@donglixp Hi i am looking how to evaluate after using the decode code of s2sft or question generation on SQUAD ( I finetuned the model before)

Please refer to https://github.com/microsoft/unilm/tree/master/unilm-v1#question-generation---squad for the evaluation of QG.

from unilm.