wasiahmad / policyie Goto Github PK

hey guys, great work!
is it possible to provide the pre-trained models as well?

Hi,

Thank you for making the code for the paper available! I'm trying to replicate your experiments with BART, but when running your run.sh script I get the following scores:

***** Eval results *****
{
    "all_slot_f1": 2.51,
    "all_slot_precision": 2.51,
    "all_slot_recall": 2.51,
    "intent_f1": 65.51,
    "type_II_exact_match": 0.0,
    "type_II_slot_f1": 31.48,
    "type_II_slot_precision": 31.48,
    "type_II_slot_recall": 31.48,
    "type_I_exact_match": 0.0,
    "type_I_slot_f1": 5.29,
    "type_I_slot_precision": 5.29,
    "type_I_slot_recall": 5.29
}

Do you have any idea of what could be wrong here?

Note that I run prepare.sh in the bart directory, but the run.sh script wouldn't work because it looks for files like "test.target" in the bart/resources directory, but these files are not there. I just copied the corresponding files from data/s2s_format to bart/resources, is that correct?

Thanks!
Agostina

Hello, can you make your data set public