what is args-exclude1 and args-include1 about dlsrl HOT 3 CLOSED

exclude1 set to True means that the f1-score is calculated without words that were assigned to the label "1" (these are words that do not have argument labels in the data). Setting it to False is a more rigorous evaluation than setting it to True, because it requires the model to identify non-arguments correctly (in addition to identifying the labels for arguments correctly).

from dlsrl.

exclude1 set to True means that the f1-score is calculated without words that were assigned to the label "1" (these are words that do not have argument labels in the data). Setting it to False is a more rigorous evaluation than setting it to True, because it requires the model to identify non-arguments correctly (in addition to identifying the labels for arguments correctly).

thanks Philip 👍

from dlsrl.

The model is now evaluated with the official perl evaluation script provided by the conll05 shared task

from dlsrl.