swathikirans / lsta Goto Github PK

I am very interested in your research and hope to get a more comprehensive code.

Hi @swathikirans

In EPIC-KITCHENS dataset, as you said in your paper, the outputs are verb and noun and activity class.

And in the GTEA61 dataset, I found the output are just activity class. In Table 1 of the Supplementary Document, you also evaluate the action and object separately in GTEA61 dataset. So could you please tell me how to split the action and object from activity class.

For example in GTEA61:

1. Activity: close_chocolate, Action: close, Object: chocolate
2. Activity: pour_ketchup, hotdog, bread , Action: pour, Object: ketchup, hotdog, bread

for multi-objects, how the network to output the different number of objects for different clips?

How will I have to arrange the dataset ?