Missing s3 object (ignored for download): 1515/9670 about ego4d HOT 6 CLOSED

Please stand by. There's an error on our end for data access on a subset of the videos. We'll have it corrected shortly.

In the meantime, there shouldn't be any issues downloading the remainder and the annotations. Please proceed there!

Apologies for the rocky start!

from ego4d.

@v-iashin This should be resolved. Can you confirm?

from ego4d.

Hi, I was running into the same issue while trying to download clips. It has been resolved at my end (almost). There's just 1 file now which throws a Boto 403 Exception:

Boto 403 Exception For exists: 476870ad-d779-423d-86ec-b8c9c4c54df2 | 476870ad-d779-423d-86ec-b8c9c4c54df2.mp4
Missing s3 object (ignored for download): 476870ad-d779-423d-86ec-b8c9c4c54df2 | 476870ad-d779-423d-86ec-b8c9c4c54df2.mp4
ERROR:root:1/12285 missing S3 downloads will be ignored

from ego4d.

Yep, I think it is resolved. At least, it shows 9670/9670 as expected.

On a side note, I run the same command but it seems that it just starts it all over again. Would it be beneficial to add guidance on how to resume the download?

from ego4d.

@v-iashin Vladimir, had it finished the first time? It's on the list, but right now it only rights the version info once at the end - so if it fails or is killed for whatever reason, it won't have written it. (Should certainly be written incrementally given the download timing!)

Is that consistent with what you're seeing?

from ego4d.

Yes, it finished the first time but only those that were not missing.

I tried to run the same command again in the same folder and it seemed to start all over again. I did not check what it did specifically eg if the version was written.

I cannot check it anymore as I removed the ego4d_data folder already and started again.

from ego4d.