Comments (9)
ebyrne
commented on May 30, 2024
1
Ah, that's the problem. You specified full-scale, not full_scale. See the warning above. (Will make that more explicit going forward.)
from ego4d.
ebyrne
commented on May 30, 2024
Have you setup your AWS key via aws configure? Can you please provide the steps and command used?
https://github.com/facebookresearch/Ego4d/blob/main/ego4d/cli/README.md
from ego4d.
ashantanu
commented on May 30, 2024
Getting the same error when trying to download full-scale dataset. I have setup my AWS key and have been able to download annotations and slowfast features. Moreover, when providing video_uids, I get
ERROR:root:ERROR: video_uids specified for non-video datasets (and will be ignored)
Appreciate the help, thanks!
from ego4d.
ebyrne
commented on May 30, 2024
Please provide the command and full output.
video_uids are only relevant for some datasets (full_scale in particular), you're using it for another dataset. Without the full command though, it's hard to say.
from ego4d.
ashantanu
commented on May 30, 2024
I am providing uids with full-scale, below is the command
python -m ego4d.cli.cli --output_directory="../ego4d_data" --datasets full-scale --video_uids 7bc80e9a-d235-4245-9876-9f414969b6d0 f8c36c51-1cca-4ed3-81db-c190b72d5c49
Output:
Warning: Non-standard Dataset Specfied (Allowed, will attempt download): ['full-scale']
datasets: ['full-scale']
ERROR:root:ERROR: video_uids specified for non-video datasets (and will be ignored)
Download Path: ../ego4d_data/v1
Ego4D Metadata: ../ego4d_data/ego4d.json
Checking requested datasets and versions...
Created download directory for version: 'v1' of dataset: 'full-scale' at:
../ego4d_data/v1/full-scale
Traceback (most recent call last):
File "/home/shantanuagar_umass_edu/miniconda3/lib/python3.9/runpy.py", line 197, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/home/shantanuagar_umass_edu/miniconda3/lib/python3.9/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/home/shantanuagar_umass_edu/Ego4d/ego4d/cli/cli.py", line 216, in <module>
main(config)
File "/home/shantanuagar_umass_edu/Ego4d/ego4d/cli/cli.py", line 101, in main
manifest_path = download_manifest_for_version(
File "/home/shantanuagar_umass_edu/Ego4d/ego4d/cli/manifest.py", line 149, in download_manifest_for_version
_manifest_object(version, dataset, s3).download_file(str(download_path))
File "/home/shantanuagar_umass_edu/miniconda3/lib/python3.9/site-packages/boto3-1.21.3-py3.9.egg/boto3/s3/inject.py", line 319, in object_download_file
return self.meta.client.download_file(
File "/home/shantanuagar_umass_edu/miniconda3/lib/python3.9/site-packages/boto3-1.21.3-py3.9.egg/boto3/s3/inject.py", line 173, in download_file
return transfer.download_file(
File "/home/shantanuagar_umass_edu/miniconda3/lib/python3.9/site-packages/boto3-1.21.3-py3.9.egg/boto3/s3/transfer.py", line 315, in download_file
future.result()
File "/home/shantanuagar_umass_edu/miniconda3/lib/python3.9/site-packages/s3transfer-0.5.1-py3.9.egg/s3transfer/futures.py", line 103, in result
return self._coordinator.result()
File "/home/shantanuagar_umass_edu/miniconda3/lib/python3.9/site-packages/s3transfer-0.5.1-py3.9.egg/s3transfer/futures.py", line 266, in result
raise self._exception
File "/home/shantanuagar_umass_edu/miniconda3/lib/python3.9/site-packages/s3transfer-0.5.1-py3.9.egg/s3transfer/tasks.py", line 269, in _main
self._submit(transfer_future=transfer_future, **kwargs)
File "/home/shantanuagar_umass_edu/miniconda3/lib/python3.9/site-packages/s3transfer-0.5.1-py3.9.egg/s3transfer/download.py", line 354, in _submit
response = client.head_object(
File "/home/shantanuagar_umass_edu/miniconda3/lib/python3.9/site-packages/botocore-1.24.3-py3.9.egg/botocore/client.py", line 391, in _api_call
return self._make_api_call(operation_name, kwargs)
File "/home/shantanuagar_umass_edu/miniconda3/lib/python3.9/site-packages/botocore-1.24.3-py3.9.egg/botocore/client.py", line 719, in _make_api_call
raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (403) when calling the HeadObject operation: Forbidden
from ego4d.
ashantanu
commented on May 30, 2024
I see. Can you please update the CLI Readme with this? I was following that for arguments. Thanks a lot!
from ego4d.
WikiChao
commented on May 30, 2024
Have you setup your AWS key via aws configure? Can you please provide the steps and command used?
https://github.com/facebookresearch/Ego4d/blob/main/ego4d/cli/README.md
Yes, this problem has been fixed by updating the configuration! But when I try to download a subset of Ego4d with command "python -m ego4d.cli.cli --output_directory="../ego4d_data" --datasets full_scale annotations --metadata --universities georgiatech", I get the following error:
Checking if latest file versions are already downloaded...
Traceback (most recent call last):
File "/home/cxu-serve/u1/chuang65/anaconda3/envs/ego4d/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/home/cxu-serve/u1/chuang65/anaconda3/envs/ego4d/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/home/cxu-serve/p1/chuang65/dataset/Ego4d/ego4d/cli/cli.py", line 220, in
main(config)
File "/home/cxu-serve/p1/chuang65/dataset/Ego4d/ego4d/cli/cli.py", line 136, in main
active_downloads = filter_already_downloaded(
TypeError: filter_already_downloaded() got an unexpected keyword argument 'bypass_check'
Since it's the first time I download the dataset, it should be no problem with "filter_already_downloaded()" function.
Looking forward to getting some suggestions. Appreciate the help, thanks!
from ego4d.
ebyrne
commented on May 30, 2024
You using a stale version of the CLI. (There was a bug introduced brielfy.) Please git pull
from ego4d.
WikiChao
commented on May 30, 2024
That solves my problem, thanks a lot!
from ego4d.
Related Issues (20)
- Missing audio data for some videos HOT 1
- Missing takes in relations benchmark HOT 1
- Issue submitting for license. HOT 5
- Quits when trying to download with CLI HOT 3
- Cannot submit the license agreement HOT 3
- License page failed HOT 1
- Project Website Down
- License page failed HOT 1
- Where is the narration of the dataset? HOT 1
- difference between expert_commentary proficiency_demonstration
- Why I set Access ID and Access Key for EgoExo4D but still can't download the hand pose datasets? HOT 2
- How to apply for the datasets in china HOT 2
- Ego4D Download Works, EgoExo Download Fails HOT 1
- Cannot download the "captures" part in ego-exo-4d HOT 5
- 3D scans
- "failed to fetch 61050 files [integrity=0, exceptions=61050]" for Ego-Exo4D HOT 1
- Visualization Tool's Semantic Search Does not Work
- Body pose looks misaligned in EgoExo4D HOT 5
- Binaural audio
- Only pose information loaded when choosing to download all the annotations of egoexo4d HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ego4d.