Giter VIP home page Giter VIP logo

nsidc-data-access-notebook's People

Contributors

asteiker avatar betolink avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

nsidc-data-access-notebook's Issues

capability url returns invalid request

I have a workflow to request subsetted ICESat-2 data based on this data access notebook. It worked until yesterday, but now the capability url returns an invalid request. The same thing happens when running this notebook in Binder, for all the data product short names that I have tried.

capability_url: https://n5eil02u.ecs.nsidc.org/egi/capabilities/ATL03.005.xml
response: <Response [400]> b'{"error":"invalid_request"}'

This triggers an error in the next line:

Traceback (most recent call last):

  File "/srv/conda/envs/notebook/lib/python3.7/site-packages/IPython/core/interactiveshell.py", line 3441, in run_code
    exec(code_obj, self.user_global_ns, self.user_ns)

  File "/tmp/ipykernel_168/938956396.py", line 13, in <module>
    root = ET.fromstring(response.content)

  File "/srv/conda/envs/notebook/lib/python3.7/xml/etree/ElementTree.py", line 1315, in XML
    parser.feed(text)

  File "<string>", line unknown
ParseError: not well-formed (invalid token): line 1, column 0

Any idea what the issue could be here?

Thanks,
Philipp

NameError: name 'Boundingshape' is not defined

When I run the notebook I get this error at the cell "Create the API endpoint":

NameError                                 Traceback (most recent call last)
~\AppData\Local\Temp\ipykernel_15140\1286720228.py in <module>
     22                   'time': time_var,
     23                   'polygon': polygon,
---> 24                   'Boundingshape': Boundingshape,
     25                   'format': reformat,
     26                   'projection': projection,

NameError: name 'Boundingshape' is not defined

The problem might be that I provided the area of interest with a shapefile, but in the 'subdict' object, the field 'spatialSubsettingShapefile' is listed as 'false'. 'temporalSubsetting' is also 'false' even though I provided dates.

This seems to result in Boundingshape never being defined in the block titled "Select subsetting, reformatting, and reprojection service options, if available." because the expected logical conditions are not met.

Here are the values for some of the variables in my workspace:

aoi = '2'
subdict = {
      'id': 'HEG',
       **'spatialSubsetting': 'true',**
       **'spatialSubsettingShapefile': 'false',**
       **'temporalSubsetting': 'false',**
       'type': 'both',
       'maxGransSyncRequest': '100',
       'maxGransAsyncRequest': '2000'
}

Relevant code block input and output below, and let me know if you need any more information:


Input short name, e.g. ATL03, here:  MOD10_L2
Input start date in yyyy-MM-dd format:  2022-05-29
Input start time in HH:mm:ss format:  14:00:00
Input end date in yyyy-MM-dd format:  2022-06-22
Input end time in HH:mm:ss format:  16:00:00

# Here I just used the default shapefile that came with the notebook
Simplified polygon coordinates based on shapefile input: -51.1203803853486,69.21453533085385,-51.25214005333067,69.18690191925793,-50.04906889941042,69.08708570400971,-48.98867272012586,68.86377341849372,-48.47406719345924,68.95294818787565,-48.22490237564403,69.07628146713546,-48.64390544471899,69.42180752487434,-49.07439704242353,69.52418890858146,-50.41130570916474,69.24203271223362,-51.1203803853486,69.21453533085385

There are 168 granules of MOD10_L2 version 61 over my area and time of interest.
The average size of each granule is 10.55 MB and the total size of all 168 granules is 1772.72 MB

These reformatting options are available: ['GeoTIFF']
If you would like to reformat, copy and paste the reformatting option you would like (make sure to omit quotes, e.g. GeoTIFF), otherwise leave blank. GeoTIFF

These reprojection options are available with your requested format: ['GEOGRAPHIC', 'UNIVERSAL TRANSVERSE MERCATOR', 'POLAR STEREOGRAPHIC', 'SINUSOIDAL']
If you would like to reproject, copy and paste the reprojection option you would like (make sure to omit quotes), otherwise leave blank. UNIVERSAL TRANSVERSE MERCATOR

Variable subsetting is available. Would you like to subset a selection of variables? (y/n) n

There will be 1 total order(s) processed for our MOD10_L2 request.

---------------------------------------------------------------------------
NameError                                 Traceback (most recent call last)
~\AppData\Local\Temp\ipykernel_5656\1286720228.py in <module>
     22                   'time': time_var,
     23                   'polygon': polygon,
---> 24                   'Boundingshape': Boundingshape,
     25                   'format': reformat,
     26                   'projection': projection,

NameError: name 'Boundingshape' is not defined

Tracking limits and cancelling orders

Thank you for your notebooks in navigating the NSIDC API.

I am downloading a lot of data and am wondering if there are ways to:

  1. Keep track of orders associated with my earthdata UID or a given token; if so, can I cancel previous orders?

  2. Track rate limits and order limits. Right now, experimenting with your notebook to download lots of data, I have already exceeded the limits. The async requests are indefinitely pending and the sync requests output the message Rejected request due to capacity limitations.

Download seems to be truncated

I am trying to download a year's worth of the 8-day MODIS10A data product (500-m Snow Cover) via this notebook. According to the Earthdata interface, I need 13367 granules, and the number of zip files with 2000 images each is calculated by the script to be 7 and 7 zip files are processed. However, when I look at the number of files produced, it's 4000. Is this a known problem?

Connection Issues

For the notebook provided, I am currently getting the following error quite frequently and cannot easily make get requests:

ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))

I get this when running the cell:

# Query service capability URL 

from xml.etree import ElementTree as ET

capability_url = f'https://n5eil02u.ecs.nsidc.org/egi/capabilities/{short_name}.{latest_version}.xml'

print(capability_url)
# Create session to store cookie and pass credentials to capabilities url

session = requests.session()
s = session.get(capability_url)
response = session.get(s.url,auth=(uid,pswd))

root = ET.fromstring(response.content)

Is this a maintenance issues? Or working remotely away from a NASA facility?

Hope you are all taking good care during these trying and scary times.

docker: Error response from daemon

once i quit the jupyter notebook i started in terminal with docker running, how could i start it again? i tried to follow the guidance again but i got an error like this:
docker: Error response from daemon: driver failed programming external connectivity on endpoint recursing_lovelace (283e0e1985b83cffb5615d65818f66c8f780f03c3fba00227e0c43a9bc5be5db): Error starting userland proxy: /forwards/expose/port returned unexpected status: 500.

KeyError:'token'

hello, i have correctly typed my username, password and email, but when i run the second code cell it got error as below:

KeyError                                  Traceback (most recent call last)
<ipython-input-18-37a76871ddd5> in <module>
     14 headers={'Accept': 'application/json'}
     15 response = requests.post(token_api_url, json=data, headers=headers)
---> 16 token = json.loads(response.content)['token']['id']
     17 print(token)

KeyError: 'token'

Is there any solutions?thank you!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.