Giter VIP home page Giter VIP logo

default-binder's Introduction

Pangeo Gallery

Build and Deploy Website

Individual gallery repos are linked a submodules in the repos directory.

default-binder's People

Contributors

dependabot[bot] avatar rabernat avatar scottyhq avatar tomaugspurger avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

default-binder's Issues

Dask labextension does not work in latest images

Pasting the dashboard link into the Dask labextension dialog has no effect. It does not recognize the link, and none of the buttons become active. I have tried this on several recent

image

For example, here is a link for our classic example notebook using the latest commit of this repo (64d772a), which points to the latest pangeo-notebook docker image (c8c0d72).

https://binder.pangeo.io/v2/gh/pangeo-gallery/default-binder/64d772a/?urlpath=git-pull?repo=https://github.com/pangeo-gallery/physical-oceanography%26amp%3Burlpath=lab/tree/physical-oceanography/01_sea-surface-height.ipynb%3Fautodecode

What extra config are we missing to make the labextension work? It DOES work in https://us-central1-b.gcp.pangeo.io/, so something must be missing here. Something also must have changed since earlier versions, but I can't pinpoint the precise commit where things broke.

cc @scottyhq @TomAugspurger for any suggestions!

failing to start cluster using binder

When I run this notebook in the Pangeo default binder using

https://binder.pangeo.io/v2/gh/pangeo-gallery/default-binder/2020.10.10/?urlpath=git-pull?repo=https://github.com/ldeo-glaciology/pangeo-glaciology-examples.git%26amp%3Burlpath=lab/tree/pangeo-glaciology-examples.git/03_REMA.ipynb

it fails to open a cluster and says:

GatewayClusterError: Cluster 'prod.e8cbb9497deb4771b8fcdcffb50c19fd' failed to start, see logs for more information

(full error below)

I will share the logs if someone can give me a pointer to where to find these.

The notebook runs successfully on us-central1-b.gcp.pangeo.io with the smallest server.

Thanks for any help on this.

from dask.distributed import Client
import dask_gateway
gateway = dask_gateway.Gateway()
cluster = gateway.new_cluster()

---------------------------------------------------------------------------
GatewayClusterError                       Traceback (most recent call last)
<ipython-input-2-de2b60f93eb6> in <module>
      2 import dask_gateway
      3 gateway = dask_gateway.Gateway()
----> 4 cluster = gateway.new_cluster()

/srv/conda/envs/notebook/lib/python3.7/site-packages/dask_gateway/client.py in new_cluster(self, cluster_options, shutdown_on_close, **kwargs)
    641             cluster_options=cluster_options,
    642             shutdown_on_close=shutdown_on_close,
--> 643             **kwargs,
    644         )
    645 

/srv/conda/envs/notebook/lib/python3.7/site-packages/dask_gateway/client.py in __init__(self, address, proxy_address, public_address, auth, cluster_options, shutdown_on_close, asynchronous, loop, **kwargs)
    816             shutdown_on_close=shutdown_on_close,
    817             asynchronous=asynchronous,
--> 818             loop=loop,
    819         )
    820 

/srv/conda/envs/notebook/lib/python3.7/site-packages/dask_gateway/client.py in _init_internal(self, address, proxy_address, public_address, auth, cluster_options, cluster_kwargs, shutdown_on_close, asynchronous, loop, name)
    912             self.status = "starting"
    913         if not self.asynchronous:
--> 914             self.gateway.sync(self._start_internal)
    915 
    916     @property

/srv/conda/envs/notebook/lib/python3.7/site-packages/dask_gateway/client.py in sync(self, func, *args, **kwargs)
    337             )
    338             try:
--> 339                 return future.result()
    340             except BaseException:
    341                 future.cancel()

/srv/conda/envs/notebook/lib/python3.7/concurrent/futures/_base.py in result(self, timeout)
    433                 raise CancelledError()
    434             elif self._state == FINISHED:
--> 435                 return self.__get_result()
    436             else:
    437                 raise TimeoutError()

/srv/conda/envs/notebook/lib/python3.7/concurrent/futures/_base.py in __get_result(self)
    382     def __get_result(self):
    383         if self._exception:
--> 384             raise self._exception
    385         else:
    386             return self._result

/srv/conda/envs/notebook/lib/python3.7/site-packages/dask_gateway/client.py in _start_internal(self)
    926             self._start_task = asyncio.ensure_future(self._start_async())
    927         try:
--> 928             await self._start_task
    929         except BaseException:
    930             # On exception, cleanup

/srv/conda/envs/notebook/lib/python3.7/site-packages/dask_gateway/client.py in _start_async(self)
    944         # Connect to cluster
    945         try:
--> 946             report = await self.gateway._wait_for_start(self.name)
    947         except GatewayClusterError:
    948             raise

/srv/conda/envs/notebook/lib/python3.7/site-packages/dask_gateway/client.py in _wait_for_start(self, cluster_name)
    576                     raise GatewayClusterError(
    577                         "Cluster %r failed to start, see logs for "
--> 578                         "more information" % cluster_name
    579                     )
    580                 elif report.status is ClusterStatus.STOPPED:

GatewayClusterError: Cluster 'prod.e8cbb9497deb4771b8fcdcffb50c19fd' failed to start, see logs for more information

Auto layout jupyterlab workspace

In some setups (like dask-examples), we set up a jupyterlab workspace with the dask dashboard already open. Once a Client is created, the dashboard automatically lights up.

Do we want the same here?

I think it would involve copying a file like https://github.com/dask/dask-examples/blob/master/binder/jupyterlab-workspace.json and a start like https://github.com/dask/dask-examples/blob/master/binder/start.

@scottyhq this repo is using the pangeo/pangeo-notebook docker image. Can you confirm that if this repo had a binder/start, it wouldn't actually get executed? In order to do that we would need to change https://github.com/pangeo-data/pangeo-docker-images/tree/master/pangeo-notebook?

cc @cgentemann who raised this question in Gitter.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.