Launching Binder is _really_ slow. about reciprocalspaceship HOT 10 CLOSED

Here's a webpage with some suggestions: https://discourse.jupyter.org/t/how-to-reduce-mybinder-org-repository-startup-time/4956

I can certainly take care of making another extras_require entry in the setup.py for handling only additional packages needed for the examples. That may speed things up a bit, but @ianhi may have some other ideas -- he set up binder in the first place.

from reciprocalspaceship.

Going through the examples, I have tabulated the dependencies we actually import:

• reciprocalspaceship
• matplotlib
• seaborn
• numpy
• tqdm
• celluloid
• IPython (from IPython.disaply import HTML, Image)
• pandas
• gemmi
• PyTorch (only in example 3)

Maybe we can make some sort of .yml file with these specific dependencies and test out the launch time? I'm looking at you, @ianhi.

from reciprocalspaceship.

yeah -- I can split the [dev] dependencies between documentation / examples so that we only install the necessary ones in this context.

However, I think the main issue here is cacheing -- binder is very slow when something hasn't been set up in a while, but quite fast if it has been. I'm guessing because you just accessed it, it just loaded in ~5 seconds for me.

from reciprocalspaceship.

Yes, it is definitely zippy after the first run, but i think we should be able to pare down the initial build to <60s.

from reciprocalspaceship.

(based on other repos I've sampled).

from reciprocalspaceship.

Anyway --- this is outside my wheelhouse, but I figured it merited an issue.

from reciprocalspaceship.

I've made the simple changes that make sense. It's still not a "fast" build for the docker image, but I do think it's faster than it was. Feel free to close the issue if this seems to have improved things enough.

from reciprocalspaceship.

It's much faster now. Thanks!

from reciprocalspaceship.

This can be improved further by installing all the dependencies using mamba and then only using postBuild to install reciprocalspaceship

from reciprocalspaceship.

basically need an environment.yml file in the .binder or binder folder like here: https://github.com/jupyterlab-contrib/jupyterlab-vim/tree/master/binder

then binder will use mamba by default i think.

from reciprocalspaceship.