Comments (3)
Answer generated by a 🤖
Answer
I understand that you're encountering an issue when trying to build Dockerfile.jupyter
for sparkmagic. The error message indicates that the jupyter-nbextension
command is not found. This is likely due to the removal of this command in version 7.0.0 of the notebook
package, as you've correctly identified.
To address this issue, one potential solution is to downgrade the notebook
package to version 6.5.5 in the Dockerfile. This can be done by adding a line to install this specific version before the jupyter nbextension enable --py --sys-prefix widgetsnbextension
command is run.
However, please note that the requirements.txt
file of sparkmagic specifies notebook>=4.2
, which means it requires at least version 4.2 of notebook
. Downgrading to version 6.5.5 could potentially cause conflicts if other parts of the application rely on features introduced in versions later than 6.5.5.
Here's how you can modify the Dockerfile:
# Add this line before the jupyter nbextension enable command
RUN pip install notebook==6.5.5
This should allow the Docker image to be built successfully. However, I would recommend checking if this change causes any other issues in your application due to the notebook>=4.2
requirement in requirements.txt
.
If you find this solution to be correct and believe that this is a bug that could impact other users, I encourage you to make a pull request with the necessary changes to the Dockerfile.
If this solution does not align with your experience, or if you encounter any other issues, I would suggest upgrading to the latest version of sparkmagic and trying again.
Sources
This response is meant to be useful, save you time, and share context. It is not meant to be a precise solution, but rather a starting point for your own research.
Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.
from sparkmagic.
I may have found the issue while trying to run a sparkmagic-powered Jupyter notebook (on my machine, not in a docker container). The jump to notebook
7.0.0 has introduced major changes to Jupyter's API, including the removal of the jupyter-nbextension
command. Downgrading to notebook
6.5.5 fixed the issue for me.
from sparkmagic.
@agrounds Thanks for reporting this and finding a workaround 🙌
from sparkmagic.
Related Issues (20)
- Plotly scala HOT 6
- Publish sparkmagic Docker images regularly HOT 1
- Run Tests Nightly to Catch Upstream Dependency Issues Earlier
- [BUG] Sparkmagic errors out using iPython 7.33.0 HOT 1
- pip deprecation warning when installing hdijupyterutils and autovizwidget HOT 1
- [QST] How to automatically load sparkmagic.magics when open a new ipython kernel tab HOT 1
- Document extending SparkMagic HOT 2
- how to pass python variable to %%sql cell ?
- [BUG] Default Docker container got broken HOT 4
- Support >= Pandas 2.0.0 HOT 6
- [BUG] error when first client connects HOT 1
- Jupyterlab 4.0.2 python 3.10 HOT 1
- [BUG] SparkMagic pyspark kernel magic(%%sql) hangs when running with Papermill. HOT 18
- Use variables in %%configure HOT 4
- [BUG] %%send-to-spark fails for dataframes with '\n' or ' characters HOT 2
- [BUG] launcher issue using jupyterlab 3.6.3 / sparkmagic 0.21.0 HOT 5
- Support notebook >= 7 HOT 1
- Does sparkmagic support dual scala/python spark session? HOT 3
- [BUG] spark magic cannot be installed on python3.11 HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sparkmagic.