Comments (2)
This is documentation of a discussion in #aut slack.
The aligned Altiscale versions (below) require the master version (currently 0.9.0-SNAPSHOT) of Spark Notebook which has removed the :cp
and :dp
commands. We previously made use of them to load the aut
jar. I have attempted to make use of the ADD_JARS
and EXTRA_CLASSPATH
environment variables, as well use a custom configured profile
. These efforts were fruitless. See also these GitHub issues: spark-notebook/spark-notebook#702, spark-notebook/spark-notebook#674
HADOOP_VERSION=2.7.3
NOTEBOOK_VERSION=master
SCALA_VERSION=2.11.8
SPARK_VERSION=2.1.1
As per consensus in slack, we'll be using the following versions of Spark Notebook, Scala, Spark, and Hadoop because of the above.
HADOOP_VERSION=2.6.5
NOTEBOOK_VERSION=0.7.0-pre2
SCALA_VERSION=2.11.7
SPARK_VERSION=1.6.3
from docker-aut.
Resolved with:
from docker-aut.
Related Issues (18)
- warcbase won't build HOT 1
- Spark Notebook - 0.11.0 HOT 4
- org.apache.hadoop#hadoop-core;0.20.2-cdh3u4: not found HOT 2
- aut build fails on master HOT 4
- unable to run docker image HOT 4
- Update 0.16.0 to use Apache Spark 2.1.3
- Unable to run docker-aut:0.18.0 HOT 5
- Build error HOT 5
- Change master branch to main branch HOT 1
- Update dockerhub image to 0.90.5 HOT 2
- Mac OS: build fails with out-of-memory error HOT 11
- Port is wrong for spark notebook
- Spark Notebook crashes when loading warcbase HOT 3
- CONTRIBUTING.md HOT 3
- Update Lesson Plan to reflect changes made by #6 being merged HOT 3
- Add Azure Provider HOT 2
- Update lesson plan for use with Docker HOT 13
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from docker-aut.