mbunel / spark-las-tests Goto Github PK
View Code? Open in Web Editor NEWA experimental las reader for spark
A experimental las reader for spark
Hi!
I achieve'nt to build the docker in the virtual machine where I cloned @MBunel 's repo.
There, docker-compose build
didn't work.
That's why I ran:
docker build -t spark-las-tests:v3 .
My problem
I got the following error many minutes after running the command above:
Error: committing container for step
{Env:[PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
SHARED_WORKSPACE=/opt/workspace
SPARK_HOME=/opt/spark
SEDONA_HOME=/opt/sedona
SPARK_MASTER_HOST=localhost
SPARK_MASTER_PORT=7077
PYTHONPATH=/opt/spark/python
PYSPARK_PYTHON=python3
PYSPARK_DRIVER_PYTHON=jupyter]
Command:run Args:
[cd /opt/workspace
&& git clone https://github.com/apache/sedona.git
&& cd sedona/examples/spark-sql
&& mvn clean package] Flags:[] Attrs:map[] Message:RUN cd /opt/workspace
&& git clone https://github.com/apache/sedona.git
&& cd sedona/examples/spark-sql
&& mvn clean package Heredocs:[] Original:RUN cd /opt/workspace
&& git clone https://github.com/apache/sedona.git
&& cd sedona/examples/spark-sql
&& mvn clean package}: copying layers and metadata for container "5488221dbdf403d34a99902d5dd9b70f7ef045e007efe1bcac344564998fa552":
writing blob: adding layer with blob "sha256:c024e48e620dbeadd0b1464c9eded8c6b385fea99672a21cfc14102542e39bb7":
processing tar file(write /root/.m2/repository/javax/media/jai_core/1.1.3/jai_core-1.1.3.jar: no space left on device): exit status 1
First of all, I tried to remove every images visible running docker images
in order to free some space in the disk (which is made
with only 20GB of system memory). Then I retry docker build -t spark-las-tests .
but again it didn't work.
Finally, running docker images
I got the following:
REPOSITORY TAG IMAGE ID CREATED SIZE
<none> <none> a3e8b65b5a47 20 minutes ago 3.97 GB
<none> <none> f9b812c832ee 33 minutes ago 3.99 GB
docker.io/apache/sedona latest 8330c29145cc 8 hours ago 3.9 GB
<none> <none> 9908d58499be 19 hours ago 4.95 GB
docker.io/library/alpine latest 1d34ffeaf190 3 weeks ago 8.08 MB
After that, I tried to remove all images to free as much space as possible and retry the command. This time, I got the following error:
[ERROR] Failed to execute goal on project sedona-spark-example:
// a lot of package names
-> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
ERRO[0524] unable to cleanup run mounts error in copier subprocess: changing to intended-new-root directory "/home/almalinux/.local/share/containers/storage/overlay/64892821a8c9e9c631912edb846e6ce95c7e0bb633190e8dbbe055ffc3aa812d/merged": chdir /home/almalinux/.local/share/containers/storage/overlay/64892821a8c9e9c631912edb846e6ce95c7e0bb633190e8dbbe055ffc3aa812d/merged: no such file or directory
ERRO[0524] error unmounting container: unmounting build container "07b7802b5b67e91ce2dc5d975b7541ff82e4d2f8c947bea286736ed5e2c503e5": layer not known
ERRO[0524] error deleting build container "d5dd9f4071e51402fb18c1c4575fb992806d744f674a31bd46f2f1cfdbdb6cb2": identifier is not a container
ERRO[0524] error deleting build container "bb059305856383b7e3da2af6071537f3c529a0f8a643fceb90c53b5be8599f69": identifier is not a container
ERRO[0524] error deleting build container "0e86b778e1ab19bb1c35d2f6508e450537106f1f3c475f0cde2ecad3746034ed": identifier is not a container
ERRO[0524] error deleting build container "cb0c96fedd7937f481a06583eec143dda1ea9d61566b1a98e3650076e050d768": identifier is not a container
Error: identifier is not a container: building at STEP "RUN cd /opt/workspace && git clone https://github.com/apache/sedona.git && cd sedona/examples/spark-sql && mvn clean package": while running runtime: exit status 1
Could you help me please ?
Thank you so much
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.