Giter VIP home page Giter VIP logo

spark-las-tests's People

Contributors

mbunel avatar

Stargazers

 avatar

Watchers

 avatar  avatar  avatar

Forkers

lcaraffa

spark-las-tests's Issues

No space left on device while building docker

Hi!
I achieve'nt to build the docker in the virtual machine where I cloned @MBunel 's repo.
There, docker-compose build didn't work.

That's why I ran:

docker build -t spark-las-tests:v3 .

My problem
I got the following error many minutes after running the command above:

Error: committing container for step 
{Env:[PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 
SHARED_WORKSPACE=/opt/workspace 
SPARK_HOME=/opt/spark 
SEDONA_HOME=/opt/sedona 
SPARK_MASTER_HOST=localhost 
SPARK_MASTER_PORT=7077 
PYTHONPATH=/opt/spark/python 
PYSPARK_PYTHON=python3 
PYSPARK_DRIVER_PYTHON=jupyter] 
Command:run Args:
[cd /opt/workspace     
&& git clone https://github.com/apache/sedona.git      
&& cd sedona/examples/spark-sql     
&& mvn clean package] Flags:[] Attrs:map[] Message:RUN cd /opt/workspace     
&& git clone https://github.com/apache/sedona.git      
&& cd sedona/examples/spark-sql     
&& mvn clean package Heredocs:[] Original:RUN cd /opt/workspace     
&& git clone https://github.com/apache/sedona.git      
&& cd sedona/examples/spark-sql     
&& mvn clean package}: copying layers and metadata for container "5488221dbdf403d34a99902d5dd9b70f7ef045e007efe1bcac344564998fa552": 
writing blob: adding layer with blob "sha256:c024e48e620dbeadd0b1464c9eded8c6b385fea99672a21cfc14102542e39bb7":
processing tar file(write /root/.m2/repository/javax/media/jai_core/1.1.3/jai_core-1.1.3.jar: no space left on device): exit status 1

First of all, I tried to remove every images visible running docker images in order to free some space in the disk (which is made
with only 20GB of system memory). Then I retry docker build -t spark-las-tests . but again it didn't work.

Finally, running docker images I got the following:

REPOSITORY                TAG         IMAGE ID      CREATED         SIZE
<none>                    <none>      a3e8b65b5a47  20 minutes ago  3.97 GB
<none>                    <none>      f9b812c832ee  33 minutes ago  3.99 GB
docker.io/apache/sedona   latest      8330c29145cc  8 hours ago     3.9 GB
<none>                    <none>      9908d58499be  19 hours ago    4.95 GB
docker.io/library/alpine  latest      1d34ffeaf190  3 weeks ago     8.08 MB

After that, I tried to remove all images to free as much space as possible and retry the command. This time, I got the following error:

[ERROR] Failed to execute goal on project sedona-spark-example: 
// a lot of package names
-> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
ERRO[0524] unable to cleanup run mounts error in copier subprocess: changing to intended-new-root directory "/home/almalinux/.local/share/containers/storage/overlay/64892821a8c9e9c631912edb846e6ce95c7e0bb633190e8dbbe055ffc3aa812d/merged": chdir /home/almalinux/.local/share/containers/storage/overlay/64892821a8c9e9c631912edb846e6ce95c7e0bb633190e8dbbe055ffc3aa812d/merged: no such file or directory 
ERRO[0524] error unmounting container: unmounting build container "07b7802b5b67e91ce2dc5d975b7541ff82e4d2f8c947bea286736ed5e2c503e5": layer not known 
ERRO[0524] error deleting build container "d5dd9f4071e51402fb18c1c4575fb992806d744f674a31bd46f2f1cfdbdb6cb2": identifier is not a container 
ERRO[0524] error deleting build container "bb059305856383b7e3da2af6071537f3c529a0f8a643fceb90c53b5be8599f69": identifier is not a container 
ERRO[0524] error deleting build container "0e86b778e1ab19bb1c35d2f6508e450537106f1f3c475f0cde2ecad3746034ed": identifier is not a container 
ERRO[0524] error deleting build container "cb0c96fedd7937f481a06583eec143dda1ea9d61566b1a98e3650076e050d768": identifier is not a container 
Error: identifier is not a container: building at STEP "RUN cd /opt/workspace     && git clone https://github.com/apache/sedona.git      && cd sedona/examples/spark-sql     && mvn clean package": while running runtime: exit status 1

Could you help me please ?
Thank you so much

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.