Comments (10)
KhaoticMind
commented on September 25, 2024
9
Found the issue (in my case).
For what I've read docker create new containers with a default image size of 10GB (https://docs.docker.com/v1.10/engine/reference/commandline/daemon/ , search for dm.basesize).
For what I get most distros already change it, but on my Gentoo system it is keeping the defaults.
What I did to fix the issue was to stop docker, clean /var/lib/docker/ (I'm running on a loopback device), start docker with the command:
docker daemon --storage-opt dm.basesize=40G
Stop it and restart the docker service as usual.
This fixed the issue for me, and a new docker pull kaggle/python finished without issues.
Not sure If you had to delete /var/lib/docker (I had nothing on it, so I decided to start clean anyway).
from docker-python.
nerdcha
commented on September 25, 2024
That error sounds puzzling, and frustrating. I haven't heard of it happening to anyone else, though, so I suspect it's going to be an issue for Docker rather than us.
My first suggestion would be to try pulling another large image, to figure out if the bug happens for all large ones or just this one.
Secondly, you could restart Docker in debug mode, so it outputs more verbose logs about what it's doing. You can do that via the daemon or IIRC by sticking a "-D" switch in /etc/default/docker. That might reveal that it's trying to write somewhere outside /var for something else weird like that.
Beyond that, my next suggestion would be to contact Docker's support. I'll keep the Issue open in case you need anything else from us, or if others want to chime in. Good luck!
from docker-python.
dsifford
commented on September 25, 2024
Wilco. Thanks -- I'll keep you posted if something turns up.
from docker-python.
dsifford
commented on September 25, 2024
Closing this issue. I unfortunately was not able to figure out why the build was failing, even after speaking with Docker support. I decided to just go with jupyter/datascience-notebook instead as that serves my needs.
Thanks
from docker-python.
KhaoticMind
commented on September 25, 2024
I'm having this same error :/
I tried pulling the images by parts, and the error happens when pulling python3 image.
Running docker on debug mode gives me this output (cut on the part that matters).
DEBU[0756] Downloaded c6d2443e2638 to tempfile /var/lib/docker/tmp/GetImageBlob289671022
DEBU[0756] pulling blob "sha256:4b3fb301ac5153c42468ee992a7e555741ac8a6eea9f8201353e7893a21079bb"
DEBU[0759] Increasing token expiration to: 60 seconds
DEBU[0765] Downloaded 4b3fb301ac51 to tempfile /var/lib/docker/tmp/GetImageBlob966782453
DEBU[0896] Downloaded ab3ce72e34fa to tempfile /var/lib/docker/tmp/GetImageBlob189660721
DEBU[0896] devmapper: AddDevice(hash=0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98 basehash=e893e0bd9d694597ee47d7d5ee644c854cce641b3d81a647cb0fc1eaf9c3685d)
DEBU[0896] devmapper: registerDevice(91, 0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98)
DEBU[0896] devmapper: AddDevice(hash=0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98 basehash=e893e0bd9d694597ee47d7d5ee644c854cce641b3d81a647cb0fc1eaf9c3685d) END
DEBU[0896] devmapper: activateDeviceIfNeeded(0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98)
DEBU[0896] Start untar layer
DEBU[0915] devmapper: UnmountDevice(hash=0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98)
DEBU[0915] devmapper: Unmount(/var/lib/docker/devicemapper/mnt/0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98)
DEBU[0916] devmapper: Unmount done
DEBU[0916] devmapper: deactivateDevice(0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98)
DEBU[0916] devmapper: removeDevice START(docker-8:6-22675468-0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98)
DEBU[0916] devmapper: removeDevice END(docker-8:6-22675468-0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98)
DEBU[0916] devmapper: deactivateDevice END(0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98)
DEBU[0916] devmapper: UnmountDevice(hash=0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98) END
DEBU[0916] Cleaning up layer 0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98: ApplyLayer exit status 1 stdout: stderr: write /usr/local/src/opencv/build/modules/core/perf_precomp.hpp.gch/opencv_perf_core_RELEASE.gch: no space left on device
DEBU[0916] devmapper: DeleteDevice(hash=0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98 syncDelete=false) START
DEBU[0916] devmapper: issueDiscard(device: 0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98). START
DEBU[0916] devmapper: activateDeviceIfNeeded(0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98)
DEBU[0918] devmapper: issueDiscard(device: 0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98). END
DEBU[0918] devmapper: deactivateDevice(0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98)
DEBU[0918] devmapper: removeDevice START(docker-8:6-22675468-0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98)
DEBU[0918] devmapper: removeDevice END(docker-8:6-22675468-0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98)
DEBU[0918] devmapper: deactivateDevice END(0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98)
DEBU[0918] devmapper: unregisterDevice(91, 0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98)
DEBU[0918] devmapper: DeleteDevice(hash=0d7e4d2a393befad976972d063e66bcda8a27171d12ef6f6e5b01c5418a77c98 syncDelete=false) END
As @dsifford I have plenty of space on my device.
I'll try building the images using the dockerfile and see what happens.
from docker-python.
ThomasDelteil
commented on September 25, 2024
Same error for me
ApplyLayer exit status 1 stdout: stderr: write /usr/local/src/opencv/build/modules/core/perf_precomp.hpp.gch/opencv_perf_core_RELEASE.gch: no space left on device
built from the Dockerfile and from pulling the image. Same error in both case
from docker-python.
ThomasDelteil
commented on September 25, 2024
Thanks it solved the problem indeed! 👍
from docker-python.
antgwms
commented on September 25, 2024
Thanks @KhaoticMind I had the same problem & just needed to restart docker 👍
from docker-python.
LN-Curiosity
commented on September 25, 2024
My storage-driver is overlay2.How can i set the parameter about size in the /etc/docker/daemon.json?
@KhaoticMind
from docker-python.
rushins
commented on September 25, 2024
hello i got the same issue , i created this file and added the value and restarted docker , however the problem persists . my docker is centos 7 . Any idea how to fix this.
more /etc/sysconfig/docker-storage
DOCKER_STORAGE_OPTIONS= "--storage-opt dm.basesize=60G"
from docker-python.
Related Issues (20)
- Please Install new package to be used in Kaggel Notebook HOT 1
- Ultralytics YOLOv8 Kaggle CPU notebook running deprecated Python 3.7 HOT 1
- v143 - GPU Latest, The latest update version upgrading CUDA seems to have caused many errors related to DeepSpeed
- CHAOS AT CURRENT CUDF WITH RAPIDS DRIVERS HOT 2
- update to glibc 2.35 0r 2.32
- Keras Issue for TensorFlow Hub model HOT 1
- Can't Install Krippendorff HOT 3
- Can't install vllm, llama.cpp
- NotFoundError: Graph execution error: TPU HOT 8
- Could not establish connection to "Kaggle"
- Not Able to run google generative ai models on kaggle notebook [bug] HOT 2
- CUML is broken on latest Kaggle environment (e.g. May 2024) HOT 8
- LightAutoML library in Kaggle Kernels HOT 4
- Masalah bug HOT 3
- RuntimeError: Expected is_sm80 || is_sm90 to be true, but got false. (Could this error message be improved? If so, please report an enhancement request to PyTorch.) HOT 2
- Can’t build a new image HOT 3
- RDKit library for chemical data processing HOT 4
- Issue Connecting Kaggle with Google Drive and Installing Ultralytics Library HOT 1
- Efficiently Setting Up Dependencies for Karpathy's llm.c on Kaggle: Seeking Guidance
- pillow needs to be updated to the latest version HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from docker-python.