Deion After pulling an image, it disappears from the docker

Docker image not visible after pull about moby HOT 3 CLOSED

DemonRx commented on June 14, 2024

Docker image not visible after pull

from moby.

Comments (3)

DemonRx commented on June 14, 2024

I enabled debug mode for docker daemon. Here is the output from the moment of running docker pull until the image is deleted`:

Dec 23 02:35:21 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:21.051095324Z" level=debug msg="Calling HEAD /_ping"
Dec 23 02:35:21 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:21.052211215Z" level=debug msg="Calling GET /v1.43/images/json"
Dec 23 02:35:22 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:22.231912737Z" level=debug msg="Calling HEAD /_ping"
Dec 23 02:35:22 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:22.233213004Z" level=debug msg="Calling POST /v1.43/images/create?fromImage=europe-docker.pkg.dev%2Fpryzm-zone%2Fcore%2Fpryzm-feeder&tag=0.3.4"
Dec 23 02:35:22 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:22.243092445Z" level=debug msg="hostDir: /etc/docker/certs.d/europe-docker.pkg.dev"
Dec 23 02:35:22 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:22.243181733Z" level=debug msg="Trying to pull europe-docker.pkg.dev/pryzm-zone/core/pryzm-feeder from https://europe-docker.pkg.dev"
Dec 23 02:35:22 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:22.700832510Z" level=debug msg="Calling HEAD /_ping"
Dec 23 02:35:22 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:22.702181670Z" level=debug msg="Calling GET /v1.43/images/json"
Dec 23 02:35:22 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:22.862810920Z" level=debug msg="Calling HEAD /_ping"
Dec 23 02:35:22 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:22.864585606Z" level=debug msg="Calling GET /v1.43/containers/json"
Dec 23 02:35:22 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:22.966066095Z" level=debug msg="Calling HEAD /_ping"
Dec 23 02:35:22 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:22.968345825Z" level=debug msg="Calling GET /v1.43/images/json"
Dec 23 02:35:24 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:24.550751828Z" level=debug msg="Pulling ref from V2 registry: europe-docker.pkg.dev/pryzm-zone/core/pryzm-feeder:0.3.4"
Dec 23 02:35:24 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:24.553171533Z" level=debug msg="pulling blob \"sha256:c926b61bad3b94ae7351bafd0c184c159ebf0643b085f7ef1d47ecdc7316833c\""
Dec 23 02:35:24 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:24.553573380Z" level=debug msg="pulling blob \"sha256:de40ff149872bcfe878807a4c0384e83da9f46336e9835dd95a6f551fdd053d3\""
Dec 23 02:35:24 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:24.553994150Z" level=debug msg="pulling blob \"sha256:a114a1346b47dc114084ddcf653e9f6b59e829231f3716be236e31948fa18cd7\""
Dec 23 02:35:25 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:25.406405442Z" level=debug msg="Downloaded a114a1346b47 to tempfile /var/lib/docker/tmp/GetImageBlob3272888107"
Dec 23 02:35:25 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:25.406592959Z" level=debug msg="pulling blob \"sha256:2766e70636b24258799225c453edc165d8709cb5efb5051f1b7f157f369ff553\""
Dec 23 02:35:26 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:26.982293843Z" level=debug msg="Downloaded c926b61bad3b to tempfile /var/lib/docker/tmp/GetImageBlob1177539249"
Dec 23 02:35:26 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:26.982561686Z" level=debug msg="pulling blob \"sha256:a50b37927d7a6ff0c264116876ed18fab3fa35ea1b785dd8365eeb96dcc78868\""
Dec 23 02:35:26 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:26.983266152Z" level=debug msg="Using /usr/bin/unpigz to decompress"
Dec 23 02:35:26 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:26.994008889Z" level=debug msg="Applying tar in /var/lib/docker/overlay2/65653a209505221e6ab914c83761fcd30f1784f554289c4086c9cb17a62fa767/diff" storage-driver=overlay2
Dec 23 02:35:27 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:27.196736933Z" level=debug msg="Downloaded 2766e70636b2 to tempfile /var/lib/docker/tmp/GetImageBlob2437609255"
Dec 23 02:35:27 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:27.196894171Z" level=debug msg="pulling blob \"sha256:9ddfdaf4d5e9d308bb194f3346ad3f9467867da8d1f4d2cfda2f9d2abf6929a6\""
Dec 23 02:35:27 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:27.318467029Z" level=debug msg="Applied tar sha256:9fe9a137fd002363ac64f5af66146702432b638a83ee0c5b620c40a9e433e813 to 65653a209505221e6ab914c83761fcd30f1784f554289c4086c9cb17a62fa767, size: 7339459"
Dec 23 02:35:28 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:28.049655594Z" level=debug msg="Downloaded 9ddfdaf4d5e9 to tempfile /var/lib/docker/tmp/GetImageBlob2338164095"
Dec 23 02:35:30 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:30.616550121Z" level=debug msg="Downloaded de40ff149872 to tempfile /var/lib/docker/tmp/GetImageBlob4164803"
Dec 23 02:35:30 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:30.616888736Z" level=debug msg="Using /usr/bin/unpigz to decompress"
Dec 23 02:35:30 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:30.631213707Z" level=debug msg="Applying tar in /var/lib/docker/overlay2/d8140f40d189584163218c2b090e34cee906893cfe406ac607a830d57d61b51f/diff" storage-driver=overlay2
Dec 23 02:35:31 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:31.628780664Z" level=debug msg="Applied tar sha256:e6bdb75f3978099b3de69bd7ad91787c774b2ec100ccad43890b31bc670eb0a1 to d8140f40d189584163218c2b090e34cee906893cfe406ac607a830d57d61b51f, size: 53647962"
Dec 23 02:35:31 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:31.656441411Z" level=debug msg="Using /usr/bin/unpigz to decompress"
Dec 23 02:35:31 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:31.674868608Z" level=debug msg="Applying tar in /var/lib/docker/overlay2/3d31a1e67ff8cbb4359f0aa94cb88e8ebad3d1222f93f53be985910ae72947e0/diff" storage-driver=overlay2
Dec 23 02:35:31 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:31.680202596Z" level=debug msg="Applied tar sha256:1a25e1490d013d950220965821355a4ad16387facecffa5b1bed9d37b06ea2cc to 3d31a1e67ff8cbb4359f0aa94cb88e8ebad3d1222f93f53be985910ae72947e0, size: 0"
Dec 23 02:35:31 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:31.702302470Z" level=debug msg="Using /usr/bin/unpigz to decompress"
Dec 23 02:35:31 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:31.712506080Z" level=debug msg="Applying tar in /var/lib/docker/overlay2/842927af8b15c5fc5e45ff22a7422f39caca5d3a639d03dca9b2fa80d25f5b67/diff" storage-driver=overlay2
Dec 23 02:35:31 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:31.763789890Z" level=debug msg="Applied tar sha256:cc860346a78085cf8d4f524cfb1befed12e811d8c590d83f1a7c8267847b6c01 to 842927af8b15c5fc5e45ff22a7422f39caca5d3a639d03dca9b2fa80d25f5b67, size: 186606"
Dec 23 02:35:31 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:31.788547480Z" level=debug msg="Downloaded a50b37927d7a to tempfile /var/lib/docker/tmp/GetImageBlob1485849952"
Dec 23 02:35:31 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:31.788888501Z" level=debug msg="Using /usr/bin/unpigz to decompress"
Dec 23 02:35:31 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:31.801063351Z" level=debug msg="Applying tar in /var/lib/docker/overlay2/9cdc78e82272c30e273b8f2439562c6779c7a44cc07db717fdb470058c65110d/diff" storage-driver=overlay2
Dec 23 02:35:37 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:37.962901808Z" level=debug msg="Calling HEAD /_ping"
Dec 23 02:35:37 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:37.964781483Z" level=debug msg="Calling GET /v1.43/containers/json"
Dec 23 02:35:42 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:42.378515981Z" level=debug msg="Applied tar sha256:f4d6068dca64183220f0cc5b326a1342048ce1237f18c2fff9663c0f6e6f27f7 to 9cdc78e82272c30e273b8f2439562c6779c7a44cc07db717fdb470058c65110d, size: 113231166"
Dec 23 02:35:42 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:42.434498464Z" level=debug msg="Using /usr/bin/unpigz to decompress"
Dec 23 02:35:42 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:42.448191321Z" level=debug msg="Applying tar in /var/lib/docker/overlay2/27ba2e971d988e7199d756612ec464ff743eecc9ab0c89daada9e3f96b28e6f1/diff" storage-driver=overlay2
Dec 23 02:35:42 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:42.454875675Z" level=debug msg="Applied tar sha256:86e73ef947410f44921e824b88bcf834c4f57ddf4349c51a49ea6cb7c4db238d to 27ba2e971d988e7199d756612ec464ff743eecc9ab0c89daada9e3f96b28e6f1, size: 2075"
Dec 23 02:35:42 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:42.492866612Z" level=debug msg="Adding content digest to lease" digest="sha256:a73f38e34f372d31f6478ad9036fd2e5a991e1d1f0cfcfd07d949b2aa78f880d" lease="moby-image-sha256:c23020b68adf3db977e45aebdc07af960721c2158e72e7bb6bb6b61941234df9" remote="europe-docker.pkg.dev/pryzm-zone/core/pryzm-feeder:0.3.4"
Dec 23 02:35:53 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:53.031936167Z" level=debug msg="Calling HEAD /_ping"
Dec 23 02:35:53 ai-demon-io dockerd[1421861]: time="2023-12-23T02:35:53.034042379Z" level=debug msg="Calling GET /v1.43/containers/json"
Dec 23 02:36:08 ai-demon-io dockerd[1421861]: time="2023-12-23T02:36:08.214402055Z" level=debug msg="Calling HEAD /_ping"
Dec 23 02:36:08 ai-demon-io dockerd[1421861]: time="2023-12-23T02:36:08.216239585Z" level=debug msg="Calling GET /v1.43/containers/json"
Dec 23 02:36:12 ai-demon-io dockerd[1421861]: time="2023-12-23T02:36:12.457370207Z" level=debug msg="Calling HEAD /_ping"
Dec 23 02:36:12 ai-demon-io dockerd[1421861]: time="2023-12-23T02:36:12.458770305Z" level=debug msg="Calling GET /v1.43/images/json?filters=%7B%22reference%22%3A%7B%22ionetcontainers%2Fio-worker-monitor%22%3Atrue%7D%7D"
Dec 23 02:36:12 ai-demon-io dockerd[1421861]: time="2023-12-23T02:36:12.528139168Z" level=debug msg="Calling HEAD /_ping"
Dec 23 02:36:12 ai-demon-io dockerd[1421861]: time="2023-12-23T02:36:12.528881886Z" level=debug msg="Calling GET /v1.43/images/json"
Dec 23 02:36:12 ai-demon-io dockerd[1421861]: time="2023-12-23T02:36:12.594061925Z" level=debug msg="Calling HEAD /_ping"
Dec 23 02:36:12 ai-demon-io dockerd[1421861]: time="2023-12-23T02:36:12.595537206Z" level=debug msg="Calling GET /v1.43/images/json"
Dec 23 02:36:12 ai-demon-io dockerd[1421861]: time="2023-12-23T02:36:12.656671279Z" level=debug msg="Calling HEAD /_ping"
Dec 23 02:36:12 ai-demon-io dockerd[1421861]: time="2023-12-23T02:36:12.657895935Z" level=debug msg="Calling GET /v1.43/containers/json?filters=%7B%22ancestor%22%3A%7B%22europe-docker.pkg.dev%2Fpryzm-zone%2Fcore%2Fpryzm-feeder%40sha256%3Aa73f38e34f372d31f6478ad9036fd2e5a991e1d1f0cfcfd07d949b2aa78f880d%22%3Atrue%7D%7D"
Dec 23 02:36:12 ai-demon-io dockerd[1421861]: time="2023-12-23T02:36:12.717489805Z" level=debug msg="Calling HEAD /_ping"
Dec 23 02:36:12 ai-demon-io dockerd[1421861]: time="2023-12-23T02:36:12.718527649Z" level=debug msg="Calling DELETE /v1.43/images/europe-docker.pkg.dev/pryzm-zone/core/pryzm-feeder@sha256:a73f38e34f372d31f6478ad9036fd2e5a991e1d1f0cfcfd07d949b2aa78f880d?force=1"

from moby.

DemonRx commented on June 14, 2024

Not sure if this is being affected by the image being pulled from the Google Cloud artifact registry (not docker hub): https://console.cloud.google.com/artifacts/docker/pryzm-zone/europe/core/pryzm-feeder/sha256:a73f38e34f372d31f6478ad9036fd2e5a991e1d1f0cfcfd07d949b2aa78f880d;tab=install

I followed the instructions to the tee, but the image still gets deleted.

from moby.

thaJeztah commented on June 14, 2024

I suspect you have something running on your machine that's configured to cleanup unused things, or at least is making calls to the API. The daemon itself does not delete images automatically, and if it would do so, those actions don't show up as API requests in the debug logs, so "something" is connecting to the API.

Here's the last few lines from your debug log with the timestamps removed and URLs decoded for readability;

msg="Calling HEAD /_ping"
msg="Calling GET /v1.43/containers/json"
msg="Calling HEAD /_ping"
msg="Calling GET /v1.43/containers/json"
msg="Calling HEAD /_ping"
msg="Calling GET /v1.43/images/json?filters={"reference":{"ionetcontainers/io-worker-monitor":true}}"
msg="Calling HEAD /_ping"
msg="Calling GET /v1.43/images/json"
msg="Calling HEAD /_ping"
msg="Calling GET /v1.43/images/json"
msg="Calling HEAD /_ping"
msg="Calling GET /v1.43/containers/json?filters={"ancestor":{"europe-docker.pkg.dev/pryzm-zone/core/pryzm-feeder@sha256:a73f38e34f372d31f6478ad9036fd2e5a991e1d1f0cfcfd07d949b2aa78f880d":true}}"
msg="Calling HEAD /_ping"
msg="Calling DELETE /v1.43/images/europe-docker.pkg.dev/pryzm-zone/core/pryzm-feeder@sha256:a73f38e34f372d31f6478ad9036fd2e5a991e1d1f0cfcfd07d949b2aa78f880d?force=1"

Breaking up those lines to explain what they correspond with;

API call for docker container ls (docker ps) (twice)

msg="Calling HEAD /_ping"
msg="Calling GET /v1.43/containers/json"
msg="Calling HEAD /_ping"
msg="Calling GET /v1.43/containers/json"

API call for docker image ls / docker images with --filter reference=ionetcontainers/io-worker-monitor;

msg="Calling HEAD /_ping"
msg="Calling GET /v1.43/images/json?filters={"reference":{"ionetcontainers/io-worker-monitor":true}}"

API call for docker image ls (docker images) (twice)

msg="Calling HEAD /_ping"
msg="Calling GET /v1.43/images/json"
msg="Calling HEAD /_ping"
msg="Calling GET /v1.43/images/json"

API call for docker container ls / docker ps with --filter ancestor=europe-docker.pkg.dev/pryzm-zone/core/pryzm-feeder@sha256:a73f38e34f372d31f6478ad9036fd2e5a991e1d1f0cfcfd07d949b2aa78f880d;

msg="Calling HEAD /_ping"
msg="Calling GET /v1.43/containers/json?filters={"ancestor":{"europe-docker.pkg.dev/pryzm-zone/core/pryzm-feeder@sha256:a73f38e34f372d31f6478ad9036fd2e5a991e1d1f0cfcfd07d949b2aa78f880d":true}}"

API call for docker image rm --force europe-docker.pkg.dev/pryzm-zone/core/pryzm-feeder@sha256:a73f38e34f372d31f6478ad9036fd2e5a991e1d1f0cfcfd07d949b2aa78f880d

msg="Calling HEAD /_ping"
msg="Calling DELETE /v1.43/images/europe-docker.pkg.dev/pryzm-zone/core/pryzm-feeder@sha256:a73f38e34f372d31f6478ad9036fd2e5a991e1d1f0cfcfd07d949b2aa78f880d?force=1"

☝️ this last one is deleting the europe-docker.pkg.dev/pryzm-zone/core/pryzm-feeder image.

from moby.

Docker image not visible after pull about moby HOT 3 CLOSED

Comments (3)

Related Issues (20)

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent