Giter VIP home page Giter VIP logo

Comments (9)

mark-vieira avatar mark-vieira commented on July 21, 2024 3

If that's something amenable, I'm happy to adjust and de-Draft that PR if I can get a list of the folks I should put there. 😄

You can add me for Elasticsearch, @watson for Kibana, and @jsvd for Logstash.

from official-images.

LaurentGoderre avatar LaurentGoderre commented on July 21, 2024

This also affected Kibana 8.11.1 & 7.17.15 and logstash 8.11.1

from official-images.

tianon avatar tianon commented on July 21, 2024

There's something weird happening with our builder that we're not 100% sure what the root cause is (we're still investigating):

$ docker buildx build --progress=plain --provenance=mode=max --sbom=generator=docker/scout-sbom-indexer:1@sha256:91bf9853796701a4dcba367ff084ab3301981b4d21ba1538bd3dc0780783dd10 --output '"type=oci","dest=temp.tar","annotation.org.opencontainers.image.source=[https://github.com/docker-library/elasticsearch.git#84a62adaf958d51f39376ed636a7d59f2e92ca69:8","annotation-manifest-descriptor.org.opencontainers.image.source=https://github.com/docker-library/elasticsearch.git#84a62adaf958d51f39376ed636a7d59f2e92ca69:8","annotation.org.opencontainers.image.revision=84a62adaf958d51f39376ed636a7d59f2e92ca69","annotation-manifest-descriptor.org.opencontainers.image.revision=84a62adaf958d51f39376ed636a7d59f2e92ca69","annotation.org.opencontainers.image.version=8.11.1","annotation-manifest-descriptor.org.opencontainers.image.version=8.11.1","annotation.org.opencontainers.image.url=https://hub.docker.com/_/elasticsearch","annotation-manifest-descriptor.org.opencontainers.image.url=https://hub.docker.com/_/elasticsearch](https://github.com/docker-library/elasticsearch.git#84a62adaf958d51f39376ed636a7d59f2e92ca69:8%22,%22annotation-manifest-descriptor.org.opencontainers.image.source=https://github.com/docker-library/elasticsearch.git#84a62adaf958d51f39376ed636a7d59f2e92ca69:8%22,%22annotation.org.opencontainers.image.revision=84a62adaf958d51f39376ed636a7d59f2e92ca69%22,%22annotation-manifest-descriptor.org.opencontainers.image.revision=84a62adaf958d51f39376ed636a7d59f2e92ca69%22,%22annotation.org.opencontainers.image.version=8.11.1%22,%22annotation-manifest-descriptor.org.opencontainers.image.version=8.11.1%22,%22annotation.org.opencontainers.image.url=https://hub.docker.com/_/elasticsearch%22,%22annotation-manifest-descriptor.org.opencontainers.image.url=https://hub.docker.com/_/elasticsearch)"' --tag elasticsearch:8.11.1 --tag arm64v8/elasticsearch:8.11.1 --tag oisupport/staging-arm64v8:2c081dfbe60e7f9621299b6e083813bfb5dda7fb6dc9ec888ead66ed388d8397 --platform linux/arm64/v8 --build-context docker.elastic.co/elasticsearch/elasticsearch:8.11.1@sha256:cf3edd6518b0159d50c0f932f6cacd63930db01e1fb740499eca477543d42b34=docker-image://docker.elastic.co/elasticsearch/elasticsearch:8.11.1@sha256:8d9c0b0b15b14ea0121e56a0f1b9784df3524bf685d74a1b2ade5598525d224a --build-arg BUILDKIT_SYNTAX=docker/dockerfile:1@sha256:ac85f380a63b13dfcefa89046420e1781752bab202122f8f50032edf31be0021 --file Dockerfile https://github.com/docker-library/elasticsearch.git#84a62adaf958d51f39376ed636a7d59f2e92ca69:8
#1 [internal] load git source https://github.com/docker-library/elasticsearch.git#84a62adaf958d51f39376ed636a7d59f2e92ca69:8
#1 CACHED

#2 resolve image config for docker.io/docker/dockerfile:1@sha256:ac85f380a63b13dfcefa89046420e1781752bab202122f8f50032edf31be0021
#2 DONE 0.1s

#3 docker-image://docker.io/docker/dockerfile:1@sha256:ac85f380a63b13dfcefa89046420e1781752bab202122f8f50032edf31be0021
#3 resolve docker.io/docker/dockerfile:1@sha256:ac85f380a63b13dfcefa89046420e1781752bab202122f8f50032edf31be0021 0.0s done
#3 CACHED

#4 resolve image config for docker.io/docker/scout-sbom-indexer:1@sha256:91bf9853796701a4dcba367ff084ab3301981b4d21ba1538bd3dc0780783dd10
#4 DONE 2.8s

#5 [context docker.elastic.co/elasticsearch/elasticsearch:8.11.1@sha256:cf3edd6518b0159d50c0f932f6cacd63930db01e1fb740499eca477543d42b34] load metadata for docker.elastic.co/elasticsearch/elasticsearch:8.11.1@sha256:8d9c0b0b15b14ea0121e56a0f1b9784df3524bf685d74a1b2ade5598525d224a
#5 DONE 0.5s

#6 [context docker.elastic.co/elasticsearch/elasticsearch:8.11.1@sha256:cf3edd6518b0159d50c0f932f6cacd63930db01e1fb740499eca477543d42b34] docker.elastic.co/elasticsearch/elasticsearch:8.11.1@sha256:8d9c0b0b15b14ea0121e56a0f1b9784df3524bf685d74a1b2ade5598525d224a
#6 resolve docker.elastic.co/elasticsearch/elasticsearch:8.11.1@sha256:8d9c0b0b15b14ea0121e56a0f1b9784df3524bf685d74a1b2ade5598525d224a 0.0s done
#6 CACHED

#7 docker-image://docker.io/docker/scout-sbom-indexer:1@sha256:91bf9853796701a4dcba367ff084ab3301981b4d21ba1538bd3dc0780783dd10
#7 resolve docker.io/docker/scout-sbom-indexer:1@sha256:91bf9853796701a4dcba367ff084ab3301981b4d21ba1538bd3dc0780783dd10 0.0s done
#7 sha256:22bee000d7ba9458d0282fb5ca71c8e9aacc45030051b9c0477d5dce77d879c5 0B / 123.56kB 0.2s
#7 sha256:d7ae4710a8b476dad50920dfc37d6772eaf57e0819a4e9c7a7ccd07fe4244020 0B / 16.86MB 0.2s
#7 sha256:22bee000d7ba9458d0282fb5ca71c8e9aacc45030051b9c0477d5dce77d879c5 123.56kB / 123.56kB 0.5s done
#7 extracting sha256:22bee000d7ba9458d0282fb5ca71c8e9aacc45030051b9c0477d5dce77d879c5 0.0s done
#7 sha256:d7ae4710a8b476dad50920dfc37d6772eaf57e0819a4e9c7a7ccd07fe4244020 5.24MB / 16.86MB 0.8s
#7 sha256:d7ae4710a8b476dad50920dfc37d6772eaf57e0819a4e9c7a7ccd07fe4244020 11.53MB / 16.86MB 0.9s
#7 sha256:d7ae4710a8b476dad50920dfc37d6772eaf57e0819a4e9c7a7ccd07fe4244020 16.86MB / 16.86MB 1.1s done
#7 extracting sha256:d7ae4710a8b476dad50920dfc37d6772eaf57e0819a4e9c7a7ccd07fe4244020
#7 extracting sha256:d7ae4710a8b476dad50920dfc37d6772eaf57e0819a4e9c7a7ccd07fe4244020 0.2s done
#7 DONE 1.4s

#8 [linux/arm64] generating sbom using docker.io/docker/scout-sbom-indexer:1@sha256:91bf9853796701a4dcba367ff084ab3301981b4d21ba1538bd3dc0780783dd10
INFO Starting docker scout sbom for buildkit 1.2.1
INFO File system read
INFO Indexed 616 packages
#8 DONE 5.7s

#9 exporting to oci image format
#9 exporting layers done
#9 exporting manifest sha256:890c8945ff42c53f7f464f0048a2bdf1144f4cf98854717a8ae5d0a3cc6ceb9a done
#9 exporting config sha256:11da9a32d05c69322b48eff32523e40609975a286aa29b997990c146bf09ea81 done
#9 ERROR: content digest sha256:ef97c2f5ad2b2e85b56b0790ec426de04b74402b61793969894ef55f376b5faf: not found
------
 > exporting to oci image format:
------
ERROR: failed to solve: content digest sha256:ef97c2f5ad2b2e85b56b0790ec426de04b74402b61793969894ef55f376b5faf: not found

As far as I can tell, there's probably some kind of race condition happening within BuildKit itself given how short the Dockerfile is (with just FROM xxx@sha256:xxx).

It's not entirely a fix, but it's probably time we rediscussed having that be a proper Dockerfile again (so it again gets the full benefits/promises of the DOI program such as automated base image rebuilds, etc), which should also have the side effect of making this problem go away.

from official-images.

mark-vieira avatar mark-vieira commented on July 21, 2024

It's not entirely a fix, but it's probably time we rediscussed having that be a proper Dockerfile again (so it again gets the full benefits/promises of the DOI program such as automated base image rebuilds, etc), which should also have the side effect of making this problem go away.

I assume by "proper" you mean moving away from the existing multi-stage build? That would be a non-trivial change on our end and we similarly are building our arm images via buildx without this issue. It's also not clear why this started happening with this release. What's the way forward here?

from official-images.

tianon avatar tianon commented on July 21, 2024

Oh no sorry, I mean moving away from https://github.com/docker-library/elasticsearch/blob/84a62adaf958d51f39376ed636a7d59f2e92ca69/8/Dockerfile and instead doing #15808 (where we build directly from the real Dockerfile instead of ingesting the pre-built images as-is, which has always been a problematic special case).

from official-images.

mark-vieira avatar mark-vieira commented on July 21, 2024

Thanks for the clarification @tianon. So that would be a change on your end, not in the upstream Elasticsearch Dockerfile. Got it.

from official-images.

tianon avatar tianon commented on July 21, 2024

That would be a change to the way the ELK images get into DOI in general, and would imply that we need to change the Maintainers: line in the library file to reflect the actual maintainers of that Git repository instead (which should've been done a while ago, TBH).

If that's something amenable, I'm happy to adjust and de-Draft that PR if I can get a list of the folks I should put there. 😄

from official-images.

antishov avatar antishov commented on July 21, 2024

Hello, any updates of this?

from official-images.

tianon avatar tianon commented on July 21, 2024

Success via #15808 👍

https://explore.ggcr.dev/?image=elasticsearch:8.11.1

from official-images.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.