nealef / clefos Goto Github PK
View Code? Open in Web Editor NEWClefOS - Official Base Image
License: GNU General Public License v2.0
ClefOS - Official Base Image
License: GNU General Public License v2.0
Hello @nealef,
While investigating pypa/manylinux#1141, I found out that the following command is currently failing with missing packages in the repo:
yum install -y devtoolset-10-binutils devtoolset-10-gcc devtoolset-10-gcc-c++ devtoolset-10-gcc-gfortran
Here are the steps to reproduce the issue in a clean clefos:7 image:
docker pull s390x/clefos:7
docker run -it --rm s390x/clefos:7
echo "multilib_policy=best" >> /etc/yum.conf
echo "skip_missing_names_on_install=False" >> /etc/yum.conf
sed -i '/^override_install_langs=/d' /etc/yum.conf
yum -y update
yum -y install yum-utils curl
yum-config-manager --enable extras
yum -y install centos-release-scl-rh
yum install -y devtoolset-10-binutils devtoolset-10-gcc devtoolset-10-gcc-c++ devtoolset-10-gcc-gfortran
It's failing with:
Loaded plugins: fastestmirror, ovl
Loading mirror speeds from cached hostfile
clefos-rh | 3.0 kB 00:00:00
clefos-rh/s390x/primary_db | 2.6 MB 00:00:06
Resolving Dependencies
--> Running transaction check
---> Package devtoolset-10-binutils.s390x 0:2.35-3.el7 will be installed
--> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-binutils-2.35-3.el7.s390x
---> Package devtoolset-10-gcc.s390x 0:10.2.1-2.1.el7 will be installed
--> Processing Dependency: glibc-devel >= 2.2.90-12 for package: devtoolset-10-gcc-10.2.1-2.1.el7.s390x
--> Processing Dependency: libgomp >= 4.4.4-13 for package: devtoolset-10-gcc-10.2.1-2.1.el7.s390x
--> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-gcc-10.2.1-2.1.el7.s390x
--> Processing Dependency: libmpc.so.3()(64bit) for package: devtoolset-10-gcc-10.2.1-2.1.el7.s390x
--> Processing Dependency: libmpfr.so.4()(64bit) for package: devtoolset-10-gcc-10.2.1-2.1.el7.s390x
---> Package devtoolset-10-gcc-c++.s390x 0:10.2.1-2.1.el7 will be installed
--> Processing Dependency: devtoolset-10-libstdc++-devel = 10.2.1-2.1.el7 for package: devtoolset-10-gcc-c++-10.2.1-2.1.el7.s390x
--> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-gcc-c++-10.2.1-2.1.el7.s390x
---> Package devtoolset-10-gcc-gfortran.s390x 0:10.2.1-2.1.el7 will be installed
--> Processing Dependency: libgfortran5 >= 8.1.1 for package: devtoolset-10-gcc-gfortran-10.2.1-2.1.el7.s390x
--> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-gcc-gfortran-10.2.1-2.1.el7.s390x
--> Running transaction check
---> Package devtoolset-10-binutils.s390x 0:2.35-3.el7 will be installed
--> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-binutils-2.35-3.el7.s390x
---> Package devtoolset-10-gcc.s390x 0:10.2.1-2.1.el7 will be installed
--> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-gcc-10.2.1-2.1.el7.s390x
---> Package devtoolset-10-gcc-c++.s390x 0:10.2.1-2.1.el7 will be installed
--> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-gcc-c++-10.2.1-2.1.el7.s390x
---> Package devtoolset-10-gcc-gfortran.s390x 0:10.2.1-2.1.el7 will be installed
--> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-gcc-gfortran-10.2.1-2.1.el7.s390x
---> Package devtoolset-10-libstdc++-devel.s390x 0:10.2.1-2.1.el7 will be installed
--> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-libstdc++-devel-10.2.1-2.1.el7.s390x
---> Package glibc-devel.s390x 0:2.17-324.el7_9 will be installed
--> Processing Dependency: glibc-headers = 2.17-324.el7_9 for package: glibc-devel-2.17-324.el7_9.s390x
--> Processing Dependency: glibc-headers for package: glibc-devel-2.17-324.el7_9.s390x
---> Package libgfortran5.s390x 0:8.3.1-2.1.1.el7 will be installed
---> Package libgomp.s390x 0:4.8.5-44.el7 will be installed
---> Package libmpc.s390x 0:1.0.1-3.el7 will be installed
---> Package mpfr.s390x 0:3.1.1-4.el7 will be installed
--> Running transaction check
---> Package devtoolset-10-binutils.s390x 0:2.35-3.el7 will be installed
--> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-binutils-2.35-3.el7.s390x
---> Package devtoolset-10-gcc.s390x 0:10.2.1-2.1.el7 will be installed
--> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-gcc-10.2.1-2.1.el7.s390x
---> Package devtoolset-10-gcc-c++.s390x 0:10.2.1-2.1.el7 will be installed
--> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-gcc-c++-10.2.1-2.1.el7.s390x
---> Package devtoolset-10-gcc-gfortran.s390x 0:10.2.1-2.1.el7 will be installed
--> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-gcc-gfortran-10.2.1-2.1.el7.s390x
---> Package devtoolset-10-libstdc++-devel.s390x 0:10.2.1-2.1.el7 will be installed
--> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-libstdc++-devel-10.2.1-2.1.el7.s390x
---> Package glibc-headers.s390x 0:2.17-324.el7_9 will be installed
--> Processing Dependency: kernel-headers >= 2.2.1 for package: glibc-headers-2.17-324.el7_9.s390x
--> Processing Dependency: kernel-headers for package: glibc-headers-2.17-324.el7_9.s390x
--> Running transaction check
---> Package devtoolset-10-binutils.s390x 0:2.35-3.el7 will be installed
--> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-binutils-2.35-3.el7.s390x
---> Package devtoolset-10-gcc.s390x 0:10.2.1-2.1.el7 will be installed
--> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-gcc-10.2.1-2.1.el7.s390x
---> Package devtoolset-10-gcc-c++.s390x 0:10.2.1-2.1.el7 will be installed
--> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-gcc-c++-10.2.1-2.1.el7.s390x
---> Package devtoolset-10-gcc-gfortran.s390x 0:10.2.1-2.1.el7 will be installed
--> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-gcc-gfortran-10.2.1-2.1.el7.s390x
---> Package devtoolset-10-libstdc++-devel.s390x 0:10.2.1-2.1.el7 will be installed
--> Processing Dependency: devtoolset-10-runtime for package: devtoolset-10-libstdc++-devel-10.2.1-2.1.el7.s390x
---> Package kernel-headers.s390x 0:3.10.0-1160.25.1.el7 will be installed
--> Finished Dependency Resolution
Error: Package: devtoolset-10-gcc-c++-10.2.1-2.1.el7.s390x (clefos-rh)
Requires: devtoolset-10-runtime
Error: Package: devtoolset-10-gcc-gfortran-10.2.1-2.1.el7.s390x (clefos-rh)
Requires: devtoolset-10-runtime
Error: Package: devtoolset-10-gcc-10.2.1-2.1.el7.s390x (clefos-rh)
Requires: devtoolset-10-runtime
Error: Package: devtoolset-10-binutils-2.35-3.el7.s390x (clefos-rh)
Requires: devtoolset-10-runtime
Error: Package: devtoolset-10-libstdc++-devel-10.2.1-2.1.el7.s390x (clefos-rh)
Requires: devtoolset-10-runtime
You could try using --skip-broken to work around the problem
You could try running: rpm -Va --nofiles --nodigest
It thus seems that devtoolset-10-runtime
is missing from the repo.
Furthermore, looking at the current version in CentOS 7, those are not the same (I understand there can be some delay between availability in CentOS and rebuild by ClefOS but just wanted to add that in case it's not expected on your end):
Hey @nealef , hope all is well!
Trying to figure out the correct steps to import Sinenomine's GPG key and was looking @ this repo and your Dockerfile as an example...
I see you importing the key here : https://github.com/nealef/clefos/blob/master/createBase.sh#L88
But am unsure where that key comes from...
I see you are downloading the sna-packages so I'm thinking maybe from there?
https://github.com/nealef/clefos/blob/master/createBase.sh#L78
If there is a better way to import your key for some automation let me know. Thanks!
Hello @nealef,
manylinux2014 image build is failing with error (nothing has changed with regards to installed packages):
yum -y install centos-release-scl-rh
Loaded plugins: fastestmirror, ovl
Loading mirror speeds from cached hostfile
No package centos-release-scl-rh available.
Error: Not tolerating missing names on install, stopping.
c.f. https://travis-ci.com/github/pypa/manylinux/jobs/492933879
It seems to be very similar to #1 (comment) when switching to 7.8.2003 (i.e. I can't find the source package for this one in 7.9.2009). I guess the switch for 7.9.2009 happened sometime this month ? (given we're now using some caching to build the image, not sure exactly when it would have first occurred).
Thanks in advance for your support.
Hello @nealef,
It seems there's something wrong with download.sinenomine.net, yum update
is failing with:
docker run -it --rm s390x/clefos:7 yum update
WARNING: The requested image's platform (linux/s390x) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested
Loaded plugins: fastestmirror, ovl
Determining fastest mirrors
https://download.sinenomine.net/epel/epel-7/repodata/repomd.xml: [Errno 12] Timeout on https://download.sinenomine.net/epel/epel-7/repodata/repomd.xml: (28, 'Connection timed out after 30001 milliseconds')
Trying other mirror.
...
Disabling epel shows the same timeout, idem for direct url browsing.
docker run -it --rm s390x/clefos:7 yum update --disablerepo=epel
WARNING: The requested image's platform (linux/s390x) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested
Loaded plugins: fastestmirror, ovl
Determining fastest mirrors
https://download.sinenomine.net/clefos/7/os/repodata/repomd.xml: [Errno 12] Timeout on https://download.sinenomine.net/clefos/7/os/repodata/repomd.xml: (28, 'Connection timed out after 30001 milliseconds')
Trying other mirror.
All I can say is that it's been this way for at least 32 hours. I waited a bit before reporting this but maybe not long enough.
Are you aware of the issue ? Any idea when the service will be available ?
Thanks in advance for your help.
yum commands executed in Dockerfile fail which uses s390x/clefos as base image fails with following error:
Step 2/24 : RUN yum update -y && yum upgrade -y && yum install -y java-1.8.0-openjdk-devel which
---> Running in 1a0393885009
Loaded plugins: fastestmirror, ovl
https://download.sinenomine.net/clefos/7/base/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found
Trying other mirror.
To address this issue please refer to the below knowledge base article
https://access.redhat.com/articles/1320623
If above article doesn't help to resolve this issue please create a bug on https://bugs.centos.org/
One of the configured repositories failed (ClefOS-7 - Base),
and yum doesn't have enough cached data to continue. At this point the only
safe thing yum can do is fail. There are a few ways to work "fix" this:
1. Contact the upstream for the repository and get them to fix the problem.
2. Reconfigure the baseurl/etc. for the repository, to point to a working
upstream. This is most often useful if you are using a newer
distribution release than is supported by the repository (and the
packages for the previous distribution release still work).
3. Run the command with the repository temporarily disabled
yum --disablerepo=base ...
4. Disable the repository permanently, so yum won't use it by default. Yum
will then just ignore the repository until you permanently enable it
again or use --enablerepo for temporary usage:
yum-config-manager --disable base
or
subscription-manager repos --disable=base
5. Configure the failing repository to be skipped, if it is unavailable.
Note that yum will try to contact the repo. when it runs most commands,
so will have to try and fail each time (and thus. yum will be be much
slower). If it is a very temporary problem though, this is often a nice
compromise:
yum-config-manager --save --setopt=base.skip_if_unavailable=true
failure: repodata/repomd.xml from base: [Errno 256] No more mirrors to try.
https://download.sinenomine.net/clefos/7/base/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found
The command '/bin/sh -c yum update -y && yum upgrade -y && yum install -y java-1.8.0-openjdk-devel which' returned a non-zero code: 1
Makefile.docker:57: recipe for target 'image' failed
make: *** [image] Error 1
Tried htting url "https://download.sinenomine.net/clefos/7/base/" , repodata
folder is not present in the above link.
Please help resolve above issue or provide any workaround if present to resolve above issue. Thanks!
Hello @nealef,
It seems that devtoolset-11 has not been rebuild yet for clefos 7.
Is this planned and if so, do you have an ETA on this ?
This has been found when investigating pypa/manylinux#1266
CentOS 7 sources are available for devtoolset-11: https://vault.centos.org/centos/7/sclo/Source/rh/
The CentOS 7 x86_64 image is able to run the same commands as below successfully.
Simple reproducer:
docker pull s390x/clefos:7
docker run -it --rm s390x/clefos:7
echo "multilib_policy=best" >> /etc/yum.conf
echo "skip_missing_names_on_install=False" >> /etc/yum.conf
sed -i '/^override_install_langs=/d' /etc/yum.conf
yum -y update
yum -y install yum-utils curl
yum-config-manager --enable extras
yum -y install centos-release-scl-rh
yum -y install devtoolset-11-binutils devtoolset-11-gcc devtoolset-11-gcc-c++ devtoolset-11-gcc-gfortran
Thanks
Hello @nealef,
I was wondering if the base packages for ClefOS will be updated with up-to-date with CentOS 7.9 packages. I noticed that in #5 you mentioned that you were in the process of moving to 7.9? Does that only apply to EPEL or also the base OS?
We are using ClefOS images to build a s390x version of our Docker Images, and we always try to update our images with the latest patches and security fixes to pass security scans.
Hi all,
first of all I'd like to thank you for your efforts, this is awesome. I was wondering about clefos8 and found this comment:
AdoptOpenJDK/openjdk-docker#253 (comment)
Is there any estimate already? soon, this year, not at all?
Thanks, rck
Hello @nealef,
manylinux2014 image build is failing with error (nothing has changed with regards to installed packages):
https://download.sinenomine.net/epel/epel-7/noarch/epel-release-7-13.noarch.rpm: [Errno 14] HTTPS Error 404 - Not Found
c.f. https://travis-ci.com/github/pypa/manylinux/jobs/454964495
Are there any maintenance actions on going on the repo ? If so, any ETA ?
Thanks
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.