TFX 1.14 docker image pip broken about tfx HOT 11 CLOSED

@IzakMaraisTAL,

Thank you for reporting this issue. I was able to replicate different versions in default python and pip environment in TFX 1.14 and TFX 1.15 dev images.

@roseayeon, Different python version in default environment(py 3.8) and pip environment(py 3.10) is causing this issue. Please have a look. Thanks

from tfx.

@IzakMaraisTAL,

Can you try using the latest TFX image. We have updated the docker image and recompiled and re-uploaded the newly-built docker image (from v1.14.0) to the DockerHub with "latest" tag. Ref: screenshot below

Please try out the latest image and let us know if you face any issues. Thank you!

from tfx.

On a side note... I imagine the image can be made smaller by removing one of the python versions from the image?

$ docker run --rm -it --entrypoint= tensorflow/tfx:latest bash -c '
python_A=$(python -V)
python_B=$(python3 -V)
conda init bash &> /dev/null
. /root/.bashrc
conda activate base &> /dev/null
python_C=$(python -V)
python_D=$(python3 -V)
echo python_A=$python_A
echo python_B=$python_B
echo python_C=$python_C
echo python_D=$python_D

result:

python_A=Python 3.8.18
python_B=Python 3.10.12
python_C=Python 3.8.18
python_D=Python 3.10.12

(Notice how both 3.8 and 3.10 is present in the image)

from tfx.

@singhniraj08, I have tested and can confirm that pip list and pip install work as expected in tensorflow/tfx:latest: dependencies are installed into the same environment used by TFX.

Thanks for the fix!

from tfx.

On a side note... I imagine the image can be made smaller by removing one of the python versions from the image?

(Notice how both 3.8 and 3.10 is present in the image)

Since image size is contributing to #6386, this might worth considering.

from tfx.

@IzakMaraisTAL,

Thank you for the confirmation and feedback on TFX docker image size issue. I will pass this feedback internally to the team we will be working on the fix.

Since this issue is fixed for you, closing this issue. Please feel free to reopen and post your comments(if you still have queries on this). Thank you!

from tfx.

Are you satisfied with the resolution of your issue?
Yes
No

from tfx.

Hi the problem persists with the gcr.io/tfx-oss-public/tfx:1.14.0 image provided in Container Registery @singhniraj08

from tfx.

@Saoussen-CH,

The fix for this issue was introduced in tensorflow/tfx:latest image and will persist in tfx:1.14.0 image. Please try using tensorflow/tfx:latest image and let us know if you face any issues. Thank yoU!

from tfx.

Hey, @singhniraj08

Yes I know, but not on the gcr.io/tfx-oss-public/tfx:latest provided in GCP as on Container Registery, which I am guessing was based on the old version of the tensorflow/tfx:latest before the fix.

I am just letting you know, so you can pass the message internally and get it fixed.

Thank you.

from tfx.

@Saoussen-CH, Thank you for bringing this up. I raised a PR #6401 with fix which is already merged. This should reflect in upcoming TFX release image. Meanwhile if this is blocking you, you can build a image from Dockerfile by following instructions as shown here.

from tfx.