Giter VIP home page Giter VIP logo

Comments (3)

lucashuy avatar lucashuy commented on May 25, 2024

Thanks for raising this issue. I can reproduce the issue where it is stuck building the project. It is actually doing something, however that isn't being streamed back to terminal while the container runs. It looks like pip is having problems trying to resolve the dependencies between glue and s3fs.

It looks like the glue extra installs botocore==1.34.80:

botocore==1.34.80
    # via
    #   boto3
    #   s3transfer

While s3fs will install botocore==1.34.51:

botocore==1.34.51
    # via aiobotocore

Both of these were installed separately in their own venv, and pip-compile was used to list the installed child dependencies.

pip is trying to download and compare every single dependency between them to find something that works.

It looks like apache/iceberg-python#534 in the iceberg repository fixes most of the issues with dependency resolution when I pulled it down to quickly test. Can you check in with the folks over there just to confirm?

As a workaround for now, you can pin boto3 and botocore just before installing pyiceberg, like this:

boto3==1.34.51
botocore==1.34.51
pyiceberg[s3fs,glue]

from aws-sam-cli.

moryachok avatar moryachok commented on May 25, 2024

Hey @lucashuy, your workaround worked for me, thanks for deep dive.

from aws-sam-cli.

github-actions avatar github-actions commented on May 25, 2024

⚠️COMMENT VISIBILITY WARNING⚠️

Comments on closed issues are hard for our team to see.
If you need more assistance, please either tag a team member or open a new issue that references this one.
If you wish to keep having a conversation with other community members under this issue feel free to do so.

from aws-sam-cli.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.