Giter VIP home page Giter VIP logo

Comments (5)

danilop avatar danilop commented on August 22, 2024

Sorry for the delay in the answer. I don't think setting the f_stat would do what you ask, because there is no way to get the size of a "folder" on S3 than doing (every time) a full "list", that is slow and costly.
I could cache that (as I do for a readdir) and that could be an interesting use case, but not easy to implement.

from yas3fs.

tonnydourado avatar tonnydourado commented on August 22, 2024

What if you put some sort of special file/object on s3 to hold the size/used/free information, and update it on writes, or when adding a file? It would still be an overhead on network traffic, but I think list operations are the most expensive, so, doing more writes might still be cheaper. Also, I didn't studied the code enough to be able to be specific, but I'm sure there's some caching you could do to minimize even those extra writes.

Anyway, I might have some time to invest on it soon, since it's a feature that would really help my use case, so maybe I will do a pull request, and we can discuss possible solutions =)

from yas3fs.

danilop avatar danilop commented on August 22, 2024

Hi, please feel free to do a pull request!
Probably a good candidate to host S3 used/free space would be DynamoDB, and keeping that updated would be easier (and faster) as DynamoDB supports atomic counters.

from yas3fs.

neilellis avatar neilellis commented on August 22, 2024

Just a +1 that is is actually a very useful feature - folder size limit, alas I don't have the appropriate skills to help on this. Just thought I'd show that others would like this too should it ever be possible :)

from yas3fs.

tonnydourado avatar tonnydourado commented on August 22, 2024

Unfortunately, I might never get around to help with this, since we might move in the direction of implementing direct access to S3, instead of using a fuse interface. =(

from yas3fs.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.