Giter VIP home page Giter VIP logo

Comments (3)

planetahuevo avatar planetahuevo commented on August 13, 2024

Related question.
Will multipart upload be automatically selected when the file is bigger than 5GB?
What is the size of the parts?

from phpbu.

planetahuevo avatar planetahuevo commented on August 13, 2024

This is what b2 recommends: https://www.backblaze.com/blog/b2-503-500-server-error/
And this is S3:
https://aws.amazon.com/premiumsupport/knowledge-center/http-5xx-errors-s3/#:~:text=The%20error%20code%20500%20Internal,high%2C%20exceeding%20the%20request%20rate.

I think customers using the S3 API won't have to worry about this discussion. :-)

When using the S3 API Backblaze will not return that particular error code for that situation (asking customer code to get a new upload URL, since Amazon S3 has no other upload URL, the client side could not possibly "fix" anything, so the Backblaze S3 layer doesn't have the ability to return this particular HTTP response code, correct). It is an anomaly of implementing the lower cost (to Backblaze) B2 API that didn't have the load balancer layer in it.

This is a side note (doesn't affect the answer): I am kind of concerned about the quality of client side customer code out there that cannot handle intermittent failures. The most conservative, best code uploading to Amazon S3 in the Amazon S3 datacenters (Backblaze not involved in any way, shape, or form) has to be able to handle rare failures where it retries the transmission when it gets an HTTP response that isn't a "200 - ok". And the difference between "rare" and "common" escapes me from a code standpoint. Put differently, it is more terrifying to me that the code MIGHT fail or corrupt data if the network experiences over 1% network failure than if the code always fails or always works. I hope that made sense.

I guess what I'm worried about is this scenario: some program out there not handling any errors at all in their upload code, and what they are banking on is that if tonight's backup is totally corrupted due to 1 network error, that tomorrow's backup will work because it will have zero network errors. And then what occurs is a bad network cable causing 50 network errors per day prevents them from ever getting an uncorrupted backup. I hope that made sense as a concern.

from phpbu.

planetahuevo avatar planetahuevo commented on August 13, 2024

@sebastianfeldmann any ideas?

from phpbu.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.