Comments (3)
Related question.
Will multipart upload be automatically selected when the file is bigger than 5GB?
What is the size of the parts?
from phpbu.
This is what b2 recommends: https://www.backblaze.com/blog/b2-503-500-server-error/
And this is S3:
https://aws.amazon.com/premiumsupport/knowledge-center/http-5xx-errors-s3/#:~:text=The%20error%20code%20500%20Internal,high%2C%20exceeding%20the%20request%20rate.
I think customers using the S3 API won't have to worry about this discussion. :-)
When using the S3 API Backblaze will not return that particular error code for that situation (asking customer code to get a new upload URL, since Amazon S3 has no other upload URL, the client side could not possibly "fix" anything, so the Backblaze S3 layer doesn't have the ability to return this particular HTTP response code, correct). It is an anomaly of implementing the lower cost (to Backblaze) B2 API that didn't have the load balancer layer in it.
This is a side note (doesn't affect the answer): I am kind of concerned about the quality of client side customer code out there that cannot handle intermittent failures. The most conservative, best code uploading to Amazon S3 in the Amazon S3 datacenters (Backblaze not involved in any way, shape, or form) has to be able to handle rare failures where it retries the transmission when it gets an HTTP response that isn't a "200 - ok". And the difference between "rare" and "common" escapes me from a code standpoint. Put differently, it is more terrifying to me that the code MIGHT fail or corrupt data if the network experiences over 1% network failure than if the code always fails or always works. I hope that made sense.
I guess what I'm worried about is this scenario: some program out there not handling any errors at all in their upload code, and what they are banking on is that if tonight's backup is totally corrupted due to 1 network error, that tomorrow's backup will work because it will have zero network errors. And then what occurs is a bad network cable causing 50 network errors per day prevents them from ever getting an uncorrupted backup. I hope that made sense as a concern.
from phpbu.
@sebastianfeldmann any ideas?
from phpbu.
Related Issues (20)
- Parse error: syntax error, unexpected '|', expecting variable (T_VARIABLE) in phar:///home/<site>/public_html/dbbackup/phpbu.phar/lib/symfony/process/Process.php on line 54 HOT 7
- Nextcloud support? HOT 1
- error HOT 3
- SSL decryption issue HOT 2
- Incomplete remote MySQL backups? HOT 1
- DropBox tokens expire after 4 hours HOT 4
- Webhook json template example? HOT 2
- Relative paths don't work for template? HOT 2
- Docker support HOT 2
- What will happen if the database is huge? HOT 1
- syntax error when selected pgdump HOT 1
- More information in the message HOT 1
- GPG encryption is not working
- Error with `xtrabackup8` source: `unknown argument` for target directory HOT 2
- Minor improvement regarding the manual and the use of OpenSSL (on Windows)
- syntax error, unexpected '|', expecting variable HOT 2
- Google Drive crypt failing HOT 2
- rsync with port
- PHP Parse error: syntax error, unexpected 'static' (T_STATIC) in phar (using phpbu-6.0.20.phar with php 7.4.33) HOT 1
- Consider adding support for MariaDB `mariabackup`
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from phpbu.