hadimodarres / s3_uploader_service Goto Github PK

add another configration option that determines what to do if the file with same name exists on the same path on s3.

options:
1- don't upload if file with same name exists on the same path
2- rewrite (default)

Please keep a log of succesful uploads and also a log of errors.

Create a folder with two files: sucessful_uploads and error
successful_uploads keeps a log of successful uploads and from which path a file was taken and at which place in what bucket and region was placed .
error will keep a record of any erros that have occured.

Create a config file "config" that would keep a configuration with default values except values for s3 key and s3 secret, and path

Make a configuration for upload policy that makes the script upload many files at once.

Policies supported:
1- A number of files (like 40) -> would scan and upload this number of files
2- Exhaustive -> would scan and upload everything it finds