Giter VIP home page Giter VIP logo

awsdocs / amazon-s3-userguide Goto Github PK

View Code? Open in Web Editor NEW
79.0 25.0 172.0 3.01 MB

The open source version of the Amazon S3 User Guide. You can submit feedback & requests for changes by submitting issues in this repo or by making proposed changes & submitting a pull request. This guide combines information from the three retired Amazon S3 guides: Amazon S3 Developer Guide, Console User Guide, and Getting Started Guide.

License: Other

amazon-s3-userguide's Introduction

amazon-s3-userguide's People

Contributors

aliepaoli avatar aws-alan avatar aws-ambrose avatar aws-dianakm avatar blange avatar cbcrowe avatar dbirtolo-amz avatar dsun-cp avatar giswqs avatar gitlankford avatar iconara avatar ifaqeer-zz avatar joshbean avatar lees-nw avatar lincolahanbeck avatar magnetikonline avatar matheusq avatar mengfwan avatar mig5 avatar mohanrajendran avatar panjws avatar pda avatar pradeepbhadani avatar sasake615 avatar sponiro avatar stevenpitts avatar tannerdolby avatar yanjieniu avatar yzarubin avatar zerooverride avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

amazon-s3-userguide's Issues

question about bucket inventory

Hi, if i set isEnabled to false when i make a put-bucket-inventory request, will the inventory be generated?

or generate a empty inventory?

and the last question is: can i get the inventory(isEnabled = false)'s detail info when i use get-bucket-inventory api?

thanks.

SCP: BucketOwnerEnforced issue

I've implemented and activated the SCP on my accounts as suggested in the docs: https://github.com/awsdocs/amazon-s3-userguide/blob/main/doc_source/ensure-object-ownership.md#disabling-acls-for-all-new-buckets-bucket-owner-enforced

However when I try to create an S3 bucket with CloudFormation where I enforce: "ObjectOwnership": "BucketOwnerEnforced", CloudFormation get's the following error:

CREATE_FAILED | API: s3:CreateBucket Access Denied

Here is the resource:

  "trainingLogs1BCCC4D1": {
   "Type": "AWS::S3::Bucket",
   "Properties": {
    "OwnershipControls": {
     "Rules": [
      {
       "ObjectOwnership": "BucketOwnerEnforced"
      }
     ]
    }
   },
   "UpdateReplacePolicy": "Retain",
   "DeletionPolicy": "Retain"
  },

What am I missing? If I create the same bucket through the console with bucket owner enforced, the resource get's created successfully.

Screen Shot 2022-04-21 at 10 32 32

Callback for receiving notification on a bucket

There is code under EnableNotificationOnABucket showing the usage of SetBucketNotificationConfigurationRequest.

I am looking for programmatic way of receiving notification on a bucket.
I searched the repository but haven't found such example.

Thanks

Announcements about S3 BitTorrent discontinuation shouldn't be buried in the commit history

Commit 0d17598 (13 May) announced the deprecation plan for S3 BitTorrent:

# doc_source/S3Torrent.md
+ As of April 29, 2021 Amazon S3 is discontinuing the S3 BitTorrent feature and it will no
+ longer be available to enable\. AWS will support customers currently using the
+ S3 BitTorrent feature for 12 months\. After April 29, 2022, BitTorrent clients will
+ no longer connect to Amazon S3\.

The entire page was then removed in commit 7a83e40 (19 May).

At present, the discontinuation notice doesn't appear anywhere in the S3 documentation; all mention of BitTorrent has been completely removed. If somebody is wondering if this feature is still supported or for how much longer it'll be available, that's pretty difficult to find right now.

It would be helpful if there was a page with this warning as part of the S3 documentation, so people could find this information more easily than poking through the commit history.

Incorrect information regarding versioning on `Deleting multiple objects`

Hello,

On the 'Deleting multiple objects' page, the below warning is given:

To delete an object in a versioning-enabled bucket with versioning Off, Amazon S3 creates a delete marker. To undo the delete action, delete this delete marker. To confirm this action, type delete.

To delete an object version in a versioning-enabled bucket with versioning On, Amazon S3 will permanently delete the object version. To confirm this action, type permanently delete.

This is incorrect & is the other way round.

It should be:

To delete an object in a versioning-enabled bucket with versioning Off, Amazon S3 will permanently delete the object version. To confirm this action, type permanently delete.

To delete an object version in a versioning-enabled bucket with versioning On, Amazon S3 creates a delete marker. To undo the delete action, delete this delete marker. To confirm this action, type delete.

No option available to create S3 specific cost and usage report

Following the guide from the snippet below, I've gotten this far, but I don't have the option to select Services for my report.

1. For **Services**, choose **Amazon Simple Storage Service**\.

I created a report with default settings which included some S3 API calls, but I don't think it included all, or it doesn't have the granularity I was looking for. I need to get the egress cost per IAM user.

How to get users list who have access to s3 bucket

I have created a policy with full control in S3. I want to read list of users/email address who can access designated s3 bucket?

When i used getBucketAcl it is throwing me my own permissions info (FULL_CONTROL).

List bucketPermissions = s3Client.getBucketAcl(bucket.getName())
.getGrantsAsList().stream().distinct()
.map(t -> t.getPermission().toString())
.collect(Collectors.toList());

Is there a way to read users list with S3 bucket access?

When to use "s3:x-amz-server-side-encryption" policy?

I'm trying to understand the use case for this policy directive "s3:x-amz-server-side-encryption" as demonstrated in this server side encryption page.

If one can enable transparent default encryption for the whole bucket, why use this policy?

image

Is it to be used where buckets do not have encryption enabled, and therefore enforcing encryption on specific conditions, like specific prefixes, extensions, etc? In this case some files are encryption, some are not.

When use one, and not the other?

{
  "Version": "2012-10-17",
  "Id": "PutObjectPolicy",
  "Statement": [
    {
      "Sid": "DenyIncorrectEncryptionHeader",
      "Effect": "Deny",
      "Principal": "*",
      "Action": "s3:PutObject",
      "Resource": "arn:aws:s3:::awsexamplebucket1/*",
      "Condition": {
        "StringNotEquals": {
          "s3:x-amz-server-side-encryption": "AES256"
        }
      }
    }
  ]
}

It enforces the client to select the encryption algorithm:

aws s3api put-object --body somefile.png --bucket mybucket --server-side-encryption 'AES256'

This is the help text form the AWS CLI for the --server-side-encryption option:

The server-side encryption algorithm used when storing this object in Amazon S3 (for example, AES256, aws:kms).

s3:TlsVersion condition example grants access to any (anonymous) users

The second example of Example 8: Requiring a minimum TLS version shows an use case which grants access to upload files to everyone ("Principal": "*") if they match the condition of the TLS Version.
In my opinion, this is a poor example inside the official documentation, since inexperienced users could simple copy & paste that example without realizing they open up their bucket to the whole world.

I would like to suggest to expand that example with an IAM role (pull request will follow) in order to mitigate this risky bucket policy.

Thanks!
Marcel

Host Zone

I followed the instructions and the Route 53 domain does not link to S3 bucket. The S3 bucket endpoint works, but the domain doesn't. http://gypsyparadise.io.s3-website-us-east-1.amazonaws.com

The only missing part I found, was "create host zone."

  1. Select "Create host zone"
  2. Enter domain name in box
  3. leave default "public hosted zone" selected
  4. Finish by selecting "Create host zone" at bottom

Could someone help me with this?

I will add to instructions if this is correct.

S3 Event Notifications on object version/deletemarker delete

The documentation covers what events are generated when the content changes on unversioned s3 buckets, but doesn't document what events if any are generated when a prior version becomes current due to the deletion of the current version (or for that matter, what events are generated when prior versions are deleted).

Currently, Amazon S3 can publish notifications for the following events:
+ **New object created events** — Amazon S3 supports multiple APIs to create objects\. You can request notification when only a specific API is used \(for example, `s3:ObjectCreated:Put`\)\. You can also use a wildcard \(for example, `s3:ObjectCreated:*`\) to request notification when an object is created regardless of the API used\.
+ **Object removal events** — Amazon S3 supports deletes of versioned and unversioned objects\. For information, see [Using versioning in S3 buckets](Versioning.md)\.
You can request notification when a non\-versioned object is deleted or a versioned object is permanently deleted by using the `s3:ObjectRemoved:Delete` event type\. Or you can request notification when a delete marker is created for a versioned object by using `s3:ObjectRemoved:DeleteMarkerCreated`\. You can also use a wildcard `s3:ObjectRemoved:*` to request notification anytime an object is deleted\. For information about deleting versioned objects, see [Deleting object versions from a versioning\-enabled bucket](DeletingObjectVersions.md)\.
+ **Restore object events **— Amazon S3 supports the restoration of objects archived to the S3 Glacier storage classes\. You request to be notified of object restoration completion by using `s3:ObjectRestore:Completed`\. You use `s3:ObjectRestore:Post` to request notification of the initiation of a restore\.
+ **Reduced Redundancy Storage \(RRS\) object lost events** — Amazon S3 sends a notification message when it detects that an object of the RRS storage class has been lost\.
+ **Replication events** — Amazon S3 sends event notifications for replication configurations that have S3 replication metrics or S3 Replication Time Control \(S3 RTC\) enabled\. You can monitor minute\-by\-minute progress of replication by tracking bytes pending, operations pending, and replication latency\. For information about replication metrics, see [Monitoring progress with replication metrics and Amazon S3 event notifications](replication-metrics.md)\.

# Deleting object versions from a versioning\-enabled bucket<a name="DeletingObjectVersions"></a>

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.