Difference between revisions of "Amazon Simple Storage Service (S3)"

From wikieduonline
Jump to navigation Jump to search
Tags: Mobile web edit, Mobile edit
 
(18 intermediate revisions by the same user not shown)
Line 4: Line 4:
  
 
== Features ==
 
== Features ==
* [[Encryption]]
+
* [[AWS S3 encryption|Encryption]]
 
* [[AWS S3 replication|Replication]]
 
* [[AWS S3 replication|Replication]]
* [[AWS S3 lifecycle|Lifecycle]]
+
* [[AWS S3 lifecycle|Lifecycle]]: <code>[[aws s3control put-bucket-lifecycle-configuration]]</code>
* [[AWS S3 versioning|Versioning]]
+
* [[AWS S3 versioning|Versioning]]: <code>[[aws s3api put-bucket-versioning]]</code>
 
* [[Object tagging]]
 
* [[Object tagging]]
 +
* [[Logging options for Amazon S3|Logging]]
  
 
== [[Amazon S3 Storage Classes]] ==
 
== [[Amazon S3 Storage Classes]] ==
 
* Amazon S3 Standard is the default class.
 
* Amazon S3 Standard is the default class.
 +
 
* [[Amazon S3 Intelligent-Tiering]] ([[AWS timeline|Sep 2021]])<ref>https://aws.amazon.com/blogs/aws/amazon-s3-intelligent-tiering-further-automating-cost-savings-for-short-lived-and-small-objects/</ref>
 
* [[Amazon S3 Intelligent-Tiering]] ([[AWS timeline|Sep 2021]])<ref>https://aws.amazon.com/blogs/aws/amazon-s3-intelligent-tiering-further-automating-cost-savings-for-short-lived-and-small-objects/</ref>
 +
 
* [[Amazon S3 Standard Infrequent Access (IA)]] is designed for less frequently accessed data. Typical use cases are backup and disaster recovery solutions.
 
* [[Amazon S3 Standard Infrequent Access (IA)]] is designed for less frequently accessed data. Typical use cases are backup and disaster recovery solutions.
 +
 
* Amazon S3 One Zone-Infrequent Access is designed for data that is not often needed but when required, needs to be accessed rapidly. Data is stored in one zone and if that zone is destroyed, all data is lost.
 
* Amazon S3 One Zone-Infrequent Access is designed for data that is not often needed but when required, needs to be accessed rapidly. Data is stored in one zone and if that zone is destroyed, all data is lost.
 +
 
* [[Amazon Glacier]] is designed for long-term storage of data that is infrequently accessed and where retrieval latency of minutes or hours is acceptable. "[[Glacier Deep Archive]]" is an alternative with a retrieval time of at least 12 hours, but 1/4th the price. It is intended as an alternative to magnetic tape libraries, and is designed for long term retention of data for 7 to 10 years.
 
* [[Amazon Glacier]] is designed for long-term storage of data that is infrequently accessed and where retrieval latency of minutes or hours is acceptable. "[[Glacier Deep Archive]]" is an alternative with a retrieval time of at least 12 hours, but 1/4th the price. It is intended as an alternative to magnetic tape libraries, and is designed for long term retention of data for 7 to 10 years.
 +
 +
* [[Amazon S3 Express One Zone]] ([[AWS timeline|Nov 2023]]): [[Directory buckets]]
  
 
== Pricing/Cost ==
 
== Pricing/Cost ==
Line 32: Line 39:
 
https://docs.aws.amazon.com/cli/latest/reference/s3/
 
https://docs.aws.amazon.com/cli/latest/reference/s3/
  
== Amazon S3 logs ==
+
== [[Logging options for Amazon S3|Amazon S3 logs]] ==
 
Amazon S3 allows users to enable or disable logging. If enabled, the logs are stored in Amazon S3 [[buckets]] which can then be analyzed. These logs contain useful information such as:
 
Amazon S3 allows users to enable or disable logging. If enabled, the logs are stored in Amazon S3 [[buckets]] which can then be analyzed. These logs contain useful information such as:
 
* Date and time of access to requested content
 
* Date and time of access to requested content
Line 39: Line 46:
 
* Turnaround time
 
* Turnaround time
 
* HTTP request message
 
* HTTP request message
 
  
 
== Encryption ==
 
== Encryption ==
Line 56: Line 62:
  
 
== News ==
 
== News ==
 +
* [[AWS timeline|Nov 2023]] [[AWS S3 Directory buckets]] introduced
 +
* [[AWS timeline|Nov 2023]] [[Amazon S3 now supports enabling S3 Object Lock on existing buckets]] <ref>https://aws.amazon.com/about-aws/whats-new/2023/11/amazon-s3-enabling-object-lock-buckets/</ref>
 +
* [[AWS timeline|Nov 2023]] [[Amazon S3 server access logging now supports automatic date-based partitioning]] <ref>https://aws.amazon.com/about-aws/whats-new/2023/11/amazon-s3-server-access-logging-date-partitioning/</ref>
 +
* [[AWS timeline|Jan 2023]] [[S3 encryption|Encryption]] activated by default <ref>https://docs.aws.amazon.com/AmazonS3/latest/userguide/default-encryption-faq.html</ref>
 
* Mar 2019 [[AWS S3 Glacier Deep Archive]]
 
* Mar 2019 [[AWS S3 Glacier Deep Archive]]
 +
* [[AWS Timeline|Nov 2018]] [[AWS Announces Amazon S3 Object Lock in all AWS Regions]] <ref>https://aws.amazon.com/about-aws/whats-new/2018/11/s3-object-lock/</ref>
  
 
== Terraform ==
 
== Terraform ==
Line 65: Line 76:
 
* [[Amazon EBS]], [[Amazon EFS]]
 
* [[Amazon EBS]], [[Amazon EFS]]
 
* [[Amazon S3 clients]]: [[CloudBerry Explorer]], [[Transmit 5]], [[Cyberduck]]
 
* [[Amazon S3 clients]]: [[CloudBerry Explorer]], [[Transmit 5]], [[Cyberduck]]
* [[s3fs-fuse]]
+
* <code>[[s3fs-fuse]]</code>
 
* [[AWS Storage Gateway]]
 
* [[AWS Storage Gateway]]
 
* [[Amazon Glacier]]
 
* [[Amazon Glacier]]
Line 84: Line 95:
 
* [[File hosting service]]
 
* [[File hosting service]]
 
* [[Google Cloud Storage (GCS)]]
 
* [[Google Cloud Storage (GCS)]]
* [[s3-website]]
+
* <code>[[s3-website]]</code>
 
* [[Object lock]], [[WORM]]
 
* [[Object lock]], [[WORM]]
 
* [[Bucket keys]]
 
* [[Bucket keys]]
 +
* [[S3 Express One Zone]]
  
 
== Limitations ==
 
== Limitations ==
Line 96: Line 108:
 
* Read https://www.sumologic.com/insight/10-things-might-not-know-using-s3/
 
* Read https://www.sumologic.com/insight/10-things-might-not-know-using-s3/
 
* Read How do I use [[CloudFront]] to serve a static website hosted on Amazon S3? https://aws.amazon.com/premiumsupport/knowledge-center/cloudfront-serve-static-website/
 
* Read How do I use [[CloudFront]] to serve a static website hosted on Amazon S3? https://aws.amazon.com/premiumsupport/knowledge-center/cloudfront-serve-static-website/
 +
* Learn about [[AWS cloudtrail data events]]
  
 
== See also ==
 
== See also ==
Line 106: Line 119:
  
 
[[Category:AWS]]
 
[[Category:AWS]]
 +
[[Category:AWS S3]]
 
[[Category:Object storage]]
 
[[Category:Object storage]]

Latest revision as of 04:38, 11 July 2024

wikipedia:Amazon S3 (March 2006) or Amazon Simple Storage Service a service offered by Amazon Web Services (AWS) since 2006 that provides Object Storage through a web service interface or CLI.

Features[edit]

Amazon S3 Storage Classes[edit]

  • Amazon S3 Standard is the default class.
  • Amazon S3 One Zone-Infrequent Access is designed for data that is not often needed but when required, needs to be accessed rapidly. Data is stored in one zone and if that zone is destroyed, all data is lost.
  • Amazon Glacier is designed for long-term storage of data that is infrequently accessed and where retrieval latency of minutes or hours is acceptable. "Glacier Deep Archive" is an alternative with a retrieval time of at least 12 hours, but 1/4th the price. It is intended as an alternative to magnetic tape libraries, and is designed for long term retention of data for 7 to 10 years.

Pricing/Cost[edit]

Commands[edit]

See also: AWS Command Line Tool (CLI)

https://docs.aws.amazon.com/cli/latest/reference/s3/

Amazon S3 logs[edit]

Amazon S3 allows users to enable or disable logging. If enabled, the logs are stored in Amazon S3 buckets which can then be analyzed. These logs contain useful information such as:

  • Date and time of access to requested content
  • Protocol used (HTTP, FTP, etc.)
  • HTTP status codes
  • Turnaround time
  • HTTP request message

Encryption[edit]

Encryption (2017) is supported in AWS S3 (default Advanced Encryption Standard (AES) 256bit)

Replication[edit]


News[edit]

Terraform[edit]

Related terms[edit]

Limitations[edit]

  • No bandwidth restriction
  • No size restriction by bucket

Activities[edit]

See also[edit]

  • https://aws.amazon.com/blogs/aws/amazon-s3-intelligent-tiering-further-automating-cost-savings-for-short-lived-and-small-objects/
  • https://docs.aws.amazon.com/cli/latest/reference/s3/cp.html
  • https://docs.aws.amazon.com/cli/latest/reference/s3/mb.html
  • https://aws.amazon.com/about-aws/whats-new/2023/11/amazon-s3-enabling-object-lock-buckets/
  • https://aws.amazon.com/about-aws/whats-new/2023/11/amazon-s3-server-access-logging-date-partitioning/
  • https://docs.aws.amazon.com/AmazonS3/latest/userguide/default-encryption-faq.html
  • https://aws.amazon.com/about-aws/whats-new/2018/11/s3-object-lock/
  • https://docs.aws.amazon.com/AmazonS3/latest/userguide/storage-inventory.html
  • Advertising: