- 11 Jan 2023
- 4 Minutes to read
- Print
- DarkLight
- PDF
Amazon S3 Bucket (Device Type)
- Updated on 11 Jan 2023
- 4 Minutes to read
- Print
- DarkLight
- PDF
Device Type Description
An Amazon S3 Bucket is a public cloud storage resource available in Amazon Web Services' (AWS) Simple Storage Service (S3), an object storage offering. Amazon S3 buckets, which are similar to file folders, store objects, which consist of data and its descriptive metadata. (Taken from searchaws.techtarget.com.)
The Amazon S3 Bucket device type allows you to monitor a variety of metrics from an Amazon S3 bucket.
Device License Value: 0.1 (See Device Licenses for more information.)
Collected Statistics
Amazon S3 Bucket statistics are split into three categories in Amazon CloudWatch:
- Storage metrics
- Request metrics
- Replication metrics.
Netreo collects and stores the following statistics for the Amazon S3 Bucket device type.
See https://docs.aws.amazon.com/AmazonS3/latest/userguide/cloudwatch-monitoring.html for more information about Amazon S3 metrics.
See Data Retention for information on how long this data is stored in Netreo.
Request Metrics
Request metrics are supplied by Amazon at 1-minute intervals, but are collected by Netreo at 5-minute intervals. The description for each statistic in the table below indicates how the retrieved 1-minute values are computed into 5-minute values.
Collected Request Metrics
Metric | Description |
---|---|
AllRequests | The total number of HTTP requests made to an Amazon S3 bucket, regardless of type. If you're using a metrics configuration with a filter, then this metric only returns the HTTP requests made to the objects in the bucket that meet the filter's requirements. Units: Count Netreo computed 5-minute value: Sum |
GetRequests | The number of HTTP GET requests made for objects in an Amazon S3 bucket. This doesn't include list operations. Units: Count Netreo computed 5-minute value: Sum Note: Paginated list-oriented requests, like List Multipart Uploads, List Parts, Get Bucket Object versions, and others, are not included in this metric. |
PutRequests | The number of HTTP PUT requests made for objects in an Amazon S3 bucket. Units: Count Netreo computed 5-minute value: Sum |
DeleteRequests | The number of HTTP DELETE requests made for objects in an Amazon S3 bucket. This also includes Delete Multiple Objects requests. This metric shows the number of requests, not the number of objects deleted. Units: Count Netreo computed 5-minute value: Sum |
HeadRequests | The number of HTTP HEAD requests made to an Amazon S3 bucket. Units: Count Netreo computed 5-minute value: Sum |
PostRequests | The number of HTTP POST requests made to an Amazon S3 bucket. Units: Count Netreo computed 5-minute value: Sum Note: Delete Multiple Objects and SELECT Object Content requests are not included in this metric. |
SelectRequests | The number of Amazon S3 SELECT Object Content requests made for objects in an Amazon S3 bucket. Units: Count Netreo computed 5-minute value: Sum |
SelectBytesScanned | The number of bytes of data scanned with Amazon S3 SELECT Object Content requests in an Amazon S3 bucket. Units: Bytes Netreo computed 5-minute value: Sum |
SelectBytesReturned | The number of bytes of data returned with Amazon S3 SELECT Object Content requests in an Amazon S3 bucket. Units: Bytes Netreo computed 5-minute value: Sum |
ListRequests | The number of HTTP requests that list the contents of a bucket. Units: Count Netreo computed 5-minute value: Sum |
BytesDownloaded | The number of bytes downloaded for requests made to an Amazon S3 bucket, where the response includes a body. Units: Bytes Netreo computed 5-minute value: Sum |
BytesUploaded | The number of bytes uploaded that contain a request body, made to an Amazon S3 bucket. Units: Bytes Netreo computed 5-minute value: Sum |
4xxErrors | The number of HTTP 4xx client error status code requests made to an Amazon S3 bucket with a value of either 0 or 1. The average statistic shows the error rate, and the sum statistic shows the count of that type of error, during each period. Units: Count Netreo computed 5-minute value: Sum |
5xxErrors | The number of HTTP 5xx server error status code requests made to an Amazon S3 bucket with a value of either 0 or 1. The average statistic shows the error rate, and the sum statistic shows the count of that type of error, during each period. Units: Counts Netreo computed 5-minute value: Sum |
FirstByteLatency | The per-request time from the complete request being received by an Amazon S3 bucket to when the response starts to be returned. Units: Milliseconds Netreo computed 5-minute value: Average |
TotalRequestLatency | The elapsed per-request time from the first byte received to the last byte sent to an Amazon S3 bucket. This includes the time taken to receive the request body and send the response body, which is not included in FirstByteLatency. Units: Milliseconds Netreo computed 5-minute value: Average |
Requirements
Netreo Configuration
In order for Netreo to retrieve statistics for an Amazon S3 bucket device type, you must add the appropriate credentials for your Amazon account.
- Log in to Netreo as a user with the SuperAdmin access level.
- Go to the main menu and select Administration > Modules > Cloud Monitoring to open the Cloud Monitoring Administration page.
- In the Amazon Web Services panel select Add AWS.
- Enter the account information provided by Amazon for the account that contains the S3 buckets that you wish to monitor.
- Select Save.
- Repeat for each Amazon account you wish to add.
- Move on to External Configuration below.
External Configuration
Statistics for the Amazon S3 bucket device type cannot be collected by Netreo until the following configuration steps have been taken within your Amazon S3 account.
- Create a request metrics filter in CloudWatch for all object you wish to monitor.
See Amazon's documentation here for specific instructions on how to create a request metrics filter.