Using Amazon S3 compatible storage on Snow Family devices - AWS Snowball Edge Developer Guide

Using Amazon S3 compatible storage on Snow Family devices

Amazon S3 compatible storage on Snow Family devices delivers secure object storage with increased resiliency, scale, and an expanded Amazon S3 API feature-set to rugged, mobile edge, and disconnected environments. Using Amazon S3 compatible storage on Snow Family devices, you can store data and run highly available applications on Snow Family devices for edge computing.

You can deploy Amazon S3 compatible storage on Snow Family devices in standalone configuration or in cluster configuration. In standalone configuration, you can provision S3 capacity on the device and the balance is available as block storage. In cluster configuration, all data disk capacity is used for S3 storage. A cluster may consist of a minimum of 3 devices up to a maximum of 16 devices. Depending on the size of cluster, S3 service is designed to sustain device fault tolerance of 1 or 2 devices.

With AWS DataSync, you can transfer objects between Amazon S3 compatible storage on Snow Family devices on a Snowball Edge device and AWS storage services. For more information, see Configuring transfers with S3 compatible storage on Snowball Edge in the AWS DataSync User Guide.

Following is the Amazon S3 compatible storage on Snow Family devices storage capacity and block storage capacity for a standalone device using Amazon S3 compatible storage on Snow Family devices. For fault tollerence and storage capacity of clusters, see this table.

Snowball Edge Compute Optimized and Compute Optimized with GPU
Storage capacity of Amazon S3 compatible storage on Snow Family devices and block storage of Snowball Edge Compute Optimized (with AMD EPYC Gen1, HDD, and optional GPU) devices
Amazon S3 compatible storage on Snow Family devices storage capacity (in TB) Block storage capacity (in TB)
2.5 41
5.5 37
8.5 33
11 29
14 25
17 21
19.5 17
22.5 13
25.5 9
28.5 5
31 1
Snowball Edge Compute Optimized with NVMe storage
Storage capacity of Amazon S3 compatible storage on Snow Family devices and block storage of Snowball Edge Compute Optimized (Compute Optimized with AMD EPYC Gen2 and NVMe) devices
Amazon S3 compatible storage on Snow Family devices storage capacity (in TB) Block storage capacity (in TB)
3 17.5
5.5 14.5
10.5 8.5
12 6.5
13 5.5
16.5 1.5

Amazon S3 compatible storage on Snow Family devices specifications:

  • The maximum number of Snow Family device buckets is 100 per device or per cluster.

  • The S3 on Snow Family device bucket owner account owns all objects in the bucket.

  • Only the S3 on Snow Family device bucket owner account can perform operations on the bucket.

  • Object size limitations are consistent with those in Amazon S3.

  • All objects stored on S3 on Snow Family devices have SNOW as the storage class.

  • By default, all objects stored in the SNOW storage class are stored using server-side encryption with Amazon S3 managed encryption keys (SSE-S3). You can also explicitly choose to store objects by using server-side encryption with customer-provided encryption keys (SSE-C).

  • If there is not enough space to store an object on your Snow Family device, the API returns an insufficient capacity exception (ICE).

Topics