PERF03-BP02 Evaluate available configuration options
Evaluate the various characteristics and configuration options and
how they relate to storage. Understand where and how to use
provisioned IOPS, SSDs, magnetic storage, object storage, archival
storage, or ephemeral storage to optimize storage space and
performance for your workload.
Amazon EBS
provides a range of options that allow you to optimize storage
performance and cost for your workload. These options are divided
into two major categories: SSD-backed storage for transactional
workloads, such as databases and boot volumes (performance depends
primarily on IOPS), and HDD-backed storage for throughput-intensive
workloads, such as MapReduce and log processing (performance depends
primarily on MB/s).
SSD-backed volumes include the highest performance provisioned IOPS
SSD for latency-sensitive transactional workloads and
general-purpose SSD that balance price and performance for a wide
variety of transactional data.
Amazon S3 transfer acceleration allows fast transfer of files over
long distances between your client and your S3 bucket. Transfer
acceleration leverages Amazon CloudFront globally distributed edge
locations to route data over an optimized network path. For a
workload in an S3 bucket that has intensive GET requests, use Amazon S3 with CloudFront. When uploading large files, use multi-part
uploads with multiple parts uploading at the same time to help
maximize network throughput.
Amazon Elastic File System (Amazon EFS) provides a simple, scalable, fully
managed elastic NFS file system for use with AWS Cloud services and
on-premises resources. To support a wide variety of cloud storage
workloads, Amazon EFS offers two performance modes: general purpose
performance mode, and max I/O performance mode. There are also two
throughput modes to choose from for your file system: Bursting
Throughput, and Provisioned Throughput. To determine which settings
to use for your workload, see the
Amazon EFS User Guide.
Amazon FSx
provides four file systems to choose from:
Amazon FSx for
Windows File Server for enterprise workloads,
Amazon FSx for
Lustre for high-performance workloads,
Amazon FSx for NetApp ONTAP for NetApps popular ONTAP file system,
and
Amazon FSx for OpenZFS for Linux-based file servers. FSx is
SSD-backed and is designed to deliver fast, predictable, scalable,
and consistent performance. Amazon FSx file systems deliver
sustained high read and write speeds and consistent low latency data
access. You can choose the throughput level you need to match your
workload’s needs.
Common anti-patterns:
-
You only use one storage type, such as Amazon EBS, for all
workloads.
-
You use Provisioned IOPS for all workloads without real-world
testing against all storage tiers.
-
You assume that all workloads have similar storage access
performance requirements.
Benefits of establishing this best
practice: Evaluating all storage service options can
reduce the cost of infrastructure and the effort required to
maintain your workloads. It can potentially accelerate your time to
market for deploying new services and features.
Level of risk exposed if this best practice
is not established: Medium
Implementation guidance
Determine storage characteristics: When you evaluate a storage
solution, determine which storage characteristics you require,
such as ability to share, file size, cache size, latency,
throughput, and persistence of data. Then match your requirements
to the AWS service that best fits your needs.
Resources
Related documents:
Related videos:
Related examples:
