Architecture Overview - Scale-Out Computing on AWS

Architecture Overview

Deploying this solution builds the following environment in the AWS Cloud.

        Scale-Out Computing on AWS architecture on AWS

Figure 1: Scale-Out Computing on AWS architecture

Scale-Out Computing on AWS uses AWS CloudFormation templates to deploy the infrastructure components, AWS services, operating systems and management software, and custom logic scripts to create a scale-out design and engineering workflow reference implementation.

At its core, this solution implements a scheduler Amazon Elastic Compute Cloud (Amazon EC2) instance, which leverages AWS CloudFormation and Amazon EC2 Auto Scaling to automatically provision the resources necessary to execute cluster user tasks such as scale-out compute jobs and remote visualization sessions.

The solution also deploys Amazon Elastic File System (Amazon EFS) for persistent storage; AWS Lambda functions to verify the required prerequisites and create a default signed certificate for an Application Load Balancer (ALB) to manage access to Desktop Cloud Visualization (DCV) workstation sessions; an Amazon Elasticsearch Service (Amazon ES) cluster to store job and host information; and AWS Secrets Manager to store the solution configuration files. The solution also leverages AWS Identity and Access Management (IAM) roles to enforce least privileged access.