AWS ParallelCluster
AWS ParallelCluster User Guide

Setting Up a Custom AWS ParallelCluster Node Package

Warning

The following are instructions for using a custom version of the AWS ParallelCluster node package. This is an advanced method of customizing AWS ParallelCluster, with potential issues that can be hard to debug. The AWS ParallelCluster team highly recommends using the scripts in Custom Bootstrap Actions for customization, because post-install hooks are generally easier to debug and more portable across releases of AWS ParallelCluster.

Steps

  1. Identify the AWS ParallelCluster node working directory where you have cloned the AWS ParallelCluster node code.

    _nodeDir=<path to node package>
  2. Detect the current version of the AWS ParallelCluster node.

    _version=$(grep "version = \"" ${_nodeDir}/setup.py |awk '{print $3}' | tr -d \")
  3. Create an archive of the AWS ParallelCluster Node.

    cd "${_nodeDir}" _stashName=$(git stash create) git archive --format tar --prefix="aws-parallelcluster-node-${_version}/" "${_stashName:-HEAD}" | gzip > "aws-parallelcluster-node-${_version}.tgz"
  4. Create an Amazon S3 bucket and upload the archive into the bucket. Give public readable permission through a public-read ACL.

    _bucket=<the bucket name> aws s3 cp --acl public-read aws-parallelcluster-node-${_version}.tgz s3://${_bucket}/node/aws-parallelcluster-node-${_version}.tgz
  5. Add the following variable to the AWS ParallelCluster configuration file, under the "[cluster ...] section".

    extra_json = { "cluster" : { "custom_node_package" : "https://${_bucket}.s3.<the bucket region>.amazonaws.com/node/aws-parallelcluster-node-${_version}.tgz" } }

On this page: