# App Staging Synthesizer

> Version 2.275.0-alpha.0

> **Separate package**
>
> `@aws-cdk/app-staging-synthesizer-alpha` is not part of `aws-cdk-lib` — install it separately:
>
> ```sh
> npm install @aws-cdk/app-staging-synthesizer-alpha
> pip install aws-cdk.app-staging-synthesizer-alpha
> ```
>
> This module is [**experimental**](/stability) (alpha): its API may change in any release, without a major version bump.
---

![cdk-constructs: Experimental](https://img.shields.io/badge/cdk--constructs-experimental-important.svg?style=for-the-badge)

> The APIs of higher level constructs in this module are experimental and under active development.
> They are subject to non-backward compatible changes or removal in any future version. These are
> not subject to the [Semantic Versioning](https://semver.org/) model and breaking changes will be
> announced in the release notes. This means that while you may use them, you may need to update
> your source code when upgrading to a newer version of this package.

---

This library includes constructs aimed at replacing the current model of bootstrapping and providing
greater control of the bootstrap experience to the CDK user. The important constructs in this library
are as follows:

- the [`IStagingResources`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.IStagingResources) interface: a framework for an app-level bootstrap stack that handles
  file assets and docker assets.
- the [`DefaultStagingStack`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.DefaultStagingStack), which is a works-out-of-the-box implementation of the [`IStagingResources`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.IStagingResources)
  interface.
- the [`AppStagingSynthesizer`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.AppStagingSynthesizer), a new CDK synthesizer that will synthesize CDK applications with
  the staging resources provided.

> As this library is `experimental`, there are features that are not yet implemented. Please look
> at the list of [Known Limitations](#known-limitations) before getting started.

To get started, update your CDK App with a new `defaultStackSynthesizer`:

```ts
import { BucketEncryption } from 'aws-cdk-lib/aws-s3';

const app = new App({
  defaultStackSynthesizer: AppStagingSynthesizer.defaultResources({
    appId: 'my-app-id', // put a unique id here
    stagingBucketEncryption: BucketEncryption.S3_MANAGED,
  }),
});
```

This will introduce a [`DefaultStagingStack`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.DefaultStagingStack) in your CDK App and staging assets of your App
will live in the resources from that stack rather than the CDK Bootstrap stack.

If you are migrating from a different version of synthesis your updated CDK App will target
the resources in the [`DefaultStagingStack`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.DefaultStagingStack) and no longer be tied to the bootstrapped resources
in your account.

## Bootstrap Model

In our default bootstrapping process, when you run `cdk bootstrap aws://<account>/<region>`, the following
resources are created:

- It creates Roles to assume for cross-account deployments and for Pipeline deployments;
- It creates staging resources: a global S3 bucket and global ECR repository to hold CDK assets;
- It creates Roles to write to the S3 bucket and ECR repository;

Because the bootstrapping resources include regional resources, you need to bootstrap
every region you plan to deploy to individually. All assets of all CDK apps deploying
to that account and region will be written to the single S3 Bucket and ECR repository.

By using the synthesizer in this library, instead of the
`DefaultStackSynthesizer`, a different set of staging resources will be created
for every CDK application, and they will be created automatically as part of a
regular deployment, in a separate Stack that is deployed before your application
Stacks. The staging resources will be one S3 bucket, and *one ECR repository per
image*, and Roles necessary to access those buckets and ECR repositories. The
Roles from the default bootstrap stack are still used (though their use can be
turned off).

This has the following advantages:

- Because staging resources are now application-specific, they can be fully cleaned up when you clean up
  the application.
- Because there is now one ECR repository per image instead of one ECR repository for all images, it is
  possible to effectively use ECR life cycle rules (for example, retain only the most recent 5 images)
  to cut down on storage costs.
- Resources between separate CDK Apps are separated so they can be cleaned up and lifecycle
  controlled individually.
- Because the only shared bootstrapping resources required are Roles, which are global resources,
  you now only need to bootstrap every account in one Region (instead of every Region). This makes it
  easier to do with CloudFormation StackSets.

For the deployment roles, this synthesizer still uses the Roles from the default
bootstrap stack, and nothing else. The staging resources from that bootstrap
stack will be unused. You can customize the template to remove those resources
if you prefer.  In the future, we will provide a bootstrap stack template with
only those Roles, specifically for use with this synthesizer.

## Using the Default Staging Stack per Environment

The most common use case will be to use the built-in default resources. In this scenario, the
synthesizer will create a new Staging Stack in each environment the CDK App is deployed to store
its staging resources. To use this kind of synthesizer, use `AppStagingSynthesizer.defaultResources()`.

```ts
import { BucketEncryption } from 'aws-cdk-lib/aws-s3';

const app = new App({
  defaultStackSynthesizer: AppStagingSynthesizer.defaultResources({
    appId: 'my-app-id',
    stagingBucketEncryption: BucketEncryption.S3_MANAGED,

    // The following line is optional. By default it is assumed you have bootstrapped in the same
    // region(s) as the stack(s) you are deploying.
    deploymentIdentities: DeploymentIdentities.defaultBootstrapRoles({ bootstrapRegion: 'us-east-1' }),
  }),
});
```

Every CDK App that uses the [`DefaultStagingStack`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.DefaultStagingStack) must include an `appId`. This should
be an identifier unique to the app and is used to differentiate staging resources associated
with the app.

### Default Staging Stack

The Default Staging Stack includes all the staging resources necessary for CDK Assets. The below example
is of a CDK App using the [`AppStagingSynthesizer`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.AppStagingSynthesizer) and creating a file asset for the Lambda Function
source code. As part of the [`DefaultStagingStack`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.DefaultStagingStack), an S3 bucket and IAM role will be created that will be
used to upload the asset to S3.

```ts
import { BucketEncryption } from 'aws-cdk-lib/aws-s3';

const app = new App({
  defaultStackSynthesizer: AppStagingSynthesizer.defaultResources({
    appId: 'my-app-id',
    stagingBucketEncryption: BucketEncryption.S3_MANAGED,
  }),
});

const stack = new Stack(app, 'my-stack');

new lambda.Function(stack, 'lambda', {
  code: lambda.AssetCode.fromAsset(path.join(__dirname, 'assets')),
  handler: 'index.handler',
  runtime: lambda.Runtime.PYTHON_3_9,
});

app.synth();
```

### Custom Roles

You can customize some or all of the roles you'd like to use in the synthesizer as well,
if all you need is to supply custom roles (and not change anything else in the [`DefaultStagingStack`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.DefaultStagingStack)):

```ts
import { BucketEncryption } from 'aws-cdk-lib/aws-s3';

const app = new App({
  defaultStackSynthesizer: AppStagingSynthesizer.defaultResources({
    appId: 'my-app-id',
    stagingBucketEncryption: BucketEncryption.S3_MANAGED,
    deploymentIdentities: DeploymentIdentities.specifyRoles({
      cloudFormationExecutionRole: BootstrapRole.fromRoleArn('arn:aws:iam::123456789012:role/Execute'),
      deploymentRole: BootstrapRole.fromRoleArn('arn:aws:iam::123456789012:role/Deploy'),
      lookupRole: BootstrapRole.fromRoleArn('arn:aws:iam::123456789012:role/Lookup'),
    }),
  }),
});
```

Or, you can ask to use the CLI credentials that exist at deploy-time.
These credentials must have the ability to perform CloudFormation calls,
lookup resources in your account, and perform CloudFormation deployment.
For a full list of what is necessary, see `LookupRole`, `DeploymentActionRole`,
and `CloudFormationExecutionRole` in the
[bootstrap template](https://github.com/aws/aws-cdk-cli/blob/main/packages/aws-cdk/lib/api/bootstrap/bootstrap-template.yaml).

```ts
import { BucketEncryption } from 'aws-cdk-lib/aws-s3';

const app = new App({
  defaultStackSynthesizer: AppStagingSynthesizer.defaultResources({
    appId: 'my-app-id',
    stagingBucketEncryption: BucketEncryption.S3_MANAGED,
    deploymentIdentities: DeploymentIdentities.cliCredentials(),
  }),
});
```

The default staging stack will create roles to publish to the S3 bucket and ECR repositories,
assumable by the deployment role. You can also specify an existing IAM role for the
`fileAssetPublishingRole` or `imageAssetPublishingRole`:

```ts
import { BucketEncryption } from 'aws-cdk-lib/aws-s3';

const app = new App({
  defaultStackSynthesizer: AppStagingSynthesizer.defaultResources({
    appId: 'my-app-id',
    stagingBucketEncryption: BucketEncryption.S3_MANAGED,
    fileAssetPublishingRole: BootstrapRole.fromRoleArn('arn:aws:iam::123456789012:role/S3Access'),
    imageAssetPublishingRole: BootstrapRole.fromRoleArn('arn:aws:iam::123456789012:role/ECRAccess'),
  }),
});
```

### Deploy Time S3 Assets

There are two types of assets:

- Assets used only during deployment. These are used to hand off a large piece of data to another
service, that will make a private copy of that data. After deployment, the asset is only necessary for
a potential future rollback.
- Assets accessed throughout the running life time of the application.

Examples of assets that are only used at deploy time are CloudFormation Templates and Lambda Code
bundles. Examples of assets accessed throughout the life time of the application are script files
downloaded to run in a CodeBuild Project, or on EC2 instance startup. ECR images are always application
life-time assets. S3 deploy time assets are stored with a `deploy-time/` prefix, and a lifecycle rule will collect them after a configurable number of days.

Lambda assets are by default marked as deploy time assets:

```ts
declare const stack: Stack;
new lambda.Function(stack, 'lambda', {
  code: lambda.AssetCode.fromAsset(path.join(__dirname, 'assets')), // lambda marks deployTime = true
  handler: 'index.handler',
  runtime: lambda.Runtime.PYTHON_3_9,
});
```

Or, if you want to create your own deploy time asset:

```ts
import { Asset } from 'aws-cdk-lib/aws-s3-assets';

declare const stack: Stack;
const asset = new Asset(stack, 'deploy-time-asset', {
  deployTime: true,
  path: path.join(__dirname, 'deploy-time-asset'),
});
```

By default, we store deploy time assets for 30 days, but you can change this number by specifying
`deployTimeFileAssetLifetime`. The number you specify here is how long you will be able to roll back
to a previous version of an application just by doing a CloudFormation deployment with the old
template, without rebuilding and republishing assets.

```ts
import { BucketEncryption } from 'aws-cdk-lib/aws-s3';

const app = new App({
  defaultStackSynthesizer: AppStagingSynthesizer.defaultResources({
    appId: 'my-app-id',
    stagingBucketEncryption: BucketEncryption.S3_MANAGED,
    deployTimeFileAssetLifetime: Duration.days(100),
  }),
});
```

### Lifecycle Rules on ECR Repositories

By default, we store a maximum of 3 revisions of a particular docker image asset. This allows
for smooth faciliation of rollback scenarios where we may reference previous versions of an
image. When more than 3 revisions of an asset exist in the ECR repository, the oldest one is
purged.

To change the number of revisions stored, use `imageAssetVersionCount`:

```ts
import { BucketEncryption } from 'aws-cdk-lib/aws-s3';

const app = new App({
  defaultStackSynthesizer: AppStagingSynthesizer.defaultResources({
    appId: 'my-app-id',
    stagingBucketEncryption: BucketEncryption.S3_MANAGED,
    imageAssetVersionCount: 10,
  }),
});
```

### Auto Delete Staging Assets on Deletion

By default, the staging resources will be cleaned up on stack deletion. That means that the
S3 Bucket and ECR Repositories are set to `RemovalPolicy.DESTROY` and have `autoDeleteObjects`
or `emptyOnDelete` turned on. This creates custom resources under the hood to facilitate
cleanup. To turn this off, specify `autoDeleteStagingAssets: false`.

```ts
import { BucketEncryption } from 'aws-cdk-lib/aws-s3';

const app = new App({
  defaultStackSynthesizer: AppStagingSynthesizer.defaultResources({
    appId: 'my-app-id',
    stagingBucketEncryption: BucketEncryption.S3_MANAGED,
    autoDeleteStagingAssets: false,
  }),
});
```

### Staging Bucket Encryption

You must explicitly specify the encryption type for the staging bucket via the `stagingBucketEncryption` property. In
future versions of this package, the default will be `BucketEncryption.S3_MANAGED`.

In previous versions of this package, the default was to use KMS encryption for the staging bucket. KMS keys cost
$1/month, which could result in unexpected costs for users who are not aware of this. As we stabilize this module
we intend to make the default S3-managed encryption, which is free. However, the migration path from KMS to S3
managed encryption for existing buckets is not straightforward. Therefore, for now, this property is required.

If you have an existing staging bucket encrypted with a KMS key, you will likely want to set this property to
`BucketEncryption.KMS`. If you are creating a new staging bucket, you can set this property to
`BucketEncryption.S3_MANAGED` to avoid the cost of a KMS key.

You can learn more about choosing a bucket encryption type in the
[S3 documentation](https://docs.aws.amazon.com/AmazonS3/latest/userguide/serv-side-encryption.html).

## Using a Custom Staging Stack per Environment

If you want to customize some behavior that is not configurable via properties,
you can implement your own class that implements [`IStagingResources`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.IStagingResources). To get a head start,
you can subclass [`DefaultStagingStack`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.DefaultStagingStack).

```ts
interface CustomStagingStackOptions extends DefaultStagingStackOptions {}

class CustomStagingStack extends DefaultStagingStack {
}
```

Or you can roll your own staging resources from scratch, as long as it implements [`IStagingResources`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.IStagingResources).

```ts
interface CustomStagingStackProps extends StackProps {}

class CustomStagingStack extends Stack implements IStagingResources {
  public constructor(scope: Construct, id: string, props: CustomStagingStackProps) {
    super(scope, id, props);
  }

  public addFile(asset: FileAssetSource): FileStagingLocation {
    return {
      bucketName: 'amzn-s3-demo-bucket',
      assumeRoleArn: 'myArn',
      dependencyStack: this,
    };
  }

  public addDockerImage(asset: DockerImageAssetSource): ImageStagingLocation {
    return {
      repoName: 'myRepo',
      assumeRoleArn: 'myArn',
      dependencyStack: this,
    };
  }
}
```

Using your custom staging resources means implementing a `CustomFactory` class and calling the
`AppStagingSynthesizer.customFactory()` static method. This has the benefit of providing a
custom Staging Stack that can be created in every environment the CDK App is deployed to.

```ts
class CustomFactory implements IStagingResourcesFactory {
  public obtainStagingResources(stack: Stack, context: ObtainStagingResourcesContext) {
    const myApp = App.of(stack);

    return new CustomStagingStack(myApp!, `CustomStagingStack-${context.environmentString}`, {});
  }
}

const app = new App({
  defaultStackSynthesizer: AppStagingSynthesizer.customFactory({
    factory: new CustomFactory(),
    oncePerEnv: true, // by default
  }),
});
```

## Using an Existing Staging Stack

Use `AppStagingSynthesizer.customResources()` to supply an existing stack as the Staging Stack.
Make sure that the custom stack you provide implements [`IStagingResources`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.IStagingResources).

```ts
const resourceApp = new App();
const resources = new CustomStagingStack(resourceApp, 'CustomStagingStack', {});

const app = new App({
  defaultStackSynthesizer: AppStagingSynthesizer.customResources({
    resources,
  }),
});
```

## Known Limitations

Since this module is experimental, there are some known limitations:

- Currently this module does not support CDK Pipelines. You must deploy CDK Apps using this
  synthesizer via `cdk deploy`. Please upvote [this issue](https://github.com/aws/aws-cdk/issues/26118)
  to indicate you want this.
- This synthesizer only needs a bootstrap stack with Roles, without staging resources. We
  haven't written such a bootstrap stack yet; at the moment you can use the existing modern
  bootstrap stack, the staging resources in them will just go unused. You can customize the
  template to remove them if desired.
- Due to limitations on the CloudFormation template size, CDK Applications can have
  at most 20 independent ECR images. Please upvote [this issue](https://github.com/aws/aws-cdk/issues/26119)
  if you need more than this.

## Types

| Name | Kind | Summary |
| --- | --- | --- |
| [`AppStagingSynthesizer`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.AppStagingSynthesizer) | Class | App Staging Synthesizer. |
| [`AppStagingSynthesizerOptions`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.AppStagingSynthesizerOptions) | Struct | Options that apply to all AppStagingSynthesizer variants. |
| [`BootstrapRole`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.BootstrapRole) | Class | Bootstrapped role specifier. |
| [`BootstrapRoles`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.BootstrapRoles) | Struct | Roles that are bootstrapped to your account. |
| [`CustomFactoryOptions`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.CustomFactoryOptions) | Struct | Properties for customFactory static method. |
| [`CustomResourcesOptions`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.CustomResourcesOptions) | Struct | Properties for customResources static method. |
| [`DefaultBootstrapRolesOptions`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.DefaultBootstrapRolesOptions) | Struct | Options for `DeploymentIdentities.defaultBootstrappedRoles`. |
| [`DefaultResourcesOptions`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.DefaultResourcesOptions) | Struct | Properties for stackPerEnv static method. |
| [`DefaultStagingStack`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.DefaultStagingStack) | Construct | A default Staging Stack that implements IStagingResources. |
| [`DefaultStagingStackOptions`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.DefaultStagingStackOptions) | Struct | User configurable options to the DefaultStagingStack. |
| [`DefaultStagingStackProps`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.DefaultStagingStackProps) | Struct | Default Staging Stack Properties. |
| [`DeploymentIdentities`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.DeploymentIdentities) | Class | Deployment identities are the class of roles to be assumed by the CDK when deploying the App. |
| [`FileStagingLocation`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.FileStagingLocation) | Struct | Information returned by the Staging Stack for each file asset. |
| [`ImageStagingLocation`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.ImageStagingLocation) | Struct | Information returned by the Staging Stack for each image asset. |
| [`IStagingResources`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.IStagingResources) | Interface | Staging Resource interface. |
| [`IStagingResourcesFactory`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.IStagingResourcesFactory) | Interface | Staging Resource Factory interface. |
| [`ObtainStagingResourcesContext`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.ObtainStagingResourcesContext) | Struct | Context parameters for the 'obtainStagingResources' function. |
| [`StagingRoles`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.StagingRoles) | Struct | Roles that are included in the Staging Stack (for access to Staging Resources). |
| [`UsingAppStagingSynthesizer`](/v2/docs/@aws-cdk_app-staging-synthesizer-alpha.UsingAppStagingSynthesizer) | Construct | This is a dummy construct meant to signify that a stack is utilizing the AppStagingSynthesizer. |