AWS Marketplace
Providers Guide

Testing Your SaaS Product

During the onboarding process, you create a second AWS account ID for testing your product. You sign in to the test account to view your SaaS product on AWS Marketplace and use it to verify the metering and billing process on an ongoing basis. You can also use seller reports provided through the AWS Marketplace Management Portal to confirm that metered usage corresponds with the account identifier for your customers. Any charges that this test account incurs when testing your product can be voided by submitting a refund request.

We whitelist the product so that it's visible only to your account and any other accounts that you own and specify. These accounts can be used to subscribe to your product and confirm that everything is working properly.

Note

If you create a SaaS product for use in the AWS GovCloud (US-West) Region, that SaaS product must be tested and meet the requirements for the AWS GovCloud (US) Region.

Test New Customer Registration

Verify the customer registration process works, and that the customer can accept your terms and then register:

  1. Create an account in your product.

  2. Verify that your redirect page is functional.

  3. Verify that your website resolves the registration token for a customer identifier.

  4. Verify that your website allows the creation of an account.

  5. Verify that the product code matches the one assigned to your product.

  6. Verify that the customer identifier is added to your accounts database.

  7. Verify that you receive a subscription notification.

(Optional) Test Existing Customer Registration

You can build your landing page so that existing accounts can be changed to use AWS for billing. Repeat the process in the previous section with an existing account that doesn't have AWS billing information attached.

Verify Records Using AWS CloudTrail

BatchMeterUsage operation calls are captured by AWS CloudTrail. You can use CloudTrail to verify that the SaaS metering records that you sent are accurate by searching for records with the event name BatchMeterUsage. You can also use CloudTrail to audit records over time.

For more information, see the AWS Marketplace Metering Service API and CloudTrail Supported Services and Integrations in the AWS CloudTrail User Guide.

Test Duplicate Accounts

Use your test account to create an account in your system and then repeat the process. Verify that you are unable to create an account in your SaaS product because another account with that customer identifier already exists.

Test Metering

Sign in to a test account in your SaaS product and begin consuming resources for a SaaS subscriptions product. For a SaaS contracts product, purchase a contract first and then consume resources above the contracted amount. Verify that your system is emitting metering records. Confirm with your AWS Marketplace representative that these records have been received.

To test entitlements, sign in to a test account and purchase your SaaS contracts product. Then perform the following steps:

  1. Verify that the entitlements you retrieve from the AWS Marketplace Entitlement Service match your purchase.

  2. Verify that your system provisions access to your product’s features and resources based on the entitlements you retrieve.

  3. Verify that your system updates customers’ entitlements after a contract upgrade.

Test Unsubscribe

Unsubscribe your test account through the Your Software page on the AWS Marketplace website. Verify the following information:

  • Your product received an unsubscribe-pending notification.

  • Your product responds as expected in an unsubscribe scenario. For example, your product might complete existing work, but prevent work from being created for your test account.

  • Your product received an unsubscribe-success notification.

  • Your product no longer sends metering records after receiving the unsubscribe-success notification.