Testing

PDF

Functional tests

This solution includes a set of functional tests against the deployed solution to verify the basic operations of this solution. Users can run these tests by using the following steps:

1. Deploy this solution. If you have previously deployed this solution, skip this step.

2. Clone the solution’s repository.

3. Open a new terminal session and navigate to the source/tests/functional_tests directory.

4. Run the following command. Replace the <stack-name> and <profile-name> variables with name of the stack deployed in step 1 and profile name of AWS CLI credentials, respectively. Replace the <in-venv-flag> with 1 if the tests are running in an existing Python virtual environment or with 0 if not. See the README.md file of functional tests on the GitHub repository for further details.

   $ sh run-functional-tests.sh [-h] [-v] [--test-file-name] [--extras] [--region] --stack-name <stack-name> --profile <profile-name> --in-venv <in-venv-flag>

Distributed Load Testing (DLT)

The load testing tools based on JMeter and Distributed Load Testing on AWS are an optional part of the solution, and can be used to verify basic operations and the configuration installed can scale to the capacity required for successful operation.

Two JMeter test plans are included with the solution source code and can be used standalone with JMeter or used for large-scale, multi-Region load testing with Distributed Load Testing on AWS.

Prebid Server test plan

This test plan is placed in source/loadtest/jmx/prebid_server_test_plan.jmx. It uses several commercial bidding adapters in Prebid Server configured to respond in test mode. The bidding adapters do not make connections over the Internet when invoked this way and respond with fixed data. This test plan is suitable for verifying basic operations of the deployed stack are working.

To use this test plan, follow these steps:

1. Deploy this solution. If you have previously deployed this solution, skip this step.

2. Open the test plan source/loadtest/jmx/prebid_server_test_plan.jmx in JMeter.

3. Update the URL under User Defined Variables in JMeter console with the CloudFront endpoint of Prebid Server deployed in step 1.

4. Install the Distributed Load Testing on AWS solution.

5. Open the Distributed Load Testing on AWS console.

6. Upload the updated test plan in step 3 and start the tests.