AWS Device Farm
Developer Guide (API Version 2015-06-23)

Analyzing Results

In a custom test environment, Device Farm gathers artifacts such as custom reports, log files, and images during your test run. These artifacts are available for each device in the test run.

You can download these files that are created in a custom test environment:

Test spec output

The output from running the commands in the test spec YAML file.

Customer artifacts

A zipped file that contains the artifacts from the test run. It is configured in the artifacts: section of your test spec YAML file.

Test spec shell script

An intermediate shell script file created from your YAML file. Because it is used in the test run, the shell script file can be used for debugging the YAML file.

Test spec file

The YAML file used in the test run.

To Retrieve Your Test Artifacts (Console)

  1. On the test run report page, choose a mobile device from Devices.

  2. From Suites, choose Tests Suite.

  3. Choose the Files tab.

    Your artifacts are listed under Tests.

To Retrieve Your Test Artifacts (AWS CLI)

The AWS CLI list-artifacts command returns a list of artifacts such as files, screenshots, and logs. Each artifact has a URL so you can download the file.

To Retrieve Your Test Artifacts (API)

The Device Farm API ListArtifacts method returns a list of artifacts such as files, screenshots, and logs. Each artifact has a URL so you can download the file.