Menu
AWS Snowball
User Guide

This guide is for the Snowball (50TB or 80TB of storage space). If you are looking for documentation for the Snowball Edge, see the AWS Snowball Edge Developer Guide.

Troubleshooting for a Standard Snowball

The following can help you troubleshoot problems that you might have with an AWS Snowball (Snowball). If you're having trouble establishing a connection to a Snowball, see Why can’t my AWS Snowball appliance establish a connection with the network? in the AWS Knowledge Center.

Troubleshooting Connection Problems

The following can help you troubleshoot issues you might have with connecting to your Snowball.

  • Routers and switches that work at a rate of 100 megabytes per second won't work with a Snowball. We recommend that you use a switch that works at a rate of 1 GB per second (or faster).

Troubleshooting Data Transfer Problems

If you encounter performance issues while transferring data to or from a Snowball, see Performance for AWS Snowball for recommendations and guidance on improving transfer performance. The following can help you troubleshoot issues you might have with your data transfer to or from a Snowball.

  • Data can't be transferred into the root folder of the Snowball. If you're having trouble transferring data into the Snowball, make sure that you're transferring data into a folder on the Snowball that is not the root folder.

  • For security purposes, data transfers must be completed within 90 days of the Snowball being prepared. After 90 days, the Snowball becomes locked to additional on-premises data transfers. If the Snowball becomes locked during a data transfer, return the Snowball and create a new job to transfer the rest of your data. If the Snowball becomes locked during an import job, we can still transfer the existing data on the Snowball into Amazon S3.

  • Objects transferred onto Snowballs have a maximum key length of 933 bytes. Key names that include characters that take up more than one byte each still have a maximum key length of 933 bytes. When determining key length, you include the file or object name and also its path or prefixes. Thus, files with short file names within a heavily nested path can have keys longer than 933 bytes. The bucket name is not factored into the path when determining the key length. Some examples follow.

    Object Name Bucket Name Path Plus Bucket Name Key Length
    sunflower-1.jpg pictures sunflower-1.jpg 15 characters
    receipts.csv MyTaxInfo /Users/Eric/Documents/2016/January/ 47 characters
    bhv.1 $7$zWwwXKQj$gLAOoZCj$r8p /.VfV/FqGC3QN$7BXys3KHYePfuIOMNjY83dVx ugPYlxVg/evpcQEJLT/rSwZc$MlVVf/$hwefVISRqwepB$/BiiD/PPF$twRAjrD/fIMp/0NY 135 characters

    If a key's length is larger than 933 bytes, you see the following error message when you try to copy the object to a Snowball:

    Failed to copy the following file: <Name of object with a keylength over 933 bytes>
              PARENT_NOT_FOUND:

    If you receive this error message, you can resolve the issue by reducing the object's key length.

  • If you're using Linux and you can't upload files with UTF-8 characters to a Snowball, it might be because your Linux workstation doesn't recognize UTF-8 character encoding. You can correct this issue by installing the locales package on your Linux workstation and configuring it to use one of the UTF-8 locales like en_US.UTF-8. You can configure the locales package by exporting the environment variable LC_ALL, for example: export LC_ALL=en_US.UTF-8

  • If you encounter unexpected errors during data transfer to the Snowball, we want to hear about it. Make a copy of your logs and include them along with a brief description of the issues that you encountered in a message to AWS Support. For more information about logs, see Snowball Logs.

Troubleshooting Client Problems

The following can help you troubleshoot issues with the Snowball client.

  • If you're having trouble using the Snowball client, type the command snowball help for a list of all available actions for that tool.

  • Although you can run multiple instances of the Snowball client at the same time, each instance of the client requires up to 7 GB of dedicated RAM for memory-intensive tasks, such as performing the snowball cp command. If your workstation runs out of memory as it runs the Snowball client, you see a Java OutOfMemoryError exception returned in the terminal window. You can resolve this issue by freeing up resources on the workstation or increasing the amount of memory for your workstation, and then performing your Snowball client task again.

  • If you encounter issues while transferring data to a Snowball using the client on a PC running Microsoft Windows Server, it might be due to the Data Deduplication feature in Windows. If you have the Data Deduplication feature turned on, we recommend that you use the Amazon S3 Adapter for Snowball with the AWS CLI to transfer data instead. For more information, see Transferring Data with the Amazon S3 Adapter for Snowball.

Troubleshooting Snowball Client Validation Problems

When you transfer data, the copy operation first performs a precheck on the metadata for each file to copy. If any of the following attributes are true about a file's metadata, then the copy operation stops before it transfers any files:

  • The size of the file is greater than 5 TB – Objects in Amazon S3 must be 5 TB or less in size, so files that are larger 5 TB in size can't be transferred to the Snowball. If you encounter this problem, separate the file into parts smaller than 5 TB, compress the file so that it's within the 5 TB limit, or otherwise reduce the size of the file, and try again.

  • The file is a symbolic link, and only contains a reference to another file or directory – Symbolic links (or junctions) can't be transferred into Amazon S3.

  • There are permissions issues for access to the file – For example, a user might be trying to read a file on the Snowball client when that user doesn't have read permissions for that file. Permissions issues result in precheck failures.

  • Object key length too large –If an object's key length is larger than 933 bytes, it fails the precheck.

For a list of files that can't be transferred, check the terminal before data copying starts. You can also find this list in the <temp directory>/snowball-<random-character-string>/failed-files file, which is saved to your Snowball client folder on the workstation. For Windows, this temp directory would be located in C:/Users/<username>/AppData/Local/Temp. For Linux and Mac, the temp directory would be located in /tmp.

If you discover errors when you run the snowball validate command, identify the files that failed the transfer, resolve the issues that the error messages report, and then transfer those files again. If your validation command fails with the same error message, then you can use the –f option with the snowball cp command to force the copy operation and overwrite the invalid files.

Troubleshooting Adapter Problems

If you're communicating with the Snowball through the Amazon S3 Adapter for Snowball using the AWS CLI, and you encounter an error that says Unable to locate credentials. You can configure credentials by running "aws configure". you need to configure your AWS credentials used by the CLI to run commands. For more information, see Configuring the AWS Command Line Interface in the AWS Command Line Interface User Guide.

Troubleshooting Import Job Problems

Sometimes files fail to import into Amazon S3. If the following issue occurs, try the actions specified to resolve your issue. If a file fails import, you might need to try importing it again. Importing it again might require a new job for Snowball Edge.

Files failed import into Amazon S3 due to invalid characters in object names

This problem occurs if a file or folder name has characters that aren't supported by Amazon S3. Amazon S3 has rules about what characters can be in object names. For more information, see Object Key Naming Guidelines.

Action to take

If you encounter this issue, you see the list of files and folders that failed import in your job completion report.

In some cases, the list is prohibitively large, or the files in the list are too large to transfer over the internet. In these cases, you should create a new Snowball import job, change the file and folder names to comply with Amazon S3 rules, and transfer the files again.

If the files are small and there isn't a large number of them, you can copy them to Amazon S3 through the AWS CLI or the AWS Management Console. For more information, see How Do I Upload Files and Folders to an S3 Bucket? in the Amazon Simple Storage Service Console User Guide.

Troubleshooting Export Job Problems

Sometimes files fail to export into your workstation. If the following issue occurs, try the actions specified to resolve your issue. If a file fails export, you might need to try exporting it again. Exporting it again might require a new job for Snowball Edge.

Files failed export to a Microsoft Windows Server

A file can fail export to a Microsoft Windows Server if it or a related folder is named in a format not supported by Windows. For example, if your file or folder name has a colon (:) in it, the export fails because Windows doesn't allow that character in file or folder names.

Action to take

  1. Make a list of the names that are causing the error. You can find the names of the files and folders that failed export in your logs. For more information, see Getting Your Job Completion Report and Logs in the Console.

  2. Change the names of the objects in Amazon S3 that are causing the issue to remove or replace the unsupported characters.

  3. If the list of names is prohibitively large, or if the files in the list are too large to transfer over the internet, create a new export job specifically for those objects.

    If the files are small and there isn't a large number of them, copy the renamed objects from Amazon S3 through the AWS CLI or the AWS Management Console. For more information, see How Do I Download an Object from an S3 Bucket? in the Amazon Simple Storage Service Console User Guide.