Transferring Data from EC2-compatible Compute Instances to S3 Buckets on the Same Snowball Edge - AWS Snowball Edge Developer Guide

Transferring Data from EC2-compatible Compute Instances to S3 Buckets on the Same Snowball Edge

You can transfer data between compute instances and Amazon S3 buckets on the same Snowball Edge device. You do this by using the supported AWS CLI commands and the appropriate endpoints. For example, assume that you want to move data from a directory in my sbe1.xlarge instance into the Amazon S3 bucket, myBucket on the same device. Assume that you're using the Amazon S3 compatible storage on Snow Family devices endpoint https://S3-object-API-endpoint:443. You use the following procedure.

Note

This procedure only works if you've followed the instructions in Configuring an AMI to Use SSH to Connect to Compute Instances Launched on the Device.

To transfer data between a compute instance and a bucket on the same Snowball Edge
  1. Use SSH to connect to your compute instance.

  2. Download and install the AWS CLI. If your instance doesn't already have the AWS CLI, download and install it. For more information, see Installing the AWS Command Line Interface.

  3. Configure the AWS CLI on your compute instance to work with the Amazon S3 endpoint on the Snowball Edge. For more information, see Getting and using local Amazon S3 credentials.

  4. Use the supported Amazon S3 compatible storage on Snow Family devices commands to transfer data. For example:

    aws s3 cp ~/june2018/results s3://myBucket/june2018/results --recursive --endpoint https://S3-object-API-endpoint:443