Using DataSync to transfer files to AWS with AWS OpsHub
You can use AWS OpsHub to create an AWS DataSync agent on your Snowcone device. You can use it to transfer files between your device and Amazon S3, Amazon Elastic File System (Amazon EFS), or FSx for Windows File Server in the AWS Cloud.
AWS DataSync is an online data transfer service designed to simplify, automate, and accelerate copying large amounts of data to and from AWS storage services. DataSync copies data over the internet or AWS Direct Connect. As a fully managed service, DataSync removes much of the need to modify applications, develop scripts, or manage infrastructure.
DataSync supports data transfer between Network File System (NFS) and Amazon EFS, Amazon S3, or Amazon FSx for Windows File Server.
For information about the source and destination location combination supported by AWS DataSync, see Working with locations in the AWS DataSync User Guide.
Snowcone ships with the DataSync agent, which is a virtual machine (VM) that is used to read or write data from an on-premises storage system. To use DataSync, you first start the agent and then go the DataSync console and activate it. For information about DataSync, see Getting started with AWS DataSync.
To start the DataSync agent
Before starting the DataSync agent, enable NFS on your Snowcone device. See Configuring the NFS interface automatically with AWS OpsHub and Starting NFS and Restricting Access.
-
On the AWS OpsHub dashboard, choose Start in the Sync with cloud section to open the Start DataSync agent wizard. The Start DataSync agent form is populated with the Device IP address, and Physical network interface fields.
-
Choose Create IP address (VNI) to create a virtual IP address or choose Use existing IP address.
-
If you choose Create IP address (VNI), then choose DHCP or Static IP in the IP Address assignment list box.
If you choose Use existing IP address, then choose a virtual interface from the Virtual network interface list box.
-
Choose Start agent. You are redirected to the DataSync resource page. It could take up to five minutes for the IP address of the agent to appear.
-
Use the copy icon to copy the IP address value of the agent from the Agent IP address file, and choose Open DataSync console.
This opens the DataSync console, where you activate the agent and transfer your files. The rest of the setup is done in the AWS DataSync console.
Transferring files through DataSync with AWS OpsHub
AWS Snowcone has already created the agent, so you only need to activate it, configure your source and destination location, create a task, and start the task.
To activate the DataSync agent and use the DataSync service
Open the AWS DataSync console at https://console.aws.amazon.com/datasync/
. -
In the Activation section, on the Create agent page, paste the IP address you copied into the Agent address box, and choose Get key. Your browser connects to the IP address and gets a unique activation key from your agent.
-
After the agent is activated, you will configure the NFS running on your Snowcone device as a source location for DataSync. For instructions, see Configure a source location in the AWS DataSync User Guide.
Note
The DataSync agent running on your Snowcone device can transfer files to and from a location that’s reachable on your network.
-
On the Configure a destination page, choose and configure the destination you want to transfer files to. For instructions, see Configure a destination location in the AWS DataSync User Guide.
-
Configure task setting. For instructions, see Configure task settings in the AWS DataSync User Guide.
-
Review your settings and create your task. For instructions, see Review your settings and create your task in the AWS DataSync User Guide.
-
Start your task and wait for your files to be transferred. For instructions, see Start your task in the AWS DataSync User Guide.