Creating an SMB location Creating an HDFS location Creating an object storage location Creating an Amazon EFS location Creating an Amazon FSx for Windows File Server location Creating an Amazon FSx for Lustre location Creating an Amazon FSx for OpenZFS location Creating an Amazon FSx for NetApp ONTAP location

Creating AWS DataSync locations with the AWS CLI

Each AWS DataSync task is made up of a pair of locations in a transfer. The source location defines the storage system or service that you want to read data from. The destination location defines the storage system or service that you want to write data to.

Creating an SMB location

An SMB location defines a file system on an SMB server that can be read from or written to. You can also create an SMB location by using the console. For more information, see Configuring AWS DataSync transfers with an SMB file server.

To create an SMB location by using the CLI

Use the following command to create an SMB source location.
```
aws datasync create-location-smb \
    --server-hostname smb-server-address \
    --user user-who-can-mount-share \
    --domain windows-domain-of-smb-server \
    --password user-password \
    --agent-arns datasync-agent-arns \
    --subdirectory smb-export-path
```
The smb-export-path that you provide for the --subdirectory parameter should be a path that's exported by the SMB server. Specify the path by using forward slashes; for example, /path/to/folder. Other SMB clients in your network should be able to access this path.

DataSync automatically chooses the SMB version that it uses to read from an SMB location. To specify an SMB version, use the optional Version parameter in the SmbMountOptions API operation.

This command returns the Amazon Resource Name (ARN) of the SMB location, similar to the ARN shown following.


{ 
    "LocationArn": "arn:aws:datasync:us-east-1:111222333444:location/loc-0f01451b140b2af49" 
}

Creating an HDFS location

An HDFS location defines a file system on a Hadoop cluster that can be read from or written to. You can also create an HDFS location by using the AWS Management Console. For more information, see Configuring AWS DataSync transfers with HDFS.

To create an HDFS location by using the AWS CLI

Use the following command to create an HDFS location. In the following example, replace each user input placeholder with your own information.
```
aws datasync create-location-hdfs --name-nodes [{"Hostname":"host1", "Port": 8020}] \
    --authentication-type "SIMPLE|KERBEROS" \
    --agent-arns [arn:aws:datasync:us-east-1:123456789012:agent/agent-01234567890example] \
    --subdirectory "/path/to/my/data"
```
The following parameters are required in the create-location-hdfs command:
- name-nodes – Specifies the hostname or IP address of the NameNode in the Hadoop cluster and the TCP port that the NameNode is listening on.
- authentication-type – The type of authentication to use when connecting to the Hadoop cluster. Specify SIMPLE or KERBEROS.
  
  If you use SIMPLE authentication, use the --simple-user parameter to specify the user name of the user. If you use KERBEROS authentication, use the --kerberos-principal, --kerberos-keytab, and --kerberos-krb5-conf parameters. For more information, see create-location-hdfs.
- agent-arns – The ARNs of the DataSync agents to use for the HDFS location.
The preceding the command returns the location ARN, similar to the following:
```
{
    "arn:aws:datasync:us-east-1:123456789012:location/loc-01234567890example"
}
```

Creating an object storage location

A location is a DataSync endpoint that represents an object storage system hosted on-premises or by another cloud provider (for example, a Google Cloud Storage bucket).

For more information about object storage locations, including compatibility requirements, see Configuring AWS DataSync transfers with an object storage system.

To create an object storage location by using the AWS CLI

Copy the following create-location-object-storage command:


aws datasync create-location-object-storage \
    --server-hostname object-storage-server.example.com \
    --bucket-name your-bucket \
    --agent-arns arn:aws:datasync:us-east-1:123456789012:agent/agent-01234567890deadfb

Specify the following required parameters in the command:
- --server-hostname – Specify the domain name or IP address of your object storage server.
- --bucket-name – Specify the name of the bucket on your object storage server that you're transferring to or from.
- --agent-arns – Specify the DataSync agents that you want to connect to your object storage server.
(Optional) Add any of the following parameters to the command:
- --server-port – Specifies the port that your object storage server accepts inbound network traffic on (for example, port 443).
- --server-protocol – Specifies the protocol (HTTP or HTTPS) which your object storage server uses to communicate.
- --access-key – Specifies the access key (for example, a user name) if credentials are required to authenticate with the object storage server.
- --secret-key – Specifies the secret key (for example, a password) if credentials are required to authenticate with the object storage server.
- --server-certificate – Specifies a certificate chain for DataSync to authenticate with your object storage system if the system uses a private or self-signed certificate authority (CA). You must specify a single .pem file with a full certificate chain (for example, file:///home/user/.ssh/object_storage_certificates.pem).
  
  The certificate chain might include:
  - The object storage system's certificate
  - All intermediate certificates (if there are any)
  - The root certificate of the signing CA
  You can concatenate your certificates into a .pem file (which can be up to 32768 bytes before base64 encoding). The following example cat command creates an object_storage_certificates.pem file that includes three certificates:
```
cat object_server_certificate.pem intermediate_certificate.pem ca_root_certificate.pem > object_storage_certificates.pem
```
- --subdirectory – Specifies the object prefix for your object storage server.
  
  DataSync only copies objects with this prefix.
- --tags – Specifies the key-value pair that represents a tag that you want to add to the location resource.
  
  Tags can help you manage, filter, and search for your resources. We recommend creating a name tag for your location.
Run the create-location-object-storage command.

You get a response that shows you the location ARN that you just created.
```
{
    "LocationArn": "arn:aws:datasync:us-east-1:123456789012:location/loc-01234567890abcdef"
}
```

Creating an Amazon EFS location

A location is the endpoint for an Amazon EFS file system that can be read from or written to. You can also create this kind of location by using the console. For more information, see Configuring AWS DataSync transfers with Amazon EFS.

To create an Amazon EFS location by using the AWS CLI

If you don't have an Amazon EFS file system, create one. For information about how to create an EFS file system, see Getting started with Amazon Elastic File System in the Amazon Elastic File System User Guide.
Identify a subnet that has at least one mount target for that file system. You can see all the mount targets and the subnets associated with an EFS file system by using the describe-mount-targets command.
```
aws efs describe-mount-targets \
    --region aws-region  \
    --file-system-id file-system-id
```
Note
The AWS Region that you specify is the one where your target S3 bucket or EFS file system is located.

This command returns information about the target similar to the information shown following.
```
{
    "MountTargets": [
        {
            "OwnerId": "111222333444",
            "MountTargetId": "fsmt-22334a10",
            "FileSystemId": "fs-123456ab",
            "SubnetId": "subnet-f12a0e34",
            "LifeCycleState": "available",
            "IpAddress": "11.222.0.123",
            "NetworkInterfaceId": "eni-1234a044"
        }
    ]
}
```
Specify an Amazon EC2 security group that can access the mount target. You can run the following command to find out the security group of the mount target.
```
aws efs describe-mount-target-security-groups \
    --region aws-region \
    --mount-target-id mount-target-id
```
The security group that you provide must be able to communicate with the security group on the mount target in the subnet specified.

The relationship between security group M on the mount target and security group S, which you provide for DataSync to use at this stage, is as follows:
- Security group M, which you associate with the mount target, must allow inbound access for the TCP protocol on the NFS port (2049) from security group S.
  
  You can enable an inbound connection either by its IP address (CIDR range) or its security group.
- Security group S, which you provide to DataSync to access Amazon EFS, should have a rule that enables outbound connections to the NFS port. It enables outbound connections on one of the file system's mount targets.
  
  You can enable outbound connections either by IP address (CIDR range) or security group.
  
  For information about security groups and mount targets, see Security groups for Amazon EC2 instances and mount targets in the Amazon Elastic File System User Guide.
Create the location. To create the EFS location, you need the ARNs for your Amazon EC2 subnet, Amazon EC2 security group, and a file system. Because the DataSync API accepts fully qualified ARNs, you can construct these ARNs. For information about how to construct ARNs for different services, see Amazon Resource Names (ARNs) in the AWS General Reference.

Use the following command to create an EFS location.
```
aws datasync create-location-efs \
    --subdirectory /path/to/your/subdirectory \
    --efs-filesystem-arn 'arn:aws:elasticfilesystem:region:account-id:file-system/filesystem-id' \
    --ec2-config SecurityGroupArns='arn:aws:ec2:region:account-id:security-group/security-group-id',SubnetArn='arn:aws:ec2:region:account-id:subnet/subnet-id'
```

Note

The AWS Region that you specify is the one where your target S3 bucket or EFS file system is located.

The command returns a location ARN similar to the one shown following.


{ 
    "LocationArn": "arn:aws:datasync:us-west-2:111222333444:location/loc-07db7abfc326c50fb" 
}

Creating an Amazon FSx for Windows File Server location

A location is an endpoint for an FSx for Windows File Server that you can read from or write to.

You can also create an FSx for Windows File Server location by using the console. For more information, see Configuring AWS DataSync transfers with Amazon FSx for Windows File Server.

To create an FSx for Windows File Server location by using the AWS CLI

Use the following command to create an Amazon FSx location.
```
aws datasync create-location-fsx-windows \
    --fsx-filesystem-arn arn:aws:fsx:region:account-id:file-system/filesystem-id \
    --security-group-arns arn:aws:ec2:region:account-id:security-group/group-id \
    --user smb-user --password password
```
In the create-location-fsx-windows command, specify the following:
- fsx-filesystem-arn – The fully qualified Amazon Resource Name (ARN) of the file system that you want to read from or write to.
  
  The DataSync API accepts fully qualified ARNs, and you can construct these ARNs. For information about how to construct ARNs for different services, see Amazon Resource Names (ARNs) in the AWS General Reference.
- security-group-arns – The ARN of an Amazon EC2 security group that can be applied to the network interfaces of the file system's preferred subnet.
- The AWS Region – The Region that you specify is the one where your target Amazon FSx file system is located.

The preceding command returns a location ARN similar to the one shown following.


{ 
    "LocationArn": "arn:aws:datasync:us-west-2:111222333444:location/loc-07db7abfc326c50fb" 
}

Creating an Amazon FSx for Lustre location

A location is an endpoint for an FSx for Lustre file system that you can read or write to.

You can also create an FSx for Lustre location by using the console. For more information, see Configuring AWS DataSync transfers with Amazon FSx for Lustre.

To create an FSx for Lustre location by using the AWS CLI

Use the following command to create an FSx for Lustre location.
```
aws datasync create-location-fsx-lustre \
    --fsx-filesystem-arn arn:aws:fsx:region:account-id:file-system:filesystem-id \
    --security-group-arns arn:aws:ec2:region:account-id:security-group/group-id
```
The following parameters are required in the create-location-fsx-lustre command.
- fsx-filesystem-arn – The fully qualified Amazon Resource Name (ARN) of the file system that you want to read from or write to.
- security-group-arns – The ARN of an Amazon EC2 security group to apply to the network interfaces of the file system's preferred subnet.

The preceding command returns a location ARN similar to the following.


{
    "LocationArn": "arn:aws:datasync:us-west-2:111222333444:location/loc-07sb7abfc326c50fb"
}

Creating an Amazon FSx for OpenZFS location

A location is an endpoint for an FSx for OpenZFS file system that DataSync can access for a transfer. You also can create an FSx for OpenZFS location in the console.

To create an FSx for OpenZFS location by using the AWS CLI

Copy the following command:


$ aws datasync create-location-fsx-openzfs \
   --fsx-filesystem-arn arn:aws:fsx:region:account-id:file-system/filesystem-id \
   --security-group-arns arn:aws:ec2:region:account-id:security-group/group-id \
   --protocol NFS={}

Specify the following required options in the command:
- For fsx-filesystem-arn, specify the location file system's fully qualified Amazon Resource Name (ARN). This includes the AWS Region where your file system resides, your AWS account, and the file system ID.
- For security-group-arns, specify the ARN of the Amazon EC2 security group that provides access to the network interfaces of your FSx for OpenZFS file system's preferred subnet. This includes the AWS Region where your Amazon EC2 instance resides, your AWS account, and the security group ID.
  
  For more information about security groups, see File System Access Control with Amazon VPC in the Amazon FSx for OpenZFS User Guide.
- For protocol, specify the protocol that DataSync uses to access your file system. (DataSync currently supports only NFS.)

Run the command. You get a response showing the location that you just created.


{ 
    "LocationArn": "arn:aws:datasync:us-west-2:123456789012:location/loc-abcdef01234567890" 
}

Creating an Amazon FSx for NetApp ONTAP location

A location is an endpoint for an FSx for ONTAP file system that DataSync can access for a transfer. You also can create an FSx for ONTAP location in the console.

To create an FSx for ONTAP location by using the AWS CLI

Copy the following command:


$ aws datasync create-location-fsx-ontap \
   --storage-virtual-machine-arn arn:aws:fsx:region:account-id:storage-virtual-machine/fs-file-system-id \
   --security-group-arns arn:aws:ec2:region:account-id:security-group/group-id \
   --protocol data-transfer-protocol={}

Specify the following required options in the command:
- For storage-virtual-machine-arn, specify the fully qualified Amazon Resource Name (ARN) of a storage virtual machine (SVM) in your file system where you want to copy data to or from.
  
  This ARN includes the AWS Region where your file system resides, your AWS account, and the file system and SVM IDs.
- For security-group-arns, specify the ARNs of the Amazon EC2 security groups that provide access to the network interfaces of your file system's preferred subnet.
  
  This includes the AWS Region where your Amazon EC2 instance resides, your AWS account, and your security group IDs. You can specify up to five security group ARNs.
  
  For more information about security groups, see File System Access Control with Amazon VPC in the Amazon FSx for NetApp ONTAP User Guide.
- For protocol, configure the protocol that DataSync uses to access your file system's SVM.
  - For NFS, you can use the default configuration:
    
    --protocol NFS={}
  - For SMB, you must specify a user name and password that can access the SVM:
    
    --protocol SMB={User=smb-user,Password=smb-password}

Run the command.

You get a response that shows the location that you just created.


{ 
    "LocationArn": "arn:aws:datasync:us-west-2:123456789012:location/loc-abcdef01234567890" 
}

Warning Javascript is disabled or is unavailable in your browser.

To use the Amazon Web Services Documentation, Javascript must be enabled. Please refer to your browser's Help pages for instructions.

Document Conventions

Creating an agent

Creating a task