Working with backups - Amazon FSx for Lustre

Working with backups

With Amazon FSx for Lustre, you can take automatic daily backups and manual backups of persistent file systems that are not linked to an Amazon S3 durable data repository. Amazon FSx backups are file-system-consistent, highly durable, and incremental. To ensure high durability, Amazon FSx for Lustre stores backups in Amazon Simple Storage Service (Amazon S3) with 99.999999999% (11 9's) durability.

Amazon FSx for Lustre backups are incremental, whether they are generated using the automatic daily backup or the manual backup feature. This means that only the data on the file system that has changed after your most recent backup is saved. This minimizes the time required to create the backup and saves on storage costs by not duplicating data. When you delete a backup, only the data unique to that backup is removed. Each Amazon FSx for Lustre backup contains all of the information that is needed to create a new file system from the backup, effectively restoring a point-in-time snapshot of the file system.

Creating regular backups for your file system is a best practice that complements the replication that Amazon FSx for Lustre performs for your file system. Amazon FSx backups help support your backup retention and compliance needs. Working with Amazon FSx for Lustre backups is easy, whether it's creating backups, restoring a file system from a backup, or deleting a backup.

Backups are not supported on scratch file systems because these file systems are designed for temporary storage and shorter-term processing of data. Backups are not supported on file systems linked to an Amazon S3 bucket because the S3 bucket serves as the primary data repository, and the Lustre file system does not necessarily contain the full data set at any given time.

Backup support in Amazon FSx for Lustre

Backups are supported only on Amazon FSx for Lustre persistent file systems that are not linked to an Amazon S3 data repository.

Amazon FSx does not support backups on scratch file systems because scratch file systems are designed for temporary storage and shorter-term processing of data. Amazon FSx does not support backups on file systems linked to an Amazon S3 bucket because the S3 bucket serves as the primary data repository and the file system does not necessarily contain the full data set at any given time. For more information, see Using File System Deployment Options and Using data repositories.

Working with manual backups

Amazon FSx for Lustre enables you to manually take backups of your file systems at any time. You can do so using the Amazon FSx for Lustre Management Console, API, or the AWS Command Line Interface (CLI). Your manual backups of Amazon FSx file systems never expire, and are available for as long as you want to keep them. Manual backups are retained even after you have deleted the file system that was backed up. Manual backups can only be deleted by using the Amazon FSx for Lustre console, API, or CLI, and they are never automatically deleted by Amazon FSx. For more information, see Deleting backups.

Creating manual backups

The following procedure guides you through how to create a user-initiated backup in the Amazon FSx console for an existing file system.

To create a manual file system backup

  1. Open the Amazon FSx for Lustre console at https://console.aws.amazon.com/fsx/.

  2. From the console dashboard, choose the name of the file system that you want to back up.

  3. From Actions, choose Create backup.

  4. In the Create backup dialog box that opens, provide a name for your backup. Backup names can be a maximum of 256 Unicode characters, including letters, white space, numbers, and the special characters . + - = _ : /

  5. Choose Create backup.

You have now created your file system backup. You can find a table of all your backups in the Amazon FSx for Lustre console by choosing Backups in the left side navigation. You can search for the name you gave your backup, and the table filters to only show matching results.

When you create a user-initiated backup as this procedure described, it has the type User-Initiated, and it has the Creating status while Amazon FSx creates the backup. The status changes to Tranferring while the backup is transferred to Amazon S3, until it is fully available.

Working with automatic daily backups

Amazon FSx for Lustre can take an automatic daily backup of your file system. These automatic daily backups occur during the daily backup window that was established when you created the file system. At some point during the daily backup window, storage I/O might be suspended briefly while the backup process initializes (typically for less than a few seconds). When you choose your daily backup window, we recommend that you choose a convenient time of the day. This time ideally is outside of the normal operating hours for the applications that use the file system.

Automatic daily backups are kept for a certain period of time, known as a retention period. You can set the retention period to be between 0–90 days. Setting the retention period to 0 (zero) days turns off automatic daily backups. The default retention period for automatic daily backups is 0 days. Automatic daily backups are deleted when the file system is deleted.

Note

Setting the retention period to 0 days means that your file system is never automatically backed up. We highly recommend that you use automatic daily backups for file systems that have any level of critical functionality associated with them.

You can use the AWS CLI or one of the AWS SDKs to change the backup window, and backup retention period for your file systems with the UpdateFileSystem API operation or the update-file-system CLI command. .

Restoring backups

You can use an available backup to create a new file system, effectively restoring a point-in-time snapshot of another file system. You can restore a backup using the console, AWS CLI, or one of the AWS SDKs. Restoring a backup to a new file system takes the same amount of time as creating a new file system. The data restored from the backup is lazy-loaded onto the file system, during which time you will experience slightly higher latency.

The following procedure guides you through how to restore a backup using the console to create a new file system.

Note

You can only restore your backup to a file system of the same deployment type, throughput per unit of storage, and storage capacity as the original.

To restore a file system from a backup

  1. Open the Amazon FSx for Lustre console at https://console.aws.amazon.com/fsx/.

  2. From the console dashboard, choose Backups from the left side navigation.

  3. Choose the backup that you want to restore from the Backups table, and then choose Restore backup.

    Doing so opens the file system creation wizard. This wizard is identical to the standard file system creation wizard, except the file system configuration (e.g., Deployment Type, throughput per unit of storage). However, you can change the associated VPC, and backup settings.

  4. Complete the wizard as you do when you create a new file system.

  5. Choose Review and create.

  6. Review the settings you chose for your Amazon FSx for Lustre file system, and then choose Create file system.

You have restored from a backup, and a new file system is now being created. When its status changes to AVAILABLE, you can use the file system as normal.

Deleting backups

Deleting a backup is a permanent, unrecoverable action. Any data in a deleted backup is also deleted. Do not delete a backup unless you're sure you won't need that backup again in the future.

To delete a backup

  1. Open the Amazon FSx for Lustre console at https://console.aws.amazon.com/fsx/.

  2. From the console dashboard, choose Backups from the left side navigation.

  3. Choose the backup that you want to delete from the Backups table, and then choose Delete backup.

  4. In the Delete backups dialog box that opens, confirm that the ID of the backup identifies the backup that you want to delete.

  5. Confirm that the check box is checked for the backup that you want to delete.

  6. Choose Delete backups.

Your backup and all included data are now permanently and unrecoverably deleted.