Menu
AWS Import/Export
Developer Guide

Appendix B: Examples

Import Examples

This section walks you through creating three sample AWS Import/Export jobs and shows the manifest file’s corresponding signature and log files. In these examples, the following files are at the root directory of the storage device. The resulting log files illustrate how manifest fields affect the data load.

Note

These examples do not apply to Amazon Glacier. Amazon Glacier imports the entire contents of a device to a single archive.

  • /README

  • /NOTICE.txt

  • /images/wookie1.jpg

  • /images/chewie.gif

  • /images/chewie.tif

  • /images/resources/chewie.psd

The following sections show different ways to create AWS Import/Export jobs.

Example – TSTD1

The TSTD1 example demonstrates the default behavior using a manifest file with the minimum configuration options. The example files associated with job TSTD1 are:

  • manifest-TSTD1.txt

  • import-log-TSTD1.csv

The following is the contents of manifest-TSTD1.txt file.

Copy
manifestVersion: 2.0 bucket: myawsbucket deviceId: 3QD0T87T pinCode:4321 eraseDevice: Yes notificationEmail: john.doe@example.com;jane.roe@example.com returnAddress: name: Jane Roe company: Example Corp. street1: 123 Any Street city: Anytown stateOrProvince: WA postalCode: 91011-1111 phoneNumber: 206-555-1111 country: USA

Important

Your return address must be a physical street address that UPS can deliver to.

TSTD1 Log File

After AWS Import/Export processes this job, the service saves the resulting log file to http://s3.amazonaws.com/myawsbucket/import-log-TSTD1. The contents of the log file are shown in the following table.

DateTime File Status Code Key MD5 Bytes Content-Type
Tue 03 Feb 200921:57:43 GMT SIGNATURE 103 Ignored 90 text/plain
Tue 03 Feb 200921:57:43 GMT Notice.txt 200 OK myawsbucket/Notice.txt f60fe317bc497b1204b327094959eb64 13 text/plain
Tue 03 Feb 200921:57:43 GMT README.txt 200 OK myawsbucket/README.txt d5a46fa22596d2464eff10babb19000e 13 text/plain
Tue 03 Feb 200921:57:43 GMT images/wookie1.jpg 200 OK myawsbucket/images/wookie1.jpb ccac0d031603ff1c2994e07703a64845 447 image/jpeg
Tue 03 Feb 200921:57:43 GMT images/chewie.GIF 200 OK myawsbucket/images/chewie.GIF 5fc22dc594e0c5929c090b9585ba9e70 848 image/gif
Tue 03 Feb 200921:57:43 GMT images/resources/chewie.psd 200 OK myawsbucket/images/resources/chewie.psd 130b64d171e9bbc2a8dbe117f189796c 524 application/octet-stream
Tue 03 Feb 200921:57:43 GMT images/chewie.TIF 200 OK myawsbucket/images/chewie.TIF 823d17b05321b968e01f9174e3dcace7 738 image/tiff

Example – TSTD2

The TSTD2 example demonstrates the behavior associated with adding the following manifest fields: acl, prefix, and logPrefix, to the manifest file used in TSTD1. The example files associated with job TSTD2 are:

  • manifest-TSTD2.txt

  • import-log-TSTD2.csv

The following text shows the contents of manifest-TSTD2.txt.

Copy
manifestVersion: 2.0 bucket: myawsbucket deviceId: eQD0T87T pinCode:4321 eraseDevice: Yes notificationEmail: john.doe@example.com;jane.doe@example.com returnAddress: name: Jane Roe company: Example Corp. street1: 123 Any Street city: Anytown stateOrProvince: WA postalCode: 91011-1111 phoneNumber: 206-555-1111 country: USA acl: public-read prefix: images/ logPrefix: loadlogs-

TSTD2 Log File

After AWS Import/Export processes this job, the service saves the resulting log file to http://s3.amazonaws.com/myawsbucket/import-log-TSTD2. The contents of the log file are shown in the following table.

DateTime File Status Code Key MD5 Bytes Content-Type
Tue 03 Feb 200921:57:43 GMT SIGNATURE 103 Ignored 90
Tue 03 Feb 200921:57:43 GMT Notice.txt 200 OK myawsbucket/images/Notice.txt f60fe317bc497b12004b327094959eb64 13 text/plain
Tue 03 Feb 200921:57:43 GMT README.txt 200 OK myawsbucket/images/README.txt d5a46fa22596d2464eff10babb19000e 13 text/plain
Tue 03 Feb 200921:57:43 GMT images/wookie1.jpg 200 OK myawsbucket/images/images/wookie1.jpg ccac0d031603ff1c94e07703a64845 444 image/jpeg
Tue 03 Feb 200921:57:43 GMT images/chewie.GIF 200 OK myawsbucket/images/images/chewie.GIF 5f22dc594e0c592929c090b9585ba9e70 846 image/gif
Tue 03 Feb 200921:57:43 GMT images/resources/chewie.psd 200 OK myawsbucket/images/images/resources-chewie.psd 130b64d171e9bbc28dbe117f189796c 590 application/octet-stream
Tue 03 Feb 200921:57:43 GMT images/chewie.TIF 200 OK myawsbucket/images/images/chewie.TIF 823d17b05321b968e01f9174e3dcace7 734 image/tiff

Example – TSTD3

The TSTD3 example load demonstrates the behavior of the following manifest fields: acl, contentTypes, prefix, and ignore. The example files associated with job TSTD3 are:

  • manifest-TSTD3.txt

  • import-log-TSTD3.csv

The following text shows the contents of manifest-TSTD3.txt file.

Copy
manifestVersion: 2.0 bucket: myawsbucket deviceId: 3QD0T87T pinCode:4321 eraseDevice: Yes notificationEmail: john.doe@example.com;jane.doe@example.com returnAddress: name: Jane Roe company: Example Corp. street1: 123 Any Street city: Anytown stateOrProvince: WA postalCode: 91011-1111 phoneNumber: 206-555-1111 country: USA acl: public-read prefix: dropoff contentTypes: jpg: application/octet-stream gif: application/octet-stream tif: application/octet-stream txt: text/html ignore: - \.psd$

TSTD3 Log File

After AWS Import/Export processes this job, the service saves the resulting log file to http://s3.amazonaws.com/myawsbucket/import-log-TSTD3. The contents of the log file are shown in the following table.

DateTime File Status Code Key MD5 Bytes Content-Type
Tue 03 Feb 200921:57:43 GMT SIGNATURE 103 Ignored 90
Tue 03 Feb 200921:57:43 GMT Notice.txt 200 OK myawsbucket/dropoffNotice.txt 386317bc497b12027094959eb64 13 text/html
Tue 03 Feb 200921:57:43 GMT README.txt 200 OK myawsbucket/dropoffREADME.txt 4686fa22596d2464e0babb19000e 13 text/html
Tue 03 Feb 200921:57:43 GMT images/wookie1.jpg 200 OK myawsbucket/dropoffimages/wookie1.jpg 586d031603ff1c2997703a64845 449 application/octet-stream
Tue 03 Feb 200921:57:43 GMT images/chewie.GIF 200 OK myawsbucket/dropoffimages/chewie.GIF 89022dc594e0c5c090b585ba9e70 846 image/gif
Tue 03 Feb 200921:57:43 GMT images/resources/chewie.psd 108 Ignored 590
Tue 03 Feb 200921:57:43 GMT images/chewie.TIF 200 OK myawsbucket/dropoffimages/chewie.TIF 8237897-21b968e0174e3dcace7 734 image/tiff

Note

The contentTypes field is case sensitive, so chewie.TIF and chewie.GIF were not picked up by the gif or tif contentTypes filter.

The prefix field, dropoff, did not have a trailing forward slash, (/), so the key name did not have a delimiter between dropoff and the loaded file path.

Export Examples

This section walks through example AWS Import/Export jobs and shows the manifest file’s corresponding SIGNATURE and log files.

Export Files

The following keys are referenced as part of each export job.

  • /myawsbucket/README

  • /myawsbucket /NOTICE.txt

  • /myawsbucket /images/wookie1.jpg

  • /myawsbucket /images/chewie.gif

  • /myawsbucket /images/chewie.tif

  • /myawsbucket /images/resources/chewie.psd

  • /myawsbucket//backup/images/chewie.gif

  • /lostbucket/bin/lost.rhtml

  • /lostbucket/html/directory.html

  • /lostbucket/images/hurley.jpg

  • /lostbucket/images/john.jpg

  • /lostbucket/images/kate.jpg

  • /lostbucket/images/sawyer.jpg

  • /lostbucket/index.html

Example – TSTDA

The TSTDA example upload demonstrates the default behavior using a manifest file with the minimum configuration options. The example files associated with job TSTDA are:

  • manifest-TSTDA.txt

  • export-log-TSTDA.csv

The following is the contents of manifest-TSTDA.txt file.

Copy
manifestVersion: 1.2 deviceId: 532404500021 logBucket: myawsbucket fileSystem: FAT32 operations: - exportBucket: myawsbucket returnAddress: name: Jane Roe company: Example Corp. street1: 123 Any Street city: Anytown stateOrProvince: WA postalCode: 91011-1111 phoneNumber: 206-555-1111 country: USA

TSTDA Log File

After AWS Import/Export processes this job, the service saves the resulting log file to http://s3.amazonaws.com/myawsbucket/export-log-TSTDA. The contents of the log file are shown in the following table.

DateTime File Status Code Key MD5 Bytes Content-Type
Tue 03 Feb 200921:57:43 GMT myawsbucket/README.txt 200 OK myawsbucket/README.txt d5a46fa22596d2464eff10babb19000e 13 text/html
Tue 03 Feb 200921:57:43 GMT myawsbucket/NOTICE.txt 200 OK myawsbucket/NOTICE.txt f60fe317bc497b1204b327094959eb64 13 text/html
Tue 03 Feb 200921:57:43 GMT myawsbucket/images/wookie1.jpg 200 OK myawsbucket/images/wookie1.jpg ccac0d031603ff1c2994e07703a64845 447 image/jpeg
Tue 03 Feb 200921:57:43 GMT myawsbucket/images/chewie.gif 200 OK myawsbucket/images/chewie.gif 5fc22dc594e0c5929c090b9585ba9e70 848 image/gif
Tue 03 Feb 200921:57:43 GMT myawsbucket/images/resources/chewie.psd 200 OK myawsbucket /images/resources/chewie.psd 130b64d171e9bbc2a8dbe117f189796c 524 application/octet-stream
Tue 03 Feb 200921:57:43 GMT EXPORT-RECOVERY/0000/0000 302 Remapped myawsbucket//backup/images/chewie.gif 823d17b05321b968e01f9174e3dcace7 738 image/gif

Example – TSTDB

The TSTDB example upload demonstrates the default behavior using a manifest file with the following configuration options: multiple buckets, targetDirectory, prefix, beginMarker, and endMarker. The example files associated with job TSTDB are:

  • manifest-TSTDB.txt

  • export-log-TSTDB.csv

The following is the contents of manifest-TSTDB.txt file.

Copy
manifestVersion: 2.0 deviceId: 532404500021 logBucket: myawsbucket logPrefix: logs/ fileSystem: NTFS operations: - exportBucket: myawsbucket prefix: images targetDirectory: starwars/image-backup - exportBucket: lostbucket beginMarker: html/ endMarker: images/kate.jpg returnAddress: name: Jane Roe company: Example Corp. street1: 123 Any Street city: Anytown stateOrProvince: WA postalCode: 91011-1111 phoneNumber: 206-555-1111 country: USA

TSTDB Log File

After AWS Import/Export processes this job, the service saves the resulting log file to http://s3.amazonaws.com/myawsbucket/export-log-TSTDB. The contents of the log file are shown in the following table.

DateTime File Status Code Key MD5 Bytes Content-Type
Tue 03 Feb 200921:57:43 GMT starwars/image-backup/images/wookie1.jpg 200 OK myawsbucket /images/wookie1.jpg d5a46fa22596d246f10babb19000e 13 image/jpeg
Tue 03 Feb 200921:57:43 GMT starwars/image-backup/images/chewie.gif 200 OK myawsbucket/images/chewie.gif f60fe317bc497b12047094959eb64 13 image/gif
Tue 03 Feb 200921:57:43 GMT starwars/image-backup/images/chewie.tif 200 OK myawsbucket/images/chewie.tif ccac0d031603ff1c4e07703a64845 447 image/tiff
Tue 03 Feb 200921:57:43 GMT starwars/image-backup/images/resources/chewie.psd 200 OK myawsbucket/images/resources/chewie.psd 5fc22dc594e0c5929cb9585ba9e70 848 application/octet-stream
Tue 03 Feb 200921:57:43 GMT lostbucket/html/directory.html 200 OK lostbucket/html/directory.html 130b64d171e9bbc2ae117f189796c 524 text/html
Tue 03 Feb 200921:57:43 GMT lostbucket/images/hurley.jpg 200 OK lostbucket/images/hurley.jpg 823d17b05321b968f9174e3dcace7 738 image/jpeg

Tue 03 Feb 200921:57:43 GMT

lostbucket/images/john.jpg 200 OK lostbucket/images/john.jpg 823d17b05321b968e9174e3dcace7 615 image/jpeg

Tue 03 Feb 200921:57:43 GMT

lostbucket/images/kate.jpg 200 OK lostbucket/images/kate.jpg 5fc22dc594e0c5929c90b9585ba9e70 345 image/jpeg