AWS Import/Export
Developer Guide (API Version 2010-06-03)
AWS Documentation » AWS Import Export » Developer Guide » Appendices » Appendix B: Examples
« PreviousNext »
View the PDF for this guide.Go to the AWS Discussion Forum for this product.Go to the Kindle Store to download this guide in Kindle format.Did this page help you?  Yes | No |  Tell us about it...

Appendix B: Examples

Topics

Import Examples

This section walks you through creating three sample AWS Import/Export jobs and shows the manifest file’s corresponding signature and log files. In these examples, the following files are at the root directory of the storage device. The resulting log files illustrate how manifest fields effect the data load.

Note

These examples do not apply to Amazon Glacier. Amazon Glacier imports the entire contents of a device to a single archive.

  • /README

  • /NOTICE.txt

  • /images/wookie1.jpg

  • /images/chewie.gif

  • /images/chewie.tif

  • /images/resources/chewie.psd

The following sections show different ways to create AWS Import/Export jobs.

Example – TSTD1

The TSTD1 example demonstrates the default behavior using a manifest file with the minimum configuration options. The example files associated with job TSTD1 are:

  • manifest-TSTD1.txt

  • import-log-TSTD1.csv

The following is the contents of manifest-TSTD1.txt file.

manifestVersion: 2.0
bucket: myawsbucket
accessKeyId: 
deviceId: 3QD0T87T
eraseDevice: No
returnAddress:
    name: Amazon.com ATTN Joe Random
    street1: 123 Any Street
    city: Anytown
    stateOrProvince: WA
    postalCode: 91111
    phoneNumber: 555-555-0100
    country: USA

Important

Your return address must be a physical street address in the United States that UPS can deliver to.

TSTD1 Log File

After AWS Import/Export processes this job, the service saves the resulting log file to http://s3.amazonaws.com/myawsbucket/import-log-TSTD1. The contents of the log file are shown in the following table.

DateTimeFileStatusCodeKeyMD5BytesContent-Type
Tue 03 Feb 2009​21:57:43 GMT SIGNATURE103Ignored  90text/plain
Tue 03 Feb 2009​21:57:43 GMT Notice.txt 200OK myawsbucket/​Notice.txtf60fe317bc4​97b1204b327094​959eb64 13text/plain
Tue 03 Feb 2009​21:57:43 GMTREADME.txt200OKmyawsbucket/​README.txtd5a46fa2259​6d2464eff10bab​b19000e13text/plain
Tue 03 Feb 2009​21:57:43 GMT images​/wookie1​.jpg 200OKmyawsbucket/​images/​wookie1.jpbccac0d031603​ff1c2994e07703​a64845447image/jpeg
Tue 03 Feb 2009​21:57:43 GMT images/​chewie​.GIF 200OKmyawsbucket/​images/​chewie.GIF5fc22dc594e​0c5929c090b958​5ba9e70848image/gif
Tue 03 Feb 2009​21:57:43 GMT images/​resources/​chewie.psd 200OKmyawsbucket/​images/​resources/​chewie.psd130b64d171​e9bbc2a8dbe117​f189796c524application/​octet-​stream
Tue 03 Feb 2009​21:57:43 GMT images/​chewie​.TIF 200OKmyawsbucket/​images/​chewie.TIF823d17b0​5321b968e01f917​4e3dcace7738image/tiff

Example – TSTD2

The TSTD2 example demonstrates the behavior associated with adding the following manifest fields: acl, prefix, and logPrefix, to the manifest file used in TSTD1. The example files associated with job TSTD2 are:

  • manifest-TSTD2.txt

  • import-log-TSTD2.csv

The following text shows the contents of manifest-TSTD2.txt.

manifestVersion: 2.0
bucket: myawsbucket
accessKeyId: 
deviceId: eQD0T87T
eraseDevice: No
returnAddress:
  name: Amazon.com ATTN Joe Random
  street1: 123 Any Street
  city: Anytown
  stateOrProvince: WA
  postalCode: 91111
  phoneNumber: 555-555-0100
  country: USA
acl: public-read
prefix: images/
logPrefix: loadlogs-

TSTD2 Log File

After AWS Import/Export processes this job, the service saves the resulting log file to http://s3.amazonaws.com/myawsbucket/import-log-TSTD2. The contents of the log file are shown in the following table.

DateTimeFileStatusCodeKeyMD5BytesContent​-Type
Tue 03 Feb 2009​21:57:43 GMT SIGNATURE103Ignored  90 
Tue 03 Feb 2009​21:57:43 GMT Notice.txt 200OKmyawsbucket/​images/Notice.txtf60fe317bc497​b12004b3270​94959eb64 13text/plain
Tue 03 Feb 2009​21:57:43 GMTREADME.txt200OKmyawsbucket/​images/​README.txtd5a46fa22​596d2464eff10ba​bb19000e13text/plain
Tue 03 Feb 2009​21:57:43 GMT images/​wookie1.jpg 200OKmyawsbucket/​images/​images/wookie1.jpgccac0d031603​ff1c94e0770​3a64845444image/jpeg
Tue 03 Feb 2009​21:57:43 GMT images/​chewie.GIF 200OKmyawsbucket/​images/​images/chewie.GIF5f22dc594​e0c592929c090b9​585ba9e70846image/gif
Tue 03 Feb 2009​21:57:43 GMT images/​resources​/chewie.psd 200OKmyawsbucket/​images/​images/resources-​chewie.psd130b64d17​1e9bbc28dbe11​7f189796c590application/​octet​-stream
Tue 03 Feb 2009​21:57:43 GMT images/​chewie.TIF 200OKmyawsbucket/​images/images/​chewie.TIF823d17b0​5321b968e01f91​74e3dcace7734image/tiff

Example – TSTD3

The TSTD3 example load demonstrates the behavior of the following manifest fields: acl, contentTypes, prefix, and ignore. The example files associated with job TSTD3 are:

  • manifest-TSTD3.txt

  • import-log-TSTD3.csv

The following text shows the contents of manifest-TSTD3.txt file.

manifestVersion: 2.0
bucket: myawsbucket
accessKeyId: 
deviceId: 3QD0T87T
eraseDevice: No
returnAddress:
  name: Amazon.com ATTN Joe Random
  street1: 123 Any Street
  city: Anytown
  stateOrProvince: WA
  postalCode: 98555
  phoneNumber: 206-555-0000
  country: USA
acl: public-read
prefix: dropoff
contentTypes:
  jpg: application/octet-stream
  gif: application/octet-stream
  tif: application/octet-stream
  txt: text/html
ignore:
    - \.psd$

TSTD3 Log File

After AWS Import/Export processes this job, the service saves the resulting log file to http://s3.amazonaws.com/myawsbucket/import-log-TSTD3. The contents of the log file are shown in the following table.

DateTimeFileStatusCodeKeyMD5BytesContent-Type
Tue 03 Feb 2009​21:57:43 GMT SIGNATURE103Ignored  90 
Tue 03 Feb 2009​21:57:43 GMT Notice.txt 200OKmyawsbucket/​dropoffNotice​.txt386317bc4​97b1202709​4959eb64 13text/html
Tue 03 Feb 2009​21:57:43 GMTREADME.txt200OKmyawsbucket/​dropoffREADME.​txt4686fa225​96d2464e0b​abb19000e13text/html
Tue 03 Feb 2009​21:57:43 GMT images/​wookie1.jpg 200OKmyawsbucket/​dropoffimages/​wookie1.jpg586d0316​03ff1c299770​3a64845449application/​octet-stream
Tue 03 Feb 2009​21:57:43 GMT images/​chewie.GIF 200OKmyawsbucket/​dropoffimages/​chewie.GIF89022dc5​94e0c5c090b​585ba9e70846image/gif
Tue 03 Feb 2009​21:57:43 GMT images/​resources/​chewie.psd 108Ignored  590 
Tue 03 Feb 2009​21:57:43 GMT images/​chewie.TIF 200OKmyawsbucket/​dropoffimages/​chewie.TIF8237897-21​b968e0174​e3dcace7734image/tiff

Note

The contentTypes field is case sensitive, so chewie.TIF and chewie.GIF were not picked up by the gif or tif contentTypes filter.

The prefix field, dropoff, did not have a trailing forward slash, (/), so the key name did not have a delimiter between dropoff and the loaded file path.

Export Examples

Topics

This section walks through example AWS Import/Export jobs and shows the manifest file’s corresponding SIGNATURE and log files.

Export Files

The following keys are referenced as part of each export job.

  • /myawsbucket/README

  • /myawsbucket /NOTICE.txt

  • /myawsbucket /images/wookie1.jpg

  • /myawsbucket /images/chewie.gif

  • /myawsbucket /images/chewie.tif

  • /myawsbucket /images/resources/chewie.psd

  • /myawsbucket//backup/images/chewie.gif

  • /lostbucket/bin/lost.rhtml

  • /lostbucket/html/directory.html

  • /lostbucket/images/hurley.jpg

  • /lostbucket/images/john.jpg

  • /lostbucket/images/kate.jpg

  • /lostbucket/images/sawyer.jpg

  • /lostbucket/index.html

Example – TSTDA

The TSTDA example upload demonstrates the default behavior using a manifest file with the minimum configuration options. The example files associated with job TSTDA are:

  • manifest-TSTDA.txt

  • export-log-TSTDA.csv

The following is the contents of manifest-TSTDA.txt file.

manifestVersion: 1.2
accessKeyId: 
deviceId: 532404500021
logBucket: myawsbucket
fileSystem: FAT32
operations:
    - exportBucket: myawsbucket
returnAddress:
    name: Amazon.com ATTN Joe Random
    street1: 123 Any Street
    city: Anytown
    stateOrProvince: WA
    postalCode: 91111
    phoneNumber: 555-555-0100
    country: USA

TSTDA Log File

After AWS Import/Export processes this job, the service saves the resulting log file to http://s3.amazonaws.com/myawsbucket/export-log-TSTDA. The contents of the log file are shown in the following table.

DateTimeFileStatusCodeKeyMD5BytesContent-Type
Tue 03 Feb 2009​21:57:43 GMTmyawsbucket/​README.txt200OKmyawsbucket/​README.txtd5a46fa2259​6d2464eff10​babb19000e13text/html
Tue 03 Feb 2009​21:57:43 GMT myawsbucket/​NOTICE​.txt200OKmyawsbucket/​NOTICE.txtf60fe317bc4​97b1204b327​094959eb64 13text/html
Tue 03 Feb 2009​21:57:43 GMTmyawsbucket/​images/​wookie1.jpg200OKmyawsbucket/​images/​wookie1.jpgccac0d031603​ff1c2994e07​703a64845447image/jpeg
Tue 03 Feb 2009​21:57:43 GMTmyawsbucket/​images/​chewie.gif200OKmyawsbucket/​images/​chewie.gif5fc22dc594e​0c5929c090​b9585ba9e70848image/gif
Tue 03 Feb 2009​21:57:43 GMTmyawsbucket/​images/​resources/chewie.psd200OKmyawsbucket /​images/​resources/​chewie.psd130b64d171​e9bbc2a8dbe1​17f189796c524application/​octet-stream
Tue 03 Feb 2009​21:57:43 GMTEXPORT-​RECOVERY​/0000/0000302Rema​ppedmyawsbucket//​backup/​images/​chewie.gif823d17b0​5321b968e01f9​174e3dcace7738image/gif

Example – TSTDB

The TSTDB example upload demonstrates the default behavior using a manifest file with the following configuration options: multiple buckets, targetDirectory, prefix, beginMarker, and endMarker. The example files associated with job TSTDB are:

  • manifest-TSTDB.txt

  • export-log-TSTDB.csv

The following is the contents of manifest-TSTDB.txt file.

manifestVersion: 2.0
accessKeyId: 
deviceId: 532404500021
logBucket: myawsbucket
logPrefix: logs/
fileSystem: NTFS
operations:
    - exportBucket: myawsbucket
      prefix: images
      targetDirectory: starwars/image-backup
    - exportBucket: lostbucket 
      beginMarker: html/
      endMarker: images/kate.jpg
returnAddress:
    name: Amazon.com ATTN Joe Random 
    street1: 123 Any Street    
    city: Anytown
    stateOrProvince: WA
    postalCode: 91111
    phoneNumber: 555-555-0100
    country: USA

TSTDB Log File

After AWS Import/Export processes this job, the service saves the resulting log file to http://s3.amazonaws.com/myawsbucket/export-log-TSTDB. The contents of the log file are shown in the following table.

DateTimeFileStatusCodeKeyMD5BytesContent-​Type
Tue 03 Feb 2009​21:57:43 GMTstarwars/​image-backup/​images/​wookie1.jpg200OKmyawsbucket /images/wookie1.jpgd5a46fa2259​6d246f10bab​b19000e13image/​jpeg
Tue 03 Feb 2009​21:57:43 GMT starwars/​image-backup/​images/​chewie.gif200OKmyawsbucket​/images/chewie.giff60fe317bc4​97b12047094​959eb64 13image/gif
Tue 03 Feb 2009​21:57:43 GMTstarwars/​image-backup/​images/chewie.tif200OKmyawsbucket​/images/chewie.tifccac0d031603​ff1c4e07703​a64845447image/​tiff
Tue 03 Feb 2009​21:57:43 GMTstarwars/​image-backup/​images/​resources/​chewie.psd200OKmyawsbucket​/images/​resources/​chewie.psd5fc22dc594e​0c5929cb958​5ba9e70848appli​cation/​octet-​stream
Tue 03 Feb 2009​21:57:43 GMTlostbucket/​html/​directory.html200OKlostbucket/​html/​directory.html130b64d171​e9bbc2ae117​f189796c524text/​html
Tue 03 Feb 2009​21:57:43 GMTlostbucket/​images/​hurley.jpg200OKlostbucket/​images/​hurley.jpg823d17b0​5321b968f917​4e3dcace7738image/​jpeg

Tue 03 Feb 2009​21:57:43 GMT

lostbucket/​images/​john.jpg200OKlostbucket/​images/​john.jpg823d17b0​5321b968e91​74e3dcace7615image/​jpeg

Tue 03 Feb 2009​21:57:43 GMT

lostbucket/​images/​kate.jpg200OKlostbucket/​images/​kate.jpg5fc22dc594​e0c5929c90b​9585ba9e70345image/​jpeg
Document Conventions« PreviousNext »
Terms of UseDid this page help you?  Yes | No |  Tell us about it...