Choosing a destination for your source server data - AWS IoT SiteWise

Choosing a destination for your source server data

Data is exported from the edge to AWS IoT SiteWise in real time, or in batches using Amazon S3. You can also send the stream to another component using a AWS IoT Greengrass stream.

  • AWS IoT SiteWise real-time – Choose this to send data directly to AWS IoT SiteWise storage. Ingest and monitor data in real-time, and process data at the edge.

  • AWS IoT SiteWise Buffered using Amazon S3 – Send data in parquet format to Amazon S3 and then import into AWS IoT SiteWise storage. Choose this option to ingest data in batches, and store historical data in a cost-effective way. You can configure your preferred Amazon S3 bucket location, and the frequency at which you want data to be uploaded to Amazon S3. You can also choose what to do with the data after ingestion into AWS IoT SiteWise. You can choose to have the data available in both SiteWise and Amazon S3 or you can choose to delete it automatically from Amazon S3.

    • The Amazon S3 bucket is a staging and buffering mechanism and supports files in the parquet format.

    • If you select the check box Import data into AWS IoT SiteWise storage, data is uploaded into Amazon S3 first, and then into AWS IoT SiteWise storage.

      • If you select the check box Delete data from Amazon S3, data is deleted from Amazon S3, after it is imported into SiteWise storage.

      • If you clear the check box Delete data from Amazon S3, data is stored both in Amazon S3, and in SiteWise storage.

    • If you clear the check box Import data into AWS IoT SiteWise storage, data is stored only in Amazon S3. It is not imported into SiteWise storage.

    Visit Managing data storage for details on the various storage options AWS IoT SiteWise provides. To learn more about pricing options, see AWS IoT SiteWise pricing.

  • AWS IoT Greengrass stream manager – Use AWS IoT Greengrass stream manager to send data to the following AWS Cloud destinations: channels in AWS IoT Analytics, streams in Amazon Kinesis Data Streams, asset properties in AWS IoT SiteWise, or objects in Amazon Simple Storage Service (Amazon S3). For more information, see Manage data streams on the AWS IoT Greengrass Core in AWS IoT Greengrass Version 2 Developer Guide.

The following example shows the required data stream message structure. All fields are required.

{ "assetId": "string", "propertyAlias": "string", "propertyId": "string", "propertyValues": [ { "quality": "string", "timestamp": { "offsetInNanos": number, "timeInSeconds": number }, "value": { "booleanValue": boolean, "doubleValue": number, "integerValue": number, "stringValue": "string" } } ] }
Note

The data stream message must include either (assetId and propertyId) or propertyAlias in its structure.

assetId

(Optional) The ID of the asset to update.

propertyAlias

(Optional) The alias that identifies the property, such as an OPC-UA server data stream path. For example:

/company/windfarm/3/turbine/7/temperature

For more information, see Mapping industrial data streams to asset properties in the AWS IoT SiteWise User Guide.

propertyId

(Optional) The ID of the asset property for this entry.

propertyValues

(Required) The list of property values to upload. You can specify up to 10 propertyValues array elements.

quality

(Optional) The quality of the asset property value.

timestamp

(Required) The timestamp of the asset property value.

offsetInNanos

(Optional) The nanosecond offset from timeInSeconds.

timeInSeconds

(Required) The timestamp date, in seconds, in the Unix epoch format. Fractional nanosecond data is provided by offsetInNanos.

value

(Required) The value of the asset property.

Note

Only one of the following values can exist in the value field.

booleanValue

(Optional) Asset property data of type Boolean (true or false).

doubleValue

(Optional) Asset property data of type double (floating point number).

integerValue

(Optional) Asset property data of type integer (whole number).

stringValue

(Optional) Asset property data of type string (sequence of characters).