AWS services or capabilities described in AWS Documentation may vary by region/location. Click Getting Started with Amazon AWS to see specific differences applicable to the China (Beijing) Region.
Specify a shard iterator using the ShardIterator
parameter. The shard
iterator specifies the position in the shard from which you want to start reading
data records sequentially. If there are no records available in the portion of the
shard that the iterator points to, GetRecords returns an empty list. Note that
it might take multiple calls to get to a portion of the shard that contains records.
You can scale by provisioning multiple shards. Your application should have one thread
per shard, each reading continuously from its stream. To read from a stream continually,
call GetRecords in a loop. Use GetShardIterator to get the shard iterator
to specify in the first GetRecords call. GetRecords returns a new shard
iterator in NextShardIterator
. Specify the shard iterator returned in
NextShardIterator
in subsequent calls to GetRecords. Note that
if the shard has been closed, the shard iterator can't return more data and GetRecords
returns null
in NextShardIterator
. You can terminate the
loop when the shard is closed, or when the shard iterator reaches the record with
the sequence number or other attribute that marks it as the last record to process.
Each data record can be up to 1 MB in size, and each shard can read up to 2 MB per
second. You can ensure that your calls don't exceed the maximum supported size or
throughput by using the Limit
parameter to specify the maximum number
of records that GetRecords can return. Consider your average record size when
determining this limit.
The size of the data returned by GetRecords will vary depending on the utilization
of the shard. The maximum size of data that GetRecords can return is 10 MB.
If a call returns this amount of data, subsequent calls made within the next 5 seconds
throw ProvisionedThroughputExceededException
. If there is insufficient
provisioned throughput on the shard, subsequent calls made within the next 1 second
throw ProvisionedThroughputExceededException
. Note that GetRecords
won't return any data when it throws an exception. For this reason, we recommend that
you wait one second between calls to GetRecords; however, it's possible that
the application will get exceptions for longer than 1 second.
To detect whether the application is falling behind in processing, you can use the
MillisBehindLatest
response attribute. You can also monitor the stream
using CloudWatch metrics (see Monitoring
Amazon Kinesis in the Amazon Kinesis Developer Guide).
Each Amazon Kinesis record includes a value, ApproximateArrivalTimestamp
,
that is set when an Amazon Kinesis stream successfully receives and stores a record.
This is commonly referred to as a server-side timestamp, which is different than a
client-side timestamp, where the timestamp is set when a data producer creates or
sends the record to a stream. The timestamp has millisecond precision. There are no
guarantees about the timestamp accuracy, or that the timestamp is always increasing.
For example, records in a shard or across a stream might have timestamps that are
out of order.
Namespace: Amazon.Kinesis.Model
Assembly: AWSSDK.dll
Version: (assembly version)
public class GetRecordsRequest : AmazonKinesisRequest IRequestEvents
The GetRecordsRequest type exposes the following members
Name | Description | |
---|---|---|
GetRecordsRequest() |
Name | Type | Description | |
---|---|---|---|
Limit | System.Int32 |
Gets and sets the property Limit.
The maximum number of records to return. Specify a value of up to 10,000. If you specify
a value that is greater than 10,000, GetRecords throws |
|
ShardIterator | System.String |
Gets and sets the property ShardIterator.
The position in the shard from which you want to start sequentially reading data records. A shard iterator specifies this position using the sequence number of a data record in the shard. |
.NET Framework:
Supported in: 4.5, 4.0, 3.5
.NET for Windows Store apps:
Supported in: Windows 8.1, Windows 8
.NET for Windows Phone:
Supported in: Windows Phone 8.1, Windows Phone 8