You are viewing documentation for version 3 of the AWS SDK for Ruby. Version 2 documentation can be found here.

Class: Aws::DynamoDBStreams::Client

Inherits:
Seahorse::Client::Base show all
Includes:
ClientStubs
Defined in:
gems/aws-sdk-dynamodbstreams/lib/aws-sdk-dynamodbstreams/client.rb

Instance Attribute Summary

Attributes inherited from Seahorse::Client::Base

#config, #handlers

API Operations collapse

Instance Method Summary collapse

Methods included from ClientStubs

#api_requests, #stub_data, #stub_responses

Methods inherited from Seahorse::Client::Base

add_plugin, api, clear_plugins, define, new, #operation_names, plugins, remove_plugin, set_api, set_plugins

Methods included from Seahorse::Client::HandlerBuilder

#handle, #handle_request, #handle_response

Constructor Details

#initialize(options) ⇒ Client

Returns a new instance of Client

Parameters:

  • options (Hash)

Options Hash (options):

  • :credentials (required, Aws::CredentialProvider)

    Your AWS credentials. This can be an instance of any one of the following classes:

    • Aws::Credentials - Used for configuring static, non-refreshing credentials.

    • Aws::InstanceProfileCredentials - Used for loading credentials from an EC2 IMDS on an EC2 instance.

    • Aws::SharedCredentials - Used for loading credentials from a shared file, such as ~/.aws/config.

    • Aws::AssumeRoleCredentials - Used when you need to assume a role.

    When :credentials are not configured directly, the following locations will be searched for credentials:

    • Aws.config[:credentials]
    • The :access_key_id, :secret_access_key, and :session_token options.
    • ENV['AWS_ACCESS_KEY_ID'], ENV['AWS_SECRET_ACCESS_KEY']
    • ~/.aws/credentials
    • ~/.aws/config
    • EC2 IMDS instance profile - When used by default, the timeouts are very aggressive. Construct and pass an instance of Aws::InstanceProfileCredentails to enable retries and extended timeouts.
  • :region (required, String)

    The AWS region to connect to. The configured :region is used to determine the service :endpoint. When not passed, a default :region is search for in the following locations:

    • Aws.config[:region]
    • ENV['AWS_REGION']
    • ENV['AMAZON_REGION']
    • ENV['AWS_DEFAULT_REGION']
    • ~/.aws/credentials
    • ~/.aws/config
  • :access_key_id (String)
  • :active_endpoint_cache (Boolean) — default: false

    When set to true, a thread polling for endpoints will be running in the background every 60 secs (default). Defaults to false.

  • :client_side_monitoring (Boolean) — default: false

    When true, client-side metrics will be collected for all API requests from this client.

  • :client_side_monitoring_client_id (String) — default: ""

    Allows you to provide an identifier for this client which will be attached to all generated client side metrics. Defaults to an empty string.

  • :client_side_monitoring_host (String) — default: "127.0.0.1"

    Allows you to specify the DNS hostname or IPv4 or IPv6 address that the client side monitoring agent is running on, where client metrics will be published via UDP.

  • :client_side_monitoring_port (Integer) — default: 31000

    Required for publishing client metrics. The port that the client side monitoring agent is running on, where client metrics will be published via UDP.

  • :client_side_monitoring_publisher (Aws::ClientSideMonitoring::Publisher) — default: Aws::ClientSideMonitoring::Publisher

    Allows you to provide a custom client-side monitoring publisher class. By default, will use the Client Side Monitoring Agent Publisher.

  • :convert_params (Boolean) — default: true

    When true, an attempt is made to coerce request parameters into the required types.

  • :disable_host_prefix_injection (Boolean) — default: false

    Set to true to disable SDK automatically adding host prefix to default service endpoint when available.

  • :endpoint (String)

    The client endpoint is normally constructed from the :region option. You should only configure an :endpoint when connecting to test endpoints. This should be avalid HTTP(S) URI.

  • :endpoint_cache_max_entries (Integer) — default: 1000

    Used for the maximum size limit of the LRU cache storing endpoints data for endpoint discovery enabled operations. Defaults to 1000.

  • :endpoint_cache_max_threads (Integer) — default: 10

    Used for the maximum threads in use for polling endpoints to be cached, defaults to 10.

  • :endpoint_cache_poll_interval (Integer) — default: 60

    When :endpoint_discovery and :active_endpoint_cache is enabled, Use this option to config the time interval in seconds for making requests fetching endpoints information. Defaults to 60 sec.

  • :endpoint_discovery (Boolean) — default: false

    When set to true, endpoint discovery will be enabled for operations when available. Defaults to false.

  • :log_formatter (Aws::Log::Formatter) — default: Aws::Log::Formatter.default

    The log formatter.

  • :log_level (Symbol) — default: :info

    The log level to send messages to the :logger at.

  • :logger (Logger)

    The Logger instance to send log messages to. If this option is not set, logging will be disabled.

  • :profile (String) — default: "default"

    Used when loading credentials from the shared credentials file at HOME/.aws/credentials. When not specified, 'default' is used.

  • :retry_base_delay (Float) — default: 0.3

    The base delay in seconds used by the default backoff function.

  • :retry_jitter (Symbol) — default: :none

    A delay randomiser function used by the default backoff function. Some predefined functions can be referenced by name - :none, :equal, :full, otherwise a Proc that takes and returns a number.

    @see https://www.awsarchitectureblog.com/2015/03/backoff.html

  • :retry_limit (Integer) — default: 3

    The maximum number of times to retry failed requests. Only ~ 500 level server errors and certain ~ 400 level client errors are retried. Generally, these are throttling errors, data checksum errors, networking errors, timeout errors and auth errors from expired credentials.

  • :retry_max_delay (Integer) — default: 0

    The maximum number of seconds to delay between retries (0 for no limit) used by the default backoff function.

  • :secret_access_key (String)
  • :session_token (String)
  • :simple_json (Boolean) — default: false

    Disables request parameter conversion, validation, and formatting. Also disable response data type conversions. This option is useful when you want to ensure the highest level of performance by avoiding overhead of walking request parameters and response data structures.

    When :simple_json is enabled, the request parameters hash must be formatted exactly as the DynamoDB API expects.

  • :stub_responses (Boolean) — default: false

    Causes the client to return stubbed responses. By default fake responses are generated and returned. You can specify the response data to return or errors to raise by calling ClientStubs#stub_responses. See ClientStubs for more information.

    Please note When response stubbing is enabled, no HTTP requests are made, and retries are disabled.

  • :validate_params (Boolean) — default: true

    When true, request parameters are validated before sending the request.

  • :http_proxy (URI::HTTP, String)

    A proxy to send requests through. Formatted like 'http://proxy.com:123'.

  • :http_open_timeout (Float) — default: 15

    The number of seconds to wait when opening a HTTP session before rasing a Timeout::Error.

  • :http_read_timeout (Integer) — default: 60

    The default number of seconds to wait for response data. This value can safely be set per-request on the session yeidled by #session_for.

  • :http_idle_timeout (Float) — default: 5

    The number of seconds a connection is allowed to sit idble before it is considered stale. Stale connections are closed and removed from the pool before making a request.

  • :http_continue_timeout (Float) — default: 1

    The number of seconds to wait for a 100-continue response before sending the request body. This option has no effect unless the request has "Expect" header set to "100-continue". Defaults to nil which disables this behaviour. This value can safely be set per request on the session yeidled by #session_for.

  • :http_wire_trace (Boolean) — default: false

    When true, HTTP debug output will be sent to the :logger.

  • :ssl_verify_peer (Boolean) — default: true

    When true, SSL peer certificates are verified when establishing a connection.

  • :ssl_ca_bundle (String)

    Full path to the SSL certificate authority bundle file that should be used when verifying peer certificates. If you do not pass :ssl_ca_bundle or :ssl_ca_directory the the system default will be used if available.

  • :ssl_ca_directory (String)

    Full path of the directory that contains the unbundled SSL certificate authority files for verifying peer certificates. If you do not pass :ssl_ca_bundle or :ssl_ca_directory the the system default will be used if available.



261
262
263
# File 'gems/aws-sdk-dynamodbstreams/lib/aws-sdk-dynamodbstreams/client.rb', line 261

def initialize(*args)
  super
end

Instance Method Details

#describe_stream(params = {}) ⇒ Types::DescribeStreamOutput

Returns information about a stream, including the current status of the stream, its Amazon Resource Name (ARN), the composition of its shards, and its corresponding DynamoDB table.

You can call DescribeStream at a maximum rate of 10 times per second.

Each shard in the stream has a SequenceNumberRange associated with it. If the SequenceNumberRange has a StartingSequenceNumber but no EndingSequenceNumber, then the shard is still open (able to receive more stream records). If both StartingSequenceNumber and EndingSequenceNumber are present, then that shard is closed and can no longer receive more data.

Examples:

Example: To describe a stream with a given stream ARN


# The following example describes a stream with a given stream ARN.

resp = client.describe_stream({
  stream_arn: "arn:aws:dynamodb:us-west-2:111122223333:table/Forum/stream/2015-05-20T20:51:10.252", 
})

resp.to_h outputs the following:
{
  stream_description: {
    creation_request_date_time: Time.parse("Wed May 20 13:51:10 PDT 2015"), 
    key_schema: [
      {
        attribute_name: "ForumName", 
        key_type: "HASH", 
      }, 
      {
        attribute_name: "Subject", 
        key_type: "RANGE", 
      }, 
    ], 
    shards: [
      {
        sequence_number_range: {
          ending_sequence_number: "20500000000000000910398", 
          starting_sequence_number: "20500000000000000910398", 
        }, 
        shard_id: "shardId-00000001414562045508-2bac9cd2", 
      }, 
      {
        parent_shard_id: "shardId-00000001414562045508-2bac9cd2", 
        sequence_number_range: {
          ending_sequence_number: "820400000000000001192334", 
          starting_sequence_number: "820400000000000001192334", 
        }, 
        shard_id: "shardId-00000001414576573621-f55eea83", 
      }, 
      {
        parent_shard_id: "shardId-00000001414576573621-f55eea83", 
        sequence_number_range: {
          ending_sequence_number: "1683700000000000001135967", 
          starting_sequence_number: "1683700000000000001135967", 
        }, 
        shard_id: "shardId-00000001414592258131-674fd923", 
      }, 
      {
        parent_shard_id: "shardId-00000001414592258131-674fd923", 
        sequence_number_range: {
          starting_sequence_number: "2574600000000000000935255", 
        }, 
        shard_id: "shardId-00000001414608446368-3a1afbaf", 
      }, 
    ], 
    stream_arn: "arn:aws:dynamodb:us-west-2:111122223333:table/Forum/stream/2015-05-20T20:51:10.252", 
    stream_label: "2015-05-20T20:51:10.252", 
    stream_status: "ENABLED", 
    stream_view_type: "NEW_AND_OLD_IMAGES", 
    table_name: "Forum", 
  }, 
}

Request syntax with placeholder values


resp = client.describe_stream({
  stream_arn: "StreamArn", # required
  limit: 1,
  exclusive_start_shard_id: "ShardId",
})

Response structure


resp.stream_description.stream_arn #=> String
resp.stream_description.stream_label #=> String
resp.stream_description.stream_status #=> String, one of "ENABLING", "ENABLED", "DISABLING", "DISABLED"
resp.stream_description.stream_view_type #=> String, one of "NEW_IMAGE", "OLD_IMAGE", "NEW_AND_OLD_IMAGES", "KEYS_ONLY"
resp.stream_description.creation_request_date_time #=> Time
resp.stream_description.table_name #=> String
resp.stream_description.key_schema #=> Array
resp.stream_description.key_schema[0].attribute_name #=> String
resp.stream_description.key_schema[0].key_type #=> String, one of "HASH", "RANGE"
resp.stream_description.shards #=> Array
resp.stream_description.shards[0].shard_id #=> String
resp.stream_description.shards[0].sequence_number_range.starting_sequence_number #=> String
resp.stream_description.shards[0].sequence_number_range.ending_sequence_number #=> String
resp.stream_description.shards[0].parent_shard_id #=> String
resp.stream_description.last_evaluated_shard_id #=> String

Parameters:

  • params (Hash) (defaults to: {})

    ({})

Options Hash (params):

  • :stream_arn (required, String)

    The Amazon Resource Name (ARN) for the stream.

  • :limit (Integer)

    The maximum number of shard objects to return. The upper limit is 100.

  • :exclusive_start_shard_id (String)

    The shard ID of the first item that this operation will evaluate. Use the value that was returned for LastEvaluatedShardId in the previous operation.

Returns:

See Also:



391
392
393
394
# File 'gems/aws-sdk-dynamodbstreams/lib/aws-sdk-dynamodbstreams/client.rb', line 391

def describe_stream(params = {}, options = {})
  req = build_request(:describe_stream, params)
  req.send_request(options)
end

#get_records(params = {}) ⇒ Types::GetRecordsOutput

Retrieves the stream records from a given shard.

Specify a shard iterator using the ShardIterator parameter. The shard iterator specifies the position in the shard from which you want to start reading stream records sequentially. If there are no stream records available in the portion of the shard that the iterator points to, GetRecords returns an empty list. Note that it might take multiple calls to get to a portion of the shard that contains stream records.

GetRecords can retrieve a maximum of 1 MB of data or 1000 stream records, whichever comes first.

Examples:

Example: To retrieve all the stream records from a shard


# The following example retrieves all the stream records from a shard.

resp = client.get_records({
  shard_iterator: "arn:aws:dynamodb:us-west-2:111122223333:table/Forum/stream/2015-05-20T20:51:10.252|1|AAAAAAAAAAEvJp6D+zaQ...  <remaining characters omitted> ...", 
})

resp.to_h outputs the following:
{
  next_shard_iterator: "arn:aws:dynamodb:us-west-2:111122223333:table/Forum/stream/2015-05-20T20:51:10.252|1|AAAAAAAAAAGQBYshYDEe ... <remaining characters omitted> ...", 
  records: [
    {
      aws_region: "us-west-2", 
      dynamodb: {
        approximate_creation_date_time: Time.parse("1.46480646E9"), 
        keys: {
          "ForumName" => {
            s: "DynamoDB", 
          }, 
          "Subject" => {
            s: "DynamoDB Thread 3", 
          }, 
        }, 
        sequence_number: "300000000000000499659", 
        size_bytes: 41, 
        stream_view_type: "KEYS_ONLY", 
      }, 
      event_id: "e2fd9c34eff2d779b297b26f5fef4206", 
      event_name: "INSERT", 
      event_source: "aws:dynamodb", 
      event_version: "1.0", 
    }, 
    {
      aws_region: "us-west-2", 
      dynamodb: {
        approximate_creation_date_time: Time.parse("1.46480527E9"), 
        keys: {
          "ForumName" => {
            s: "DynamoDB", 
          }, 
          "Subject" => {
            s: "DynamoDB Thread 1", 
          }, 
        }, 
        sequence_number: "400000000000000499660", 
        size_bytes: 41, 
        stream_view_type: "KEYS_ONLY", 
      }, 
      event_id: "4b25bd0da9a181a155114127e4837252", 
      event_name: "MODIFY", 
      event_source: "aws:dynamodb", 
      event_version: "1.0", 
    }, 
    {
      aws_region: "us-west-2", 
      dynamodb: {
        approximate_creation_date_time: Time.parse("1.46480646E9"), 
        keys: {
          "ForumName" => {
            s: "DynamoDB", 
          }, 
          "Subject" => {
            s: "DynamoDB Thread 2", 
          }, 
        }, 
        sequence_number: "500000000000000499661", 
        size_bytes: 41, 
        stream_view_type: "KEYS_ONLY", 
      }, 
      event_id: "740280c73a3df7842edab3548a1b08ad", 
      event_name: "REMOVE", 
      event_source: "aws:dynamodb", 
      event_version: "1.0", 
    }, 
  ], 
}

Request syntax with placeholder values


resp = client.get_records({
  shard_iterator: "ShardIterator", # required
  limit: 1,
})

Response structure


resp.records #=> Array
resp.records[0].event_id #=> String
resp.records[0].event_name #=> String, one of "INSERT", "MODIFY", "REMOVE"
resp.records[0].event_version #=> String
resp.records[0].event_source #=> String
resp.records[0].aws_region #=> String
resp.records[0].dynamodb.approximate_creation_date_time #=> Time
resp.records[0].dynamodb.keys #=> Hash
resp.records[0].dynamodb.keys["AttributeName"] #=> <Hash,Array,String,Numeric,Boolean,IO,Set,nil>
resp.records[0].dynamodb.new_image #=> Hash
resp.records[0].dynamodb.new_image["AttributeName"] #=> <Hash,Array,String,Numeric,Boolean,IO,Set,nil>
resp.records[0].dynamodb.old_image #=> Hash
resp.records[0].dynamodb.old_image["AttributeName"] #=> <Hash,Array,String,Numeric,Boolean,IO,Set,nil>
resp.records[0].dynamodb.sequence_number #=> String
resp.records[0].dynamodb.size_bytes #=> Integer
resp.records[0].dynamodb.stream_view_type #=> String, one of "NEW_IMAGE", "OLD_IMAGE", "NEW_AND_OLD_IMAGES", "KEYS_ONLY"
resp.records[0].user_identity.principal_id #=> String
resp.records[0].user_identity.type #=> String
resp.next_shard_iterator #=> String

Parameters:

  • params (Hash) (defaults to: {})

    ({})

Options Hash (params):

  • :shard_iterator (required, String)

    A shard iterator that was retrieved from a previous GetShardIterator operation. This iterator can be used to access the stream records in this shard.

  • :limit (Integer)

    The maximum number of records to return from the shard. The upper limit is 1000.

Returns:

See Also:



537
538
539
540
# File 'gems/aws-sdk-dynamodbstreams/lib/aws-sdk-dynamodbstreams/client.rb', line 537

def get_records(params = {}, options = {})
  req = build_request(:get_records, params)
  req.send_request(options)
end

#get_shard_iterator(params = {}) ⇒ Types::GetShardIteratorOutput

Returns a shard iterator. A shard iterator provides information about how to retrieve the stream records from within a shard. Use the shard iterator in a subsequent GetRecords request to read the stream records from the shard.

A shard iterator expires 15 minutes after it is returned to the requester.

Examples:

Example: To obtain a shard iterator for the provided stream ARN and shard ID


# The following example returns a shard iterator for the provided stream ARN and shard ID.

resp = client.get_shard_iterator({
  shard_id: "00000001414576573621-f55eea83", 
  shard_iterator_type: "TRIM_HORIZON", 
  stream_arn: "arn:aws:dynamodb:us-west-2:111122223333:table/Forum/stream/2015-05-20T20:51:10.252", 
})

resp.to_h outputs the following:
{
  shard_iterator: "arn:aws:dynamodb:us-west-2:111122223333:table/Forum/stream/2015-05-20T20:51:10.252|1|AAAAAAAAAAEvJp6D+zaQ...  <remaining characters omitted> ...", 
}

Request syntax with placeholder values


resp = client.get_shard_iterator({
  stream_arn: "StreamArn", # required
  shard_id: "ShardId", # required
  shard_iterator_type: "TRIM_HORIZON", # required, accepts TRIM_HORIZON, LATEST, AT_SEQUENCE_NUMBER, AFTER_SEQUENCE_NUMBER
  sequence_number: "SequenceNumber",
})

Response structure


resp.shard_iterator #=> String

Parameters:

  • params (Hash) (defaults to: {})

    ({})

Options Hash (params):

  • :stream_arn (required, String)

    The Amazon Resource Name (ARN) for the stream.

  • :shard_id (required, String)

    The identifier of the shard. The iterator will be returned for this shard ID.

  • :shard_iterator_type (required, String)

    Determines how the shard iterator is used to start reading stream records from the shard:

    • AT_SEQUENCE_NUMBER - Start reading exactly from the position denoted by a specific sequence number.

    • AFTER_SEQUENCE_NUMBER - Start reading right after the position denoted by a specific sequence number.

    • TRIM_HORIZON - Start reading at the last (untrimmed) stream record, which is the oldest record in the shard. In DynamoDB Streams, there is a 24 hour limit on data retention. Stream records whose age exceeds this limit are subject to removal (trimming) from the stream.

    • LATEST - Start reading just after the most recent stream record in the shard, so that you always read the most recent data in the shard.

  • :sequence_number (String)

    The sequence number of a stream record in the shard from which to start reading.

Returns:

See Also:



620
621
622
623
# File 'gems/aws-sdk-dynamodbstreams/lib/aws-sdk-dynamodbstreams/client.rb', line 620

def get_shard_iterator(params = {}, options = {})
  req = build_request(:get_shard_iterator, params)
  req.send_request(options)
end

#list_streams(params = {}) ⇒ Types::ListStreamsOutput

Returns an array of stream ARNs associated with the current account and endpoint. If the TableName parameter is present, then ListStreams will return only the streams ARNs for that table.

You can call ListStreams at a maximum rate of 5 times per second.

Examples:

Example: To list all of the stream ARNs


# The following example lists all of the stream ARNs.

resp = client.list_streams({
})

resp.to_h outputs the following:
{
  streams: [
    {
      stream_arn: "arn:aws:dynamodb:us-wesst-2:111122223333:table/Forum/stream/2015-05-20T20:51:10.252", 
      stream_label: "2015-05-20T20:51:10.252", 
      table_name: "Forum", 
    }, 
    {
      stream_arn: "arn:aws:dynamodb:us-west-2:111122223333:table/Forum/stream/2015-05-20T20:50:02.714", 
      stream_label: "2015-05-20T20:50:02.714", 
      table_name: "Forum", 
    }, 
    {
      stream_arn: "arn:aws:dynamodb:us-west-2:111122223333:table/Forum/stream/2015-05-19T23:03:50.641", 
      stream_label: "2015-05-19T23:03:50.641", 
      table_name: "Forum", 
    }, 
  ], 
}

Request syntax with placeholder values


resp = client.list_streams({
  table_name: "TableName",
  limit: 1,
  exclusive_start_stream_arn: "StreamArn",
})

Response structure


resp.streams #=> Array
resp.streams[0].stream_arn #=> String
resp.streams[0].table_name #=> String
resp.streams[0].stream_label #=> String
resp.last_evaluated_stream_arn #=> String

Parameters:

  • params (Hash) (defaults to: {})

    ({})

Options Hash (params):

  • :table_name (String)

    If this parameter is provided, then only the streams associated with this table name are returned.

  • :limit (Integer)

    The maximum number of streams to return. The upper limit is 100.

  • :exclusive_start_stream_arn (String)

    The ARN (Amazon Resource Name) of the first item that this operation will evaluate. Use the value that was returned for LastEvaluatedStreamArn in the previous operation.

Returns:

See Also:



699
700
701
702
# File 'gems/aws-sdk-dynamodbstreams/lib/aws-sdk-dynamodbstreams/client.rb', line 699

def list_streams(params = {}, options = {})
  req = build_request(:list_streams, params)
  req.send_request(options)
end