Working with Amazon OpenSearch Service direct queries with Amazon S3
You can use Amazon OpenSearch Service direct queries to query data in Amazon S3. Amazon OpenSearch Service provides a direct query integration with Amazon S3 as a way to analyze operational logs in Amazon S3 and data lakes based in Amazon S3 without having to switch between services. You can now analyze data in cloud object stores—and simultaneously use the operational analytics and visualizations of OpenSearch Service.
With direct queries with Amazon S3, you no longer need to build complex ETL pipelines or incur the expense of duplicating data in both OpenSearch Service and Amazon S3 storage. You can also install integrations of popular log-type templates that include predefined dashboards, and configure data accelerations tailored to that log type. The templates include VPC Flow Logs, AWS CloudTrail logs, and Amazon S3 logs. The accelerations include skipping indexes, materialized views, and covered indexes.
Topics
Quotas
Your account has the following quotas related to OpenSearch Service direct queries with Amazon S3. Each time you initiate a query, OpenSearch Service opens a session and keeps it alive for at least ten minutes. This reduces query latency by removing session startup time in subsequent queries.
| Description | Maxiumum | Can override |
|---|---|---|
| Connections per domain | 10 | Yes |
| Data sources per domain | 20 | Yes |
| Indexes per domain | 5 | Yes |
| Concurrent sessions per data source | 10 | Yes |
| Maximum OCU per query | 60 | Yes |
| Maximum query execution time (minutes) | 30 | Yes |
| Maximum OCUs per acceleration | 20 | Yes |
| Maximum ephemeral storage | 20 | Yes |
Supported Regions
The following Regions are available for OpenSearch Service direct queries with Amazon S3: Asia Pacific (Hong Kong), Asia Pacific (Mumbai), Asia Pacific (Seoul), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), Canada (Central), Europe (Frankfurt), Europe (Ireland), Europe (Stockholm), US East (N. Virginia), US East (Ohio), and US West (Oregon).
