Document history for Amazon OpenSearch Service and Amazon Elasticsearch Service - Amazon OpenSearch Service (successor to Amazon Elasticsearch Service)

Document history for Amazon OpenSearch Service and Amazon Elasticsearch Service

This topic describes important changes to Amazon OpenSearch Service.

Relevant Dates to this History:

  • Current product version—2021-01-01

  • Latest product release—October 5, 2021

  • Latest documentation update—October 5, 2021

Release notes

The following table describes important changes to Amazon OpenSearch Service and its predecessor, Amazon Elasticsearch Service. For notifications about updates, you can subscribe to the RSS feed.

Important

Service software updates add support for new features, security patches, bug fixes, and other improvements. To use new features, you might need to update the service software on your domain. For more information, see Service software updates in Amazon OpenSearch Service.

Change Description Date

Cross-cluster replication

Amazon OpenSearch Service adds cross-cluster replication, which lets you replicate indices, mappings, and metadata from one OpenSearch Service domain to another. Cross-cluster replication requires a domain running Elasticsearch 7.10. OpenSearch domains are not yet supported.

October 5, 2021

New AWS-managed policies

The launch of Amazon OpenSearch Service includes new AWS-managed policies and the deprecation of old policies. To learn more, see AWS-managed policies.

September 8, 2021

Data streams

Amazon OpenSearch Service adds support for data streams, which simplify the process of managing time-series data. This feature requires a domain running OpenSearch 1.0 or later.

September 8, 2021

Amazon OpenSearch Service

AWS introduces Amazon OpenSearch Service, the successor to Amazon Elasticsearch Service. Amazon OpenSearch Service supports OpenSearch and legacy Elasticsearch OSS. When you create a cluster, you have the option of which search engine to use. OpenSearch Service offers broad compatibility with Elasticsearch OSS 7.10, the final open source version of the software. For more information, see What is Amazon OpenSearch Service?

September 8, 2021

Kibana 6.4.3 support

Amazon Elasticsearch Service domains running Elasticsearch version 6.4 now support the latest patch release for Kibana 6.4, which adds bug fixes and improves security. Amazon ES will automatically upgrade domains to this patch release.

August 16, 2021

Cold storage

Amazon Elasticsearch Service adds cold storage, a new storage tier for infrequently accessed or historical data. Cold indices only occupy S3 storage and have no compute attached to them. Cold storage requires a domain running Elasticsearch 7.9 or later and service software R20210426 or later.

May 13, 2021

ARM-based Graviton instances

Amazon Elasticsearch Service now supports ARM-based Graviton instance types (M6G, C6G, R6G, and R6GD). Graviton instance types are available on new and existing domains running Elasticsearch 7.9 or later and service software R20210331 or later.

May 4, 2021

ISM templates

Amazon Elasticsearch Service adds support for ISM templates, which let you automatically attach an ISM policy to an index if the index matches a pattern defined in the policy. ISM templates require service software R20210426 or later. This update also deprecates the policy_id setting, meaning you can no longer use index templates to apply ISM policies to newly created indices. The update introduces a breaking change for existing CloudFormation templates using this setting.

April 27, 2021

Elasticsearch 7.10 support

Amazon Elasticsearch Service now supports Elasticsearch version 7.10. To learn more, see Supported versions and Upgrading.

April 21, 2021

Asynchronous search

Amazon Elasticsearch Service now supports asynchronous search, which lets you run search requests in the background. Asynchronous search requires a domain running Elasticsearch 7.10 or later and service software R20210331 or later.

April 21, 2021

Tag-based access control

You can now use AWS tags to control access to the Amazon ES configuration API.

March 2, 2021

Auto-Tune

Amazon Elasticsearch Service adds Auto-Tune, which uses performance and usage metrics from your cluster to suggest changes to the JVM settings on your nodes. Auto-Tune requires a domain running Elasticsearch 6.7 or later and service software R20201117 or later.

February 24, 2021

Trace Analytics

The default installation of Kibana for Amazon Elasticsearch Service now includes the trace analytics plugin, which lets you monitor trace data from your distributed applications. The plugin requires a domain running Elasticsearch 7.9 or later and service software R20210201 or later.

February 17, 2021

Shard metrics

Amazon Elasticsearch Service adds the following CloudWatch metrics for tracking shard status: Shards.active, Shards.unassigned, Shards.delayedUnassignedShards.activePrimary, Shards.initializing, Shards.relocating. The metrics are available on domains with service software R20210201 or later.

February 17, 2021

Kibana reports

The default installation of Kibana for Amazon Elasticsearch Service now supports on-demand reports for the Discover, Visualize, and Dashboard pages. This feature requires Elasticsearch 7.9 or later and service software R20210201 or later.

February 17, 2021

Kibana 5.6.16 support

Amazon Elasticsearch Service domains running Elasticsearch 5.6 now support the latest patch release for Kibana 5.6, which adds bug fixes and improves security. Amazon ES will automatically upgrade domains to this patch release.

February 17, 2021

Encryption for existing domains

Amazon Elasticsearch Service now supports enabling encryption of data at rest and node-to-node encryption on existing domains running Elasticsearch 6.7 or later. After you enable these settings, you can't disable them.

January 27, 2021

Remote reindex

Amazon Elasticsearch Service now supports remote reindex, which lets you migrate indices from remote domains. This feature requires service software R20201117 or later.

November 24, 2020

Piped Processing Language

Amazon Elasticsearch Service now supports Piped Processing Language (PPL), a query language that lets you use pipe (|) syntax to query data stored in Elasticsearch. This feature requires service software R20201117 or later. To learn more, see .

November 24, 2020

Kibana notebooks

Amazon Elasticsearch Service adds support for Kibana notebooks, which lets you combine live visualizations and narrative text in a single interface. This feature requires service software R20201117 or later.

November 24, 2020

Gantt charts

The default installation of Kibana for Amazon Elasticsearch Service now supports a new visualization type, Gantt charts. This feature requires service software R20201117 or later.

November 24, 2020

Elasticsearch 7.9 support

Amazon Elasticsearch Service now supports Elasticsearch version 7.9. To learn more, see Supported versions and Upgrading. This release also includes an all-new Kibana user interface for fine-grained access control.

November 24, 2020

Anomaly detection updates

Anomaly detection for Amazon Elasticsearch Service adds support for high cardinality, which lets you categorize anomalies with a dimension like IP address, product ID, country code, and so on. This feature requires service software R20201117 or later.

November 24, 2020

Dynamic dictionary updates

Amazon Elasticsearch Service now lets you update your search analyzers without reindexing. You can update the dictionary files on some or all of your domains, and Amazon ES tracks package versions over time so that you have a history of what changed and when. This feature requires service software R20201019 or later.

November 17, 2020

Custom endpoints

Amazon Elasticsearch Service now supports custom endpoints, which let you give your Amazon ES domain a new URL. If you ever swap domains, you can maintain the same URL. This feature requires service software R20201019 or later.

November 5, 2020

New language plugins

Amazon Elasticsearch Service now supports IK (Chinese) Analysis, Vietnamese Analysis, and Thai Analysis plugins on domains running Elasticsearch 7.7 or later with service software R20201019 or later.

October 28, 2020

Elasticsearch 7.8 support

Amazon Elasticsearch Service now supports Elasticsearch version 7.8. To learn more, see Supported versions and Upgrading.

October 28, 2020

SAML authentication for Kibana

Amazon Elasticsearch Service now supports SAML authentication for Kibana, which lets you use third-party identity providers to log in to Kibana, manage fine-grained access control, search your data, and build visualizations. This feature requires service software R20201019 or later.

October 27, 2020

T3 instances

Amazon Elasticsearch Service now supports the t3.small and t3.medium instance types. Consult the best practices around using these instance types.

September 23, 2020

Audit logs

Amazon Elasticsearch Service now supports audit logs for your data, which lets you track failed login attempts, user access to indices, documents, and fields, and much more. This feature requires service software R20200910 or later.

September 16, 2020

UltraWarm updates

UltraWarm for Amazon Elasticsearch Service adds new metrics, new settings, a larger migration queue, and a cancellation API. These updates require service software R20200910 or later. For more information, see .

September 14, 2020

Learning to Rank

Amazon Elasticsearch Service now supports the open source Learning to Rank plugin, which lets you use machine learning technologies to improve search relevance. This feature requires service software R20200721 or later.

July 27, 2020

k-NN cosine similarity

k-Nearest Neighbor (k-NN) now lets you search for "nearest neighbors" by cosine similarity in addition to Euclidean distance. This feature requires service software R20200721 or later.

July 23, 2020

gzip compression

Amazon Elasticsearch Service now supports gzip compression for most HTTP requests and responses, which can reduce latency and conserve bandwidth. This feature requires service software R20200721 or later.

July 23, 2020

Elasticsearch 7.7 support

Amazon Elasticsearch Service now supports Elasticsearch version 7.7. To learn more, see Supported Versions and Upgrading.

July 23, 2020

Kibana map service

The default installation of Kibana for Amazon Elasticsearch Service now includes a WMS map server, except for domains in the India and China Regions.

June 18, 2020

SQL improvements

SQL support for Amazon Elasticsearch Service now supports many new operations, a dedicated Kibana user interface for data exploration, and an interactive CLI. For more information, see .

June 3, 2020

Cross-cluster search

Amazon Elasticsearch Service lets you perform cross-cluster queries and aggregations across multiple connected domains.

June 3, 2020

Anomaly detection

Amazon Elasticsearch Service lets you automatically detect anomalies in near-real time.

June 3, 2020

UltraWarm

UltraWarm storage for Amazon Elasticsearch Service has left public preview and is now generally available. The feature now supports a wider range of versions and AWS Regions. For more information, see .

May 5, 2020

Custom dictionaries

Amazon Elasticsearch Service lets you upload custom dictionary files for use with your cluster. These files improve your search results by telling Elasticsearch to ignore certain high-frequency words or to treat terms as equivalent.

April 21, 2020

Elasticsearch 7.4 Support

Amazon Elasticsearch Service now supports Elasticsearch version 7.4. To learn more, see Supported versions and Upgrading.

March 12, 2020

k-NN

Amazon Elasticsearch Service adds support for k-Nearest Neighbor (k-NN) search. k-NN requires service software R20200302 or later.

March 3, 2020

Index State Management

Amazon Elasticsearch Service adds Index State Management (ISM), which lets you automate routine tasks, such as deleting indices when they reach a certain age. This feature requires service software R20200302 or later.

March 3, 2020

Elasticsearch 5.6.16 support

Amazon Elasticsearch Service now supports the latest patch release for version 5.6, which adds bug fixes and improves security. Amazon ES will automatically upgrade existing 5.6 domains to this release. Note that this Elasticsearch release incorrectly reports its version as 5.6.17.

March 2, 2020

Fine-grained access control

Amazon Elasticsearch Service now supports fine-grained access control, which offers security at the index, document, and field level, Kibana multi-tenancy, and optional HTTP basic authentication for your cluster.

February 11, 2020

UltraWarm storage (preview)

Amazon Elasticsearch Service adds UltraWarm, a new warm storage tier that uses Amazon S3 and a sophisticated caching solution to improve performance. For indices that you are not actively writing to and query less frequently, UltraWarm storage offers significantly lower costs per GiB.

December 3, 2019

Encryption features for China Regions

Encryption of data at rest and node-to-node encryption are now available in the cn-north-1 China (Beijing) Region and cn-northwest-1 China (Ningxia) Region.

November 20, 2019

Require HTTPS

You can now require that all traffic to your Amazon ES domains arrive over HTTPS. When configuring your domain, check the Require HTTPS box. This feature requires service software R20190808 or later.

October 3, 2019

Elasticsearch 7.1 and 6.8 support

Amazon Elasticsearch Service now supports Elasticsearch version 7.1 and 6.8. To learn more, see Supported versions and Upgrading.

August 13, 2019

Hourly snapshots

Rather than daily snapshots, Amazon Elasticsearch Service now takes hourly snapshots of domains running Elasticsearch 5.3 and later so that you have more frequent backups from which to restore your data.

July 8, 2019

Elasticsearch 6.7 support

Amazon Elasticsearch Service now supports Elasticsearch version 6.7. To learn more, see Supported versions.

May 29, 2019

SQL support

Amazon Elasticsearch Service now lets you query your data using SQL. SQL support requires service software R20190418 or later.

May 15, 2019

5-series instance types

Amazon Elasticsearch Service now supports M5, C5, and R5 instance types. Compared to previous-generation instance types, these new types offer better performance at lower prices. For more information, see Supported instance types and Limits.

April 24, 2019

Elasticsearch 6.5 support

Amazon Elasticsearch Service now supports Elasticsearch version 6.5. To learn more, see Supported versions.

April 8, 2019

Alerting

Alerting for Amazon Elasticsearch Service notifies you when data from one or more Amazon ES indices meets certain conditions. Alerting requires service software R20190221 or later.

March 25, 2019

Three Availability Zone support

Amazon Elasticsearch Service now supports three Availability Zones in many Regions. This release also includes a streamlined console experience. This multi-AZ requires service software R20181023 or later.

February 7, 2019

Elasticsearch 6.4 support

Amazon Elasticsearch Service now supports Elasticsearch version 6.4. To learn more, see Supported versions.

January 23, 2019

200-node clusters

Amazon ES now lets you create clusters with up to 200 data nodes for a total of 3 PB of storage. To learn more, see the petabyte scale documentation.

January 22, 2019

Service software updates

Amazon ES now lets you manually update the service software for your domain in order to benefit from new features more quickly or update at a low traffic time. To learn more, see .

November 20, 2018

New CloudWatch metrics

Amazon ES now offers node-level metrics and new Cluster health and Instance health tabs in the Amazon ES console. To learn more, see the metrics documentation.

November 20, 2018

China (Beijing) support

Amazon Elasticsearch Service is now available in the cn-north-1 Region, where it supports the M4, C4, and R4 instance types.

October 17, 2018

Node-to-node encryption

Amazon Elasticsearch Service now supports node-to-node encryption, which keeps your data encrypted as Amazon ES distributes it throughout your cluster.

September 18, 2018

In-place version upgrades

Amazon Elasticsearch Service now supports in-place version upgrades. To learn more, see Upgrading.

August 14, 2018

Elasticsearch 6.3 and 5.6 support

Amazon Elasticsearch Service now supports Elasticsearch version 6.3 and 5.6. To learn more, see Supported versions.

August 14, 2018

Error logs

Amazon ES now lets you publish Elasticsearch error logs to Amazon CloudWatch.

July 31, 2018

China (Ningxia) Reserved Instances

Amazon ES now offers Reserved Instances in the China (Ningxia) Region.

May 29, 2018

Reserved Instances

Amazon ES now offers support for Reserved Instances.

May 7, 2018

Earlier updates

The following table describes important changes Amazon ES before May 2018.

Change Description Date
Amazon Cognito Authentication for Kibana Amazon ES now offers login page protection for Kibana. To learn more, see Configuring Amazon Cognito authentication for OpenSearch Dashboards. April 2, 2018
Elasticsearch 6.2 Support

Amazon Elasticsearch Service now supports Elasticsearch version 6.2.

March 14, 2018
Korean Analysis Plugin Amazon ES now supports a memory-optimized version of the Seunjeon Korean analysis plugin. March 13, 2018
Instant Access Control Updates Changes to the access control policies on Amazon ES domains now take effect instantly. March 7, 2018
Petabyte Scale Amazon ES now supports I3 instance types and total domain storage of up to 1.5 PB. To learn more, see Petabyte scale for Amazon OpenSearch Service. 19 December 2017
Encryption of Data at Rest Amazon ES now supports encryption of data at rest. To learn more, see Encryption of data at rest for Amazon OpenSearch Service. December 7, 2017
Elasticsearch 6.0 Support

Amazon ES now supports Elasticsearch version 6.0. For migration considerations and instructions, see Upgrading OpenSearch and Elasticsearch.

December 6, 2017
VPC Support

Amazon ES now lets you launch domains within an Amazon Virtual Private Cloud. VPC support provides an additional layer of security and simplifies communications between Amazon ES and other services within a VPC. To learn more, see Launching your Amazon OpenSearch Service domains within a VPC.

October 17, 2017
Slow Logs Publishing

Amazon ES now supports the publishing of slow logs to CloudWatch Logs. To learn more, see Monitoring OpenSearch logs with Amazon CloudWatch Logs.

October 16, 2017
Elasticsearch 5.5 Support

Amazon ES now supports Elasticsearch version 5.5.

You can now restore automated snapshots without contacting AWS Support and store scripts using the _scripts API.

September 7, 2017
Elasticsearch 5.3 Support Amazon ES added support for Elasticsearch version 5.3. June 1, 2017
More Instances and EBS Capacity per Cluster Amazon ES now supports up to 100 nodes and 150 TB EBS capacity per cluster. April 5, 2017
Canada (Central) and EU (London) Support Amazon ES added support for the following Regions: Canada (Central), ca-central-1, and EU (London), eu-west-2. March 20, 2017
More Instances and Larger EBS Volumes Amazon ES added support for more instances and larger EBS volumes. February 21, 2017
Elasticsearch 5.1 Support Amazon ES added support for Elasticsearch version 5.1. January 30, 2017
Support for the Phonetic Analysis Plugin Amazon ES now provides built-in integration with the Phonetic Analysis plugin, which allows you to run “sounds-like” queries on your data. December 22, 2016
US East (Ohio) Support Amazon ES added support for the following Region: US East (Ohio), us-east-2. October 17, 2016
New Performance Metric Amazon ES added a performance metric, ClusterUsedSpace. July 29, 2016
Elasticsearch 2.3 Support Amazon ES added support for Elasticsearch version 2.3. July 27, 2016
Asia Pacific (Mumbai) Support Amazon ES added support for the following Region: Asia Pacific (Mumbai), ap-south-1. June 27, 2016
More Instances per Cluster Amazon ES increased the maximum number of instances (instance count) per cluster from 10 to 20. May 18, 2016
Asia Pacific (Seoul) Support Amazon ES added support for the following Region: Asia Pacific (Seoul), ap-northeast-2. January 28, 2016
Amazon ES Initial release. October 1, 2015