Document history for Amazon Elasticsearch Service - Amazon Elasticsearch Service

Document history for Amazon Elasticsearch Service

This topic describes important changes to Amazon Elasticsearch Service.

Relevant Dates to this History:

  • Current product version—2015-01-01

  • Latest product release—May 13, 2021

  • Latest documentation update—May 20, 2021

Release notes

The following table describes important changes to Amazon ES. For notifications about updates, you can subscribe to the RSS feed.

Important

Service software updates add support for new features, security patches, bug fixes, and other improvements. To use new features, you might need to update the service software on your domain. For more information, see Service software updates in Amazon Elasticsearch Service.

Change Description Date

Cold storage

Amazon Elasticsearch Service adds cold storage, a new storage tier for infrequently accessed or historical data. Cold indices only occupy S3 storage and have no compute attached to them. Cold storage requires a domain running Elasticsearch 7.9 or later and service software R20210426 or later. For more information, see Cold storage for Amazon Elasticsearch Service.

May 13, 2021

ARM-based Graviton instances

Amazon Elasticsearch Service now supports ARM-based Graviton instance types (M6G, C6G, R6G, and R6GD). Graviton instance types are available on new and existing domains running Elasticsearch 7.9 or later and service software R20210331 or later. For details, see Supported instance types in Amazon Elasticsearch Service.

May 4, 2021

ISM templates

Amazon Elasticsearch Service adds support for ISM templates, which let you automatically attach an ISM policy to an index if the index matches a pattern defined in the policy. ISM templates require service software R20210426 or later. This update also deprecates the policy_id setting, meaning you can no longer use index templates to apply ISM policies to newly created indices. The update introduces a breaking change for existing CloudFormation templates using this setting. To learn more, see ISM templates.

April 27, 2021

Elasticsearch 7.10 support

Amazon Elasticsearch Service now supports Elasticsearch version 7.10. To learn more, see Supported Elasticsearch versions and Upgrading Elasticsearch.

April 21, 2021

Asynchronous search

Amazon Elasticsearch Service now supports asynchronous search, which lets you run search requests in the background. Asynchronous search requires a domain running Elasticsearch 7.9 or later and service software R20210331 or later. To learn more, see Asynchronous search for Amazon Elasticsearch Service.

April 21, 2021

Tag-based access control

You can now use AWS tags to control access to the Amazon ES configuration API. For more information, see Identity and Access Management in Amazon Elasticsearch Service.

March 2, 2021

Auto-Tune

Amazon Elasticsearch Service adds Auto-Tune, which uses performance and usage metrics from your cluster to suggest changes to the JVM settings on your nodes. Auto-Tune requires a domain running Elasticsearch 6.7 or later and service software R20201117 or later. For more information, see Auto-Tune for Amazon Elasticsearch Service.

February 24, 2021

Trace Analytics

The default installation of Kibana for Amazon Elasticsearch Service now includes the Trace Analytics plugin, which lets you monitor trace data from your distributed applications. The plugin requires a domain running Elasticsearch 7.9 or later and service software R20210201 or later. To learn more, see Trace Analytics for Amazon Elasticsearch Service.

February 17, 2021

Shard metrics

Amazon Elasticsearch Service adds the following CloudWatch metrics for tracking shard status: Shards.active, Shards.unassigned, Shards.delayedUnassignedShards.activePrimary, Shards.initializing, Shards.relocating. The metrics are available on domains with service software R20210201 or later. For more information, see Cluster metrics.

February 17, 2021

Kibana reports

The default installation of Kibana for Amazon Elasticsearch Service now supports on-demand reports for the Discover, Visualize, and Dashboard pages. This feature requires Elasticsearch 7.9 or later and service software R20210201 or later.

February 17, 2021

Kibana 5.6.16 support

Amazon Elasticsearch Service domains running Elasticsearch 5.6 now support the latest patch release for Kibana 5.6, which adds bug fixes and improves security. Amazon ES will automatically upgrade domains to this patch release.

February 17, 2021

Encryption for existing domains

Amazon Elasticsearch Service now supports enabling encryption of data at rest and node-to-node encryption on existing domains running Elasticsearch 6.7 or later. After you enable these settings, you can't disable them.

January 27, 2021

Remote reindex

Amazon Elasticsearch Service now supports remote reindex, which lets you migrate indices from remote domains. This feature requires service software R20201117 or later. To learn more, see Migrating Amazon Elasticsearch Service indices using remote reindex.

November 24, 2020

Piped Processing Language

Amazon Elasticsearch Service now supports Piped Processing Language (PPL), a query language that lets you use pipe (|) syntax to query data stored in Elasticsearch. This feature requires service software R20201117 or later. To learn more, see Querying Amazon Elasticsearch Service data using Piped Processing Language.

November 24, 2020

Kibana notebooks

Amazon Elasticsearch Service adds support for Kibana notebooks, which lets you combine live visualizations and narrative text in a single interface. This feature requires service software R20201117 or later. To learn more, see Kibana notebooks (experimental).

November 24, 2020

Gantt charts

The default installation of Kibana for Amazon Elasticsearch Service now supports a new visualization type, Gantt charts. This feature requires service software R20201117 or later.

November 24, 2020

Elasticsearch 7.9 support

Amazon Elasticsearch Service now supports Elasticsearch version 7.9. To learn more, see Supported Elasticsearch versions and Upgrading Elasticsearch. This release also includes an all-new Kibana user interface for fine-grained access control.

November 24, 2020

Anomaly detection updates

Anomaly detection for Amazon Elasticsearch Service adds support for high cardinality, which lets you categorize anomalies with a dimension like IP address, product ID, country code, and so on. This feature requires service software R20201117 or later. To learn more, see Anomaly detection for Amazon Elasticsearch Service.

November 24, 2020

Dynamic dictionary updates

Amazon Elasticsearch Service now lets you update your search analyzers without reindexing. You can update the dictionary files on some or all of your domains, and Amazon ES tracks package versions over time so that you have a history of what changed and when. This feature requires service software R20201019 or later. To learn more, see Custom packages for Amazon Elasticsearch Service.

November 17, 2020

Custom endpoints

Amazon Elasticsearch Service now supports custom endpoints, which let you give your Amazon ES domain a new URL. If you ever swap domains, you can maintain the same URL. This feature requires service software R20201019 or later. To learn more, see Creating a custom endpoint for Amazon Elasticsearch Service.

November 5, 2020

New language plugins

Amazon Elasticsearch Service now supports IK (Chinese) Analysis, Vietnamese Analysis, and Thai Analysis plugins on domains running Elasticsearch 7.7 or later with service software R20201019 or later.

October 28, 2020

Elasticsearch 7.8 support

Amazon Elasticsearch Service now supports Elasticsearch version 7.8. To learn more, see Supported Elasticsearch versions and Upgrading Elasticsearch.

October 28, 2020

SAML authentication for Kibana

Amazon Elasticsearch Service now supports SAML authentication for Kibana, which lets you use third-party identity providers to log in to Kibana, manage fine-grained access control, search your data, and build visualizations. This feature requires service software R20201019 or later. For more information, see SAML authentication for Kibana.

October 27, 2020

T3 instances

Amazon Elasticsearch Service now supports the t3.small and t3.medium instance types. For best practices around using these instance types, see Best practices for Amazon Elasticsearch Service.

September 23, 2020

Audit logs

Amazon Elasticsearch Service now supports audit logs for your data, which lets you track failed login attempts, user access to indices, documents, and fields, and much more. This feature requires service software R20200910 or later. For more information, see Managing audit logs in Amazon Elasticsearch Service.

September 16, 2020

UltraWarm updates

UltraWarm for Amazon Elasticsearch Service adds new metrics, new settings, a larger migration queue, and a cancellation API. These updates require service software R20200910 or later. For more information, see UltraWarm for Amazon Elasticsearch Service.

September 14, 2020

Learning to Rank

Amazon Elasticsearch Service now supports the open source Learning to Rank plugin, which lets you use machine learning technologies to improve search relevance. This feature requires service software R20200721 or later. For more information, see Learning to Rank for Amazon Elasticsearch Service.

July 27, 2020

k-NN cosine similarity

k-NN now lets you search for "nearest neighbors" by cosine similarity in addition to Euclidean distance. This feature requires service software R20200721 or later. For more information, see k-Nearest Neighbor (k-NN) search in Amazon Elasticsearch Service.

July 23, 2020

gzip compression

Amazon Elasticsearch Service now supports gzip compression for most HTTP requests and responses, which can reduce latency and conserve bandwidth. This feature requires service software R20200721 or later. For more information, see Compressing HTTP requests in Amazon Elasticsearch Service.

July 23, 2020

Elasticsearch 7.7 support

Amazon Elasticsearch Service now supports Elasticsearch version 7.7. To learn more, see Supported Elasticsearch Versions and Upgrading Elasticsearch.

July 23, 2020

Kibana map service

The default installation of Kibana for Amazon Elasticsearch Service now includes a map service, except for domains in the India and China regions. For more information, see Configuring Kibana to use a WMS map server .

June 18, 2020

SQL improvements

SQL support for Amazon Elasticsearch Service now supports many new operations, a dedicated Kibana user interface for data exploration, and an interactive CLI. For more information, see Querying your Amazon Elasticsearch Service data with SQL.

June 3, 2020

Cross-cluster search

Amazon Elasticsearch Service lets you perform queries and aggregations across multiple connected domains. For more information, see Cross-cluster search for Amazon Elasticsearch Service.

June 3, 2020

Anomaly detection

Amazon Elasticsearch Service lets you automatically detect anomalies in near-real time. For more information, see Anomaly detection in Amazon Elasticsearch Service.

June 3, 2020

UltraWarm

UltraWarm storage for Amazon Elasticsearch Service has left public preview and is now generally available. The feature now supports a wider range of Elasticsearch versions and AWS Regions. For more information, see UltraWarm for Amazon Elasticsearch Service.

May 5, 2020

Custom dictionaries

Amazon Elasticsearch Service lets you upload custom dictionary files for use with your cluster. These files improve your search results by telling Elasticsearch to ignore certain high-frequency words or to treat terms as equivalent. For more information, see Custom packages for Amazon Elasticsearch Service.

April 21, 2020

Elasticsearch 7.4 Support

Amazon Elasticsearch Service now supports Elasticsearch version 7.4. To learn more, see Supported Elasticsearch versions and Upgrading Elasticsearch.

March 12, 2020

k-NN

Amazon Elasticsearch Service adds support for k-nearest neighbor (KNN) search. This feature requires service software R20200302 or later. For more information, see k-Nearest Neighbor (k-NN) search in Amazon Elasticsearch Service.

March 3, 2020

Index State Management

Amazon Elasticsearch Service adds Index State Management (ISM), which lets you automate routine tasks, such as deleting indices when they reach a certain age. This feature requires service software R20200302 or later. For more information, see Index State Management in Amazon Elasticsearch Service.

March 3, 2020

Elasticsearch 5.6.16 support

Amazon Elasticsearch Service now supports the latest patch release for version 5.6, which adds bug fixes and improves security. Amazon ES will automatically upgrade existing 5.6 domains to this release. Note that this Elasticsearch release incorrectly reports its version as 5.6.17.

March 2, 2020

Fine-grained access control

Amazon Elasticsearch Service now supports fine-grained access control, which offers security at the index, document, and field level, Kibana multi-tenancy, and optional HTTP basic authentication for your cluster.

February 11, 2020

UltraWarm storage (preview)

Amazon Elasticsearch Service adds UltraWarm, a new warm storage tier that uses Amazon S3 and a sophisticated caching solution to improve performance. For indices that you are not actively writing to and query less frequently, UltraWarm storage offers significantly lower costs per GiB. For more information, see UltraWarm for Amazon Elasticsearch Service.

December 3, 2019

Encryption features for China Regions

Encryption of data at rest and node-to-node encryption are now available in the cn-north-1 (Beijing) and cn-northwest-1 (Ningxia) Regions.

November 20, 2019

Require HTTPS

You can now require that all traffic to your Amazon ES domains arrive over HTTPS. When configuring your domain, check the Require HTTPS box. This feature requires service software R20190808 or later.

October 3, 2019

Elasticsearch 7.1 and 6.8 support

Amazon Elasticsearch Service now supports Elasticsearch version 7.1 and 6.8. To learn more, see Supported Elasticsearch versions and Upgrading Elasticsearch.

August 13, 2019

Hourly snapshots

Rather than daily snapshots, Amazon Elasticsearch Service now takes hourly snapshots of domains running Elasticsearch 5.3 and later so that you have more frequent backups from which to restore your data. To learn more, see Creating index snapshots in Amazon Elasticsearch Service.

July 8, 2019

Elasticsearch 6.7 support

Amazon Elasticsearch Service now supports Elasticsearch version 6.7. To learn more, see Supported Elasticsearch versions.

May 29, 2019

SQL support

Amazon Elasticsearch Service now lets you query your data using SQL. For more information, see Querying your Amazon Elasticsearch Service data with SQL. This feature requires service software R20190418 or later.

May 15, 2019

5-series instance types

Amazon Elasticsearch Service now supports M5, C5, and R5 instance types. Compared to previous-generation instance types, these new types offer better performance at lower prices. For more information, see Supported Instance Types and Limits.

April 24, 2019

Elasticsearch 6.5 support

Amazon Elasticsearch Service now supports Elasticsearch version 6.5. To learn more, see Supported Elasticsearch versions.

April 8, 2019

Alerting

The alerting feature notifies you when data from one or more Elasticsearch indices meets certain conditions. To learn more, see Configuring alerts in Amazon Elasticsearch Service. This feature requires service software R20190221 or later.

March 25, 2019

Three Availability Zone support

Amazon Elasticsearch Service now supports three Availability Zones in many regions. This release also includes a streamlined console experience. To learn more, see Configuring a multi-AZ domain in Amazon Elasticsearch Service. This feature requires service software R20181023 or later.

February 7, 2019

Elasticsearch 6.4 support

Amazon Elasticsearch Service now supports Elasticsearch version 6.4. To learn more, see Supported Elasticsearch versions.

January 23, 2019

200-node clusters

Amazon ES now lets you create clusters with up to 200 data nodes for a total of 3 PB of storage. To learn more, see Petabyte scale for Amazon Elasticsearch Service.

January 22, 2019

Service software updates

Amazon ES now lets you manually update the service software for your domain in order to benefit from new features more quickly or update at a low traffic time. To learn more, see Service software updates in Amazon Elasticsearch Service.

November 20, 2018

New CloudWatch metrics

Amazon ES now offers node-level metrics and new Cluster health and Instance health tabs in the Amazon ES console. To learn more, see Monitoring Amazon Elasticsearch Service cluster metrics with Amazon CloudWatch.

November 20, 2018

China (Beijing) support

Amazon Elasticsearch Service is now available in the cn-north-1 region, where it supports the M4, C4, and R4 instance types.

October 17, 2018

Node-to-node encryption

Amazon Elasticsearch Service now supports node-to-node encryption, which keeps your data encrypted as Elasticsearch distributes it throughout your cluster. To learn more, see Node-to-node encryption for Amazon Elasticsearch Service.

September 18, 2018

In-place version upgrades

Amazon Elasticsearch Service now supports in-place version upgrades for Elasticsearch. To learn more, see Upgrading Elasticsearch.

August 14, 2018

Elasticsearch 6.3 and 5.6 support

Amazon Elasticsearch Service now supports Elasticsearch version 6.3 and 5.6. To learn more, see Supported Elasticsearch versions.

August 14, 2018

Error logs

Amazon ES now lets you publish Elasticsearch error logs to Amazon CloudWatch. To learn more, see Configuring logs in Amazon Elasticsearch Service.

July 31, 2018

China (Ningxia) Reserved Instances

Amazon ES now offers Reserved Instances in the China (Ningxia) region.

May 29, 2018

Reserved Instances

Amazon ES now offers Reserved Instances. To learn more, see Reserved Instances in Amazon Elasticsearch Service.

May 7, 2018

Earlier updates

The following table describes important changes Amazon ES before May 2018.

Change Description Date
Amazon Cognito Authentication for Kibana Amazon ES now offers login page protection for Kibana. To learn more, see Configuring Amazon Cognito authentication for Kibana. April 2, 2018
Elasticsearch 6.2 Support

Amazon Elasticsearch Service now supports Elasticsearch version 6.2.

March 14, 2018
Korean Analysis Plugin Amazon ES now supports a memory-optimized version of the Seunjeon Korean analysis plugin. March 13, 2018
Instant Access Control Updates Changes to the access control policies on Amazon ES domains now take effect instantly. March 7, 2018
Petabyte Scale Amazon ES now supports I3 instance types and total domain storage of up to 1.5 PB. To learn more, see Petabyte scale for Amazon Elasticsearch Service. 19 December 2017
Encryption of Data at Rest Amazon ES now supports encryption of data at rest. To learn more, see Encryption of data at rest for Amazon Elasticsearch Service. December 7, 2017
Elasticsearch 6.0 Support

Amazon ES now supports Elasticsearch version 6.0. For migration considerations and instructions, see Upgrading Elasticsearch.

December 6, 2017
VPC Support

Amazon ES now lets you launch domains within an Amazon Virtual Private Cloud. VPC support provides an additional layer of security and simplifies communications between Amazon ES and other services within a VPC. To learn more, see Launching your Amazon Elasticsearch Service domains using a VPC.

October 17, 2017
Slow Logs Publishing

Amazon ES now supports the publishing of slow logs to CloudWatch Logs. To learn more, see Monitoring Elasticsearch logs with Amazon CloudWatch Logs.

October 16, 2017
Elasticsearch 5.5 Support

Amazon ES now supports Elasticsearch version 5.5. For new feature summaries, see the Amazon announcement of availability.

You can now restore automated snapshots without contacting AWS Support and store scripts using the Elasticsearch _scripts API.

September 7, 2017
Elasticsearch 5.3 Support Amazon ES added support for Elasticsearch version 5.3. June 1, 2017
More Instances and EBS Capacity per Cluster Amazon ES now supports up to 100 nodes and 150 TB EBS capacity per cluster. April 5, 2017
Canada (Central) and EU (London) Support Amazon ES added support for the following regions: Canada (Central), ca-central-1, and EU (London), eu-west-2. March 20, 2017
More Instances and Larger EBS Volumes Amazon ES added support for more instances and larger EBS volumes. February 21, 2017
Elasticsearch 5.1 Support Amazon ES added support for Elasticsearch version 5.1. January 30, 2017
Support for the Phonetic Analysis Plugin Amazon ES now provides built-in integration with the Phonetic Analysis plugin, which allows you to run “sounds-like” queries on your data. December 22, 2016
US East (Ohio) Support Amazon ES added support for the following region: US East (Ohio), us-east-2. October 17, 2016
New Performance Metric Amazon ES added a performance metric, ClusterUsedSpace. July 29, 2016
Elasticsearch 2.3 Support Amazon ES added support for Elasticsearch version 2.3. July 27, 2016
Asia Pacific (Mumbai) Support Amazon ES added support for the following region: Asia Pacific (Mumbai), ap-south-1. June 27, 2016
More Instances per Cluster Amazon ES increased the maximum number of instances (instance count) per cluster from 10 to 20. May 18, 2016
Asia Pacific (Seoul) Support Amazon ES added support for the following region: Asia Pacific (Seoul), ap-northeast-2. January 28, 2016
Amazon ES Initial release. October 1, 2015