navigation_title: "Elasticsearch" mapped_pages:

Elasticsearch release notes [elasticsearch-release-notes]

Review the changes, fixes, and more in each version of Elasticsearch.

To check for security updates, go to Security announcements for the Elastic stack.

% Release notes include only features, enhancements, and fixes. Add breaking changes, deprecations, and known issues to the applicable release notes sections.

% ## version.next [elasticsearch-next-release-notes]

% ### Features and enhancements [elasticsearch-next-features-enhancements] % *

% ### Fixes [elasticsearch-next-fixes] % *

9.0.0 [elasticsearch-900-release-notes]

Highlights [elasticsearch-900-highlights]

::::{dropdown} rank_vectors field type is now available for late-interaction ranking

rank_vectors is a new field type released as an experimental feature in Elasticsearch 9.0. It is designed to be used with dense vectors and allows for late-interaction second order ranking.

Late-interaction models are powerful rerankers. While their size and overall cost doesn’t lend itself for HNSW indexing, utilizing them as second order reranking can provide excellent boosts in relevance. The new rank_vectors mapping allows for rescoring over new and novel multi-vector late-interaction models like ColBERT or ColPali. ::::

::::{dropdown} ES|QL LOOKUP JOIN is now available in technical preview

LOOKUP JOIN is now available in technical preview. LOOKUP JOIN combines data from your ES|QL queries with matching records from a lookup index, enabling you to:

Enrich your search results with reference data
Speed up root-cause analysis and security investigations
Join data across indices without complex queries
Reduce operational overhead when correlating events ::::

::::{dropdown} The semantic_text field type is now GA semantic_text is now an official GA (generally available) feature! This field type allows you to easily set up and perform semantic search with minimal ramp up time. ::::

Features and enhancements [elasticsearch-900-features-enhancements]

Allocation:

Add FailedShardEntry info to shard-failed task source string #125520 (issue: #125520)
Add a not-master state for desired balance #116904
Add cache support in TransportGetAllocationStatsAction #124898 (issue: #124898)
Introduce AllocationBalancingRoundSummaryService #120957
Only publish desired balance gauges on master #115383
Reset relocation/allocation failure counter on node join/shutdown #119968

Authentication:

Allow SSHA-256 for API key credential hash #120997

Authorization:

Allow kibana_system user to manage .reindexed-v8-internal.alerts indices #118959
Do not fetch reserved roles from native store when Get Role API is called #121971
Grant necessary Kibana application privileges to reporting_user role #118058
Make reserved built-in roles queryable #117581
[Security Solution] Add create_index to kibana_system role for index/DS .logs-endpoint.action.responses-* #115241
[Security Solution] allows kibana_system user to manage .reindexed-v8-* Security Solution indices #119054

CCS:

Resolve/cluster allows querying for cluster info only (no index expression required) #119898

CRUD:

Enhance memory accounting for document expansion and introduce max document size limit #123543
Metrics for indexing failures due to version conflicts #119067
Remove INDEX_REFRESH_BLOCK after index becomes searchable #120807
Suppress merge-on-recovery for older indices #113462

Cluster Coordination:

Include clusterApplyListener in long cluster apply warnings #120087

Data streams:

Add action to create index from a source index #118890
Add index and reindex request settings to speed up reindex #119780
Add index mode to get data stream API #122486
Add rest endpoint for create_from_source_index #119250
Add sanity check to ReindexDatastreamIndexAction #120231
Adding a migration reindex cancel API #118291
Adding get migration reindex status #118267
Consistent mapping for OTel log and event bodies #120547
Filter deprecated settings when making dest index #120163
Ignore closed indices for reindex #120244
Improve how reindex data stream index action handles api blocks #120084
Initial work on ReindexDatastreamIndexAction #116996
Make requests_per_second configurable to throttle reindexing #120207
Optimized index sorting for OTel logs #119504
Reindex data stream indices on different nodes #125171
Report Deprecated Indices That Are Flagged To Ignore Migration Reindex As A Warning #120629
Retry ILM async action after reindexing data stream #124149
Run TransportGetDataStreamLifecycleAction on local node #125214
Run TransportGetDataStreamOptionsAction on local node #125213
Run TransportGetDataStreamsAction on local node #122852
Set cause on create index request in create from action #124363
Update data stream deprecations warnings to new format and filter searchable snapshots from response #118562

Distributed:

Make various alias retrieval APIs wait for cluster to unblock #117230
Metrics for incremental bulk splits #116765
Use Azure blob batch API to delete blobs in batches #114566

Downsampling:

Improve downsample performance by buffering docids and do bulk processing #124477
Improve rolling up metrics #124739

EQL:

Add support for partial shard results #116388
Optional named arguments for function in map #118619

ES|QL:

Add ES|QL cross-cluster query telemetry collection #119474
Add a LicenseAware interface for licensed Nodes #118931 (issue: #118931)
Add a PostAnalysisAware, distribute verification #119798
Add a standard deviation aggregating function: STD_DEV #116531
Add cluster level reduction #117731
Add initial grammar and changes for FORK #121948
Add initial grammar and planning for RRF (snapshot) #123396
Add nulls support to Categorize #117655
Allow partial results in ES|QL #121942
Allow skip shards with _tier and _index in ES|QL #123728
Async search responses have CCS metadata while searches are running #117265
Avoid NamedWritable in block serialization #124394
Calculate concurrent node limit #124901
Check for early termination in Driver #118188
Do not serialize EsIndex in plan #119580
Double parameter markers for identifiers #122459
ESQL - Add Match function options #120360
ESQL - Allow full text functions disjunctions for non-full text functions #120291
ESQL - Remove restrictions for disjunctions in full text functions #118544
ESQL - enabling scoring with METADATA _score #113120
ESQL Add esql hash function #117989
ESQL Support IN operator for Date nanos #119772 (issue: #119772)
ESQL: Align RENAME behavior with EVAL for sequential processing #122250 (issue: #122250)
ESQL: CATEGORIZE as a BlockHash #114317
ESQL: Enable async get to support formatting #111104 (issue: #111104)
ESQL: Enterprise license enforcement for CCS #118102
ES|QL - Add scoring for full text functions disjunctions #121793
ES|QL slow log #124094
ES|QL: Partial result on demand for async queries #118122
ES|QL: Support ::date in inline cast #123460 (issue: #123460)
Enable KQL function as a tech preview #119730
Enable LOOKUP JOIN in non-snapshot builds #121193 (issue: #121193)
Enable node-level reduction by default #119621
Enable physical plan verification #118114
Ensure cluster string could be quoted #120355
Esql - Support date nanos in date extract function #120727 (issue: #120727)
Esql - support date nanos in date format function #120143 (issue: #120143)
Esql Support date nanos on date diff function #120645 (issue: #120645)
Esql bucket function for date nanos #118474 (issue: #118474)
Esql compare nanos and millis #118027 (issue: #118027)
Esql implicit casting for date nanos #118697 (issue: #118697)
Expand type compatibility for match function and operator #117555
Extend TranslationAware to all pushable expressions #120192
Fix Driver status iterations and cpuTime #123290 (issue: #123290)
Fix sorting when aggregate_metric_double present #125191
Hash functions #118938
Implement a MetricsAware interface #121074
Implement runtime skip_unavailable=true #121240
Include failures in partial response #124929
Infer the score mode to use from the Lucene collector #125930
Initial support for unmapped fields #119886
Introduce allow_partial_results setting in ES|QL #122890
Introduce a pre-mapping logical plan processing step #121260
Keep ordinals in conversion functions #125357
LOOKUP JOIN using field-caps for field mapping #117246
Lookup join on multiple join fields not yet supported #118858
Move scoring in ES|QL out of snapshot #120354
Optimize ST_EXTENT_AGG for geo_shape and cartesian_shape #119889
Pragma to load from stored fields #122891
Push down StartsWith and EndsWith functions to Lucene #123381 (issue: #123381)
Push down filter passed lookup join #118410
Remove page alignment in exchange sink #124610
Render aggregate_metric_double #122660
Report original_types #124913
Report failures on partial results #124823
Resume Driver on cancelled or early finished #120020
Retry ES|QL node requests on shard level failures #120774
Reuse child outputSet inside the plan where possible #124611
Rewrite TO_UPPER/TO_LOWER comparisons #118870 (issue: #118870)
ST_EXTENT aggregation #117451 (issue: #117451)
ST_EXTENT_AGG optimize envelope extraction from doc-values for cartesian_shape #118802
Smarter field caps with subscribable listener #116755
Support ST_ENVELOPE and related (ST_XMIN, ST_XMAX, ST_YMIN, ST_YMAX) functions #116964 (issue: #116964)
Support partial results in CCS in ES|QL #122708
Support partial sort fields in TopN pushdown #116043 (issue: #116043)
Support some stats on aggregate_metric_double #120343 (issue: #120343)
Support subset of metrics in aggregate metric double #121805
Take double parameter markers for identifiers out of snapshot #125690
Take named parameters for identifier and pattern out of snapshot #121850
Term query for ES|QL #117359
Update grammar to rely on indexPattern instead of identifier in join target #120494
ToAggregateMetricDouble function #124595
_score should not be a reserved attribute in ES|QL #118435 (issue: #118435)

Engine:

Defer unpromotable shard refreshes until index refresh blocks are cleared #120642
POC mark read-only #119743
Threadpool merge scheduler #120869

Experiences:

Integrate IBM watsonx to Inference API for re-ranking task #117176

Extract&Transform:

[Connector API] Support hard deletes with new URL param in delete endpoint #120200
[Connector API] Support soft-deletes of connectors #118669
[Connector APIs] Enforce index prefix for managed connectors #117778

Geo:

Optimize indexing points with index and doc values set to true #120271

Health:

Add health indicator impact to HealthPeriodicLogger #122390
Increase replica_unassigned_buffer_time default from 3s to 5s #112834

Highlighting:

Add Highlighter for Semantic Text Fields #118064

ILM+SLM:

Add a replicate_for option to the ILM searchable_snapshot action #119003
Improve SLM Health Indicator to cover missing snapshot #121370
Optimize usage calculation in ILM policies retrieval API #106953 (issue: #106953)
Process ILM cluster state updates on another thread #123712
Run TransportExplainLifecycleAction on local node #122885
Truncate step_info and error reason in ILM execution state and history #125054 (issue: #125054)

Indices APIs:

Add remove_index_block arg to _create_from api #120548
Avoid creating known_fields for every check in Alias #124690
Remove index blocks by default in create_from #120643
Run TransportGetComponentTemplateAction on local node #116868
Run TransportGetComposableIndexTemplate on local node #119830
Run TransportGetIndexTemplateAction on local node #119837
Run TransportGetMappingsAction on local node #122921
introduce new categories for deprecated resources in deprecation API #120505

Inference:

Add version prefix to Inference Service API path #117095
Remove Elastic Inference Service feature flag and deprecated setting #120842
Update sparse text embeddings API route for Inference Service #118025
[Elastic Inference Service] Add ElasticInferenceService Unified ChatCompletions Integration #118871
[Inference API] Rename model_id prop to model in EIS sparse inference request body #122272

Infra/CLI:

Ignore _JAVA_OPTIONS #124843
Strengthen encryption for elasticsearch-keystore tool to AES 256 #119749

Infra/Circuit Breakers:

Add link to Circuit Breaker "Data too large" exception message #113561

Infra/Core:

Add support for specifying reindexing script for system index migration #119001
Bump major version for feature migration system indices #117243
Change default Docker image to be based on UBI minimal instead of Ubuntu #116739
Give Kibana user 'all' permissions for .entity_analytics.* indices #123588
Improve size limiting string message #122427
Infrastructure for assuming cluster features in the next major version #118143
Permanently switch from Java SecurityManager to Entitlements. The Java SecurityManager has been deprecated since Java 17, and it is now completely disabled in Java 24. In order to retain an similar level of protection, Elasticsearch implemented its own protection mechanism, Entitlements. Starting with this version, Entitlements will permanently replace the Java SecurityManager. #124865
Permanently switch from Java SecurityManager to Entitlements. The Java SecurityManager has been deprecated since Java 17, and it is now completely disabled in Java 24. In order to retain an similar level of protection, Elasticsearch implemented its own protection mechanism, Entitlements. Starting with this version, Entitlements will permanently replace the Java SecurityManager. #125117
Update ASM 9.7 -> 9.7.1 to support JDK 24 #118094

Infra/Metrics:

Add ensureGreen test method for use with adminClient #113425

Infra/REST API:

A new query parameter ?include_source_on_error was added for create / index, update and bulk REST APIs to control if to include the document source in the error response in case of parsing errors. The default value is true. #120725
Indicate when errors represent timeouts #124936

Infra/Scripting:

Add a mustache.max_output_size_bytes setting to limit the length of results from mustache scripts #114002

Infra/Settings:

Allow passing several reserved state chunks in single process call #124574
Introduce IndexSettingDeprecatedInV8AndRemovedInV9 Setting property #120334
Run TransportClusterGetSettingsAction on local node #119831

Ingest Node:

Allow setting the type in the reroute processor #122409 (issue: #122409)
Optimize IngestCtxMap construction #120833
Optimize IngestDocMetadata isAvailable #120753
Optimize IngestDocument FieldPath allocation #120573
Optimize some per-document hot paths in the geoip processor #120824
Returning ignored fields in the simulate ingest API #117214
Run GetPipelineTransportAction on local node #120445
Run TransportEnrichStatsAction on local node #121256
Run TransportGetEnrichPolicyAction on local node #121124
Run template simulation actions on local node #120038

License:

Bump TrialLicenseVersion to allow starting new trial on 9.0 #120198

Logs:

Add LogsDB option to route on sort fields #116687
Add a new index setting to skip recovery source when synthetic source is enabled #114618
Configure index sorting through index settings for logsdb #118968 (issue: #118968)
Optimize loading mappings when determining synthetic source usage and whether host.name can be sorted on. #120055

Machine Learning:

Add DeBERTa-V2/V3 tokenizer #111852
Add Inference Unified API for chat completions for OpenAI #117589
Add Jina AI API to do inference for Embedding and Rerank models #118652
Add ModelRegistryMetadata to Cluster State #121106
Add enterprise license check for Inference API actions #119893
Adding chunking settings to IbmWatsonxService #114914
Adding common rerank options to Perform Inference API #125239 (issue: #125239)
Adding default endpoint for Elastic Rerank #117939
Adding elser default endpoint for EIS #122066
Adding endpoint creation validation for all task types to remaining services #115020
Adding endpoint creation validation to ElasticInferenceService #117642
Adding integration for VoyageAI embeddings and rerank models #122134
Adding support for binary embedding type to Cohere service embedding type #120751
Adding support for specifying embedding type to Jina AI service settings #121548
Automatically rollover legacy .ml-anomalies indices #120913
Automatically rollover legacy ml indices #120405
Change the auditor to write via an alias #120064
Check for presence of error object when validating streaming responses from integrations in the inference API #118375
Check if the anomaly results index has been rolled over #125404
ES|QL change_point processing command #120998
ES|QL categorize with multiple groupings #118173
Expose input_type option at root level for text_embedding task type in Perform Inference API #122638 (issue: #122638)
Ignore failures from renormalizing buckets in read-only index #118674
Inference duration and error metrics #115876
Integrate with DeepSeek API #122218
Limit the number of chunks for semantic text to prevent high memory usage #123150
Migrate stream to core error parsing #120722
Remove all mentions of eis and gateway and deprecate flags that do #116692
Remove deprecated sort from reindex operation within dataframe analytics procedure #117606
Retry on ClusterBlockException on transform destination index #118194
Support mTLS for the Elastic Inference Service integration inside the inference API #119679
Upgrade AWS v2 SDK to 2.30.38 #124738
[Inference API] Add node-local rate limiting for the inference API #120400
[Inference API] Propagate product use case http header to EIS #124025
[Inference API] fix spell words: covertToString to convertToString #119922

Mapping:

Add Optional Source Filtering to Source Loaders #113827
Add option to store sparse_vector outside _source #117917
Enable synthetic recovery source by default when synthetic source is enabled. Using synthetic recovery source significantly improves indexing performance compared to regular recovery source. #122615 (issue: #122615)
Enable the use of nested field type with index.mode=time_series #122224 (issue: #122224)
Improved error message when index field type is invalid #122860
Introduce FallbackSyntheticSourceBlockLoader and apply it to keyword fields #119546
Release semantic_text as a GA feature #124669
Store arrays offsets for boolean fields natively with synthetic source #125529
Store arrays offsets for ip fields natively with synthetic source #122999
Store arrays offsets for keyword fields natively with synthetic source instead of falling back to ignored source. #113757
Store arrays offsets for numeric fields natively with synthetic source #124594
Store arrays offsets for unsigned long fields natively with synthetic source #125709
Use FallbackSyntheticSourceBlockLoader for shape and geo_shape #124927
Use FallbackSyntheticSourceBlockLoader for unsigned_long and scaled_float fields #122637
Use FallbackSyntheticSourceBlockLoader for boolean and date fields #124050
Use FallbackSyntheticSourceBlockLoader for number fields #122280

Network:

Allow http unsafe buffers by default #116115
Http stream activity tracker and exceptions handling #119564
Remove HTTP content copies #117303
ConnectTransportException returns retryable BAD_GATEWAY #118681 (issue: #118681)

Packaging:

Update bundled JDK to Java 24 #125159

Ranking:

Add a generic rescorer retriever based on the search request's rescore functionality #118585 (issue: #118585)
Leverage scorer supplier in QueryFeatureExtractor #125259
Set default reranker for text similarity reranker to Elastic reranker #120551

Recovery:

Allow archive and searchable snapshots indices in N-2 version #118941
Trigger merges after recovery #113102

Reindex:

Change Reindexing metrics unit from millis to seconds #115721

Relevance:

Add Multi-Field Support for Semantic Text Fields #120128
Skip semantic_text embedding generation when no content is provided. #123763

Search:

Account for the SearchHit source in circuit breaker #121920 (issue: #121920)
Add match support for semantic_text fields #117839
Add support for sparse_vector queries against semantic_text fields #118617
Add support for knn vector queries on semantic_text fields #119011
Added optional parameters to QSTR ES|QL function #121787 (issue: #121787)
Adding linear retriever to support weighted sums of sub-retrievers #120222
Address and remove any references of RestApiVersion version 7 #117572
Feat: add a user-configurable timeout parameter to the _resolve/cluster API #120542
Introduce batched query execution and data-node side reduce #121885
Make semantic text part of the text family #119792
Only aggregations require at least one shard request #115314
Optimize memory usage in ShardBulkInferenceActionFilter #124313
Optionally allow text similarity reranking to fail #121784
Prevent data nodes from sending stack traces to coordinator when error_trace=false #118266
Propagate status codes from shard failures appropriately #118016 (issue: #118016)
Upgrade to Lucene 10 #114741
Upgrade to Lucene 10.1.0 #119308

Security:

Add refresh .security index call between security migrations #114879

Snapshot/Restore:

Add IMDSv2 support to repository-s3 #117748 (issue: #117748)
Expose operation and request counts separately in repository stats #117530 (issue: #117530)
GCS blob store: add OperationPurpose/Operation stats counters #122991
Retry S3BlobContainer#getRegister on all exceptions #114813
Retry internally when CAS upload is throttled [GCS] #120250 (issue: #120250)
Retry when the server can't be resolved (Google Cloud Storage) #123852
Track shard snapshot progress during node shutdown #112567
Upgrade AWS SDK to v1.12.746 #122431

Stats:

Run XPack usage actions on local node #122933

Store:

Abort pending deletion on IndicesService close #123569

Suggesters:

Extensible Completion Postings Formats #111494

TSDB:

Increase field limit for OTel metrics to 10 000 #120591

Transform:

Add support for extended_stats #120340
Auto-migrate max_page_search_size #119348
Create upgrade mode #117858
Wait while index is blocked #119542
[Deprecation] Add transform_ids to outdated index #120821

Vector Search:

Add bit vector support to semantic text #123187
Add new experimental rank_vectors mapping for late-interaction second order ranking #118804
Add panama implementations of byte-bit and float-bit script operations #124722 (issue: #124722)
Adds implementations of dotProduct and cosineSimilarity painless methods to operate on float vectors for byte fields #122381 (issue: #122381)
Allow zero for rescore_vector.oversample to indicate by-passing oversample and rescoring #125599
Even better(er) binary quantization #117994
KNN vector rescoring for quantized vectors #116663
Mark bbq indices as GA and add rolling upgrade integration tests #121105
New vector_rescore parameter as a quantized index type option #124581
Speed up bit compared with floats or bytes script operations #117199

Watcher:

Run TransportGetWatcherSettingsAction on local node #122857

Fixes [elasticsearch-900-fixes]

Aggregations:

Aggs: Let terms run in global ords mode no match #124782
Handle with illegalArgumentExceptions negative values in HDR percentile aggregations #116174 (issue: #116174)