Browse Source

Add release notes for v9.0.3 release (#129803)

* Update docs for v9.0.3 release

* Add merge scheduler issue to known issues pages

* Add patch release information

---------

Co-authored-by: Charlotte Hoblik <116336412+charlotte-hoblik@users.noreply.github.com>
Co-authored-by: Charlotte Hoblik <sarolta@saroltah.hu>
elasticsearchmachine 3 months ago
parent
commit
9cc034ba44

+ 7 - 3
docs/release-notes/breaking-changes.md

@@ -12,6 +12,13 @@ If you are migrating from a version prior to version 9.0, you must first upgrade
 
 % ## Next version [elasticsearch-nextversion-breaking-changes]
 
+```{applies_to}
+stack: coming 9.0.3
+```
+## 9.0.3 [elasticsearch-9.0.3-breaking-changes]
+
+No breaking changes in this version.
+
 ```{applies_to}
 stack: coming 9.0.2
 ```
@@ -49,9 +56,6 @@ will prevent node from starting [#118366](https://github.com/elastic/elasticsear
 Cluster Coordination:
 * Remove unsupported legacy value for `discovery.type` [#112903](https://github.com/elastic/elasticsearch/pull/112903)
 
-ES|QL
-* Limit the scope of the skip_unavailable setting for remote clusters [#120236](https://github.com/elastic/elasticsearch/pull/120236)
-
 EQL:
 * Set allow_partial_search_results=true by default [#120267](https://github.com/elastic/elasticsearch/pull/120267)
 

+ 162 - 0
docs/release-notes/changelog-bundles/9.0.3.yml

@@ -0,0 +1,162 @@
+version: 9.0.3
+released: false
+generated: 2025-06-21T00:06:16.346021604Z
+changelogs:
+  - pr: 120869
+    summary: Threadpool merge scheduler
+    area: Engine
+    type: feature
+    issues: []
+  - pr: 125408
+    summary: Prevent ML data retention logic from failing when deleting documents in read-only indices
+    area: Machine Learning
+    type: bug
+    issues: []
+  - pr: 127532
+    summary: Fix case insensitive comparisons to ""
+    area: ES|QL
+    type: bug
+    issues:
+      - 127431
+  - pr: 127613
+    summary: Threadpool merge executor is aware of available disk space
+    area: Engine
+    type: feature
+    issues: []
+  - pr: 127621
+    summary: Fix error message when changing the password for a user in the file realm
+    area: Security
+    type: bug
+    issues: []
+  - pr: 127651
+    summary: Add complete attribute to .fleet-agents docs
+    area: Infra/Plugins
+    type: bug
+    issues: []
+  - pr: 127962
+    summary: Support DATE_NANOS in LOOKUP JOIN
+    area: ES|QL
+    type: bug
+    issues:
+      - 127249
+  - pr: 128036
+    summary: Fix inner hits + aggregations concurrency bug
+    area: Search
+    type: bug
+    issues:
+      - 122419
+  - pr: 128362
+    summary: Avoid unnecessary determinization in index pattern conflict checks
+    area: Indices APIs
+    type: bug
+    issues: []
+  - pr: 128472
+    summary: "Aggs: Fix significant terms not finding background docuemnts for nested fields"
+    area: Aggregations
+    type: bug
+    issues:
+      - 101163
+  - pr: 128532
+    summary: Prevent invalid privileges in manage roles privilege
+    area: Authorization
+    type: bug
+    issues:
+      - 127496
+  - pr: 128610
+    summary: "Handle the indices pattern `[\"*\", \"-*\"]` when grouping indices by cluster name"
+    area: CCS
+    type: bug
+    issues: []
+  - pr: 128650
+    summary: Update shardGenerations for all indices on snapshot finalization
+    area: Snapshot/Restore
+    type: enhancement
+    issues:
+      - 108907
+  - pr: 128689
+    summary: Fix minmax normalizer handling of single-doc result sets
+    area: Search
+    type: bug
+    issues: []
+  - pr: 128702
+    summary: Fix missing highlighting in `match_all` queries for `semantic_text` fields
+    area: Search
+    type: bug
+    issues: []
+  - pr: 128740
+    summary: Optimize sparse vector stats collection
+    area: Stats
+    type: enhancement
+    issues: []
+  - pr: 128742
+    summary: Account for Java direct memory on machine learning nodes to prevent out-of-memory crashes.
+    area: Machine Learning
+    type: bug
+    issues: []
+  - pr: 128890
+    summary: Improve cache invalidation in IdP SP cache
+    area: IdentityProvider
+    type: bug
+    issues: []
+  - pr: 128910
+    summary: Fix `FieldAttribute` name usage in `InferNonNullAggConstraint`
+    area: ES|QL
+    type: bug
+    issues: []
+  - pr: 128960
+    summary: Throw ISE instead of IAE for illegal block in page
+    area: ES|QL
+    type: bug
+    issues: []
+  - pr: 128989
+    summary: Fix NPE in semantic highlighter
+    area: Search
+    type: bug
+    issues:
+      - 128975
+  - pr: 129005
+    summary: Update AbstractXContentParser to support parsers that don't provide text characters
+    area: Infra/Core
+    type: bug
+    issues: []
+  - pr: 129158
+    summary: Fix unsupported privileges error message during role and API key creation
+    area: Authorization
+    type: enhancement
+    issues:
+      - 128132
+  - pr: 129176
+    summary: Adjust unpromotable shard refresh request validation to allow `RefreshResult.NO_REFRESH`
+    area: Searchable Snapshots
+    type: bug
+    issues:
+      - 129036
+  - pr: 129391
+    summary: Ensure that anomaly detection job state update retries if master node is temoporarily unavailable
+    area: Machine Learning
+    type: bug
+    issues:
+      - 126148
+  - pr: 129418
+    summary: Update traces duration mappings with appropriate unit type
+    area: Ingest Node
+    type: enhancement
+    issues: []
+  - pr: 129464
+    summary: Deprecate `indices.merge.scheduler.use_thread_pool` setting
+    area: Engine
+    type: deprecation
+    issues: []
+    deprecation:
+      area: Ingest
+      title: Deprecate `indices.merge.scheduler.use_thread_pool` setting
+      details: This deprecates the `indices.merge.scheduler.use_thread_pool` node setting that was introduced in
+      impact: There should be no impact to users since the setting was not released before its deprecation here (and is not documented).
+      notable: false
+      essSettingChange: false
+  - pr: 129580
+    summary: Check prefixes when constructing synthetic source for flattened fields
+    area: Mapping
+    type: bug
+    issues:
+      - 129508

+ 10 - 0
docs/release-notes/deprecations.md

@@ -16,6 +16,16 @@ To give you insight into what deprecated features you’re using, {{es}}:
 
 % ## Next version [elasticsearch-nextversion-deprecations]
 
+```{applies_to}
+stack: coming 9.0.3
+```
+## 9.0.3 [elasticsearch-9.0.3-deprecations]
+
+Engine:
+* Deprecate `indices.merge.scheduler.use_thread_pool` setting [#129464](https://github.com/elastic/elasticsearch/pull/129464)
+
+
+
 ```{applies_to}
 stack: coming 9.0.2
 ```

+ 73 - 2
docs/release-notes/index.md

@@ -20,6 +20,79 @@ To check for security updates, go to [Security announcements for the Elastic sta
 % ### Fixes [elasticsearch-next-fixes]
 % *
 
+## 9.0.3 [elasticsearch-9.0.3-release-notes]
+```{applies_to}
+stack: coming 9.0.3
+```
+
+### Features and enhancements [elasticsearch-9.0.3-features-enhancements]
+
+Authorization:
+* Fix unsupported privileges error message during role and API key creation [#129158](https://github.com/elastic/elasticsearch/pull/129158) (issue: [#128132](https://github.com/elastic/elasticsearch/issues/128132))
+
+Engine:
+* Threadpool merge executor is aware of available disk space [#127613](https://github.com/elastic/elasticsearch/pull/127613)
+* Threadpool merge scheduler [#120869](https://github.com/elastic/elasticsearch/pull/120869)
+
+Ingest Node:
+* Update traces duration mappings with appropriate unit type [#129418](https://github.com/elastic/elasticsearch/pull/129418)
+
+Snapshot/Restore:
+* Update shardGenerations for all indices on snapshot finalization [#128650](https://github.com/elastic/elasticsearch/pull/128650) (issue: [#108907](https://github.com/elastic/elasticsearch/issues/108907))
+
+Stats:
+* Optimize sparse vector stats collection [#128740](https://github.com/elastic/elasticsearch/pull/128740)
+
+### Fixes [elasticsearch-9.0.3-fixes]
+
+Aggregations:
+* Aggs: Fix significant terms not finding background docuemnts for nested fields [#128472](https://github.com/elastic/elasticsearch/pull/128472) (issue: [#101163](https://github.com/elastic/elasticsearch/issues/101163))
+
+Authorization:
+* Prevent invalid privileges in manage roles privilege [#128532](https://github.com/elastic/elasticsearch/pull/128532) (issue: [#127496](https://github.com/elastic/elasticsearch/issues/127496))
+
+CCS:
+* Handle the indices pattern `["*", "-*"]` when grouping indices by cluster name [#128610](https://github.com/elastic/elasticsearch/pull/128610)
+
+ES|QL:
+* Fix `FieldAttribute` name usage in `InferNonNullAggConstraint` [#128910](https://github.com/elastic/elasticsearch/pull/128910)
+* Fix case insensitive comparisons to "" [#127532](https://github.com/elastic/elasticsearch/pull/127532) (issue: [#127431](https://github.com/elastic/elasticsearch/issues/127431))
+* Support DATE_NANOS in LOOKUP JOIN [#127962](https://github.com/elastic/elasticsearch/pull/127962) (issue: [#127249](https://github.com/elastic/elasticsearch/issues/127249))
+* Throw ISE instead of IAE for illegal block in page [#128960](https://github.com/elastic/elasticsearch/pull/128960)
+
+IdentityProvider:
+* Improve cache invalidation in IdP SP cache [#128890](https://github.com/elastic/elasticsearch/pull/128890)
+
+Indices APIs:
+* Avoid unnecessary determinization in index pattern conflict checks [#128362](https://github.com/elastic/elasticsearch/pull/128362)
+
+Infra/Core:
+* Update AbstractXContentParser to support parsers that don't provide text characters [#129005](https://github.com/elastic/elasticsearch/pull/129005)
+
+Infra/Plugins:
+* Add complete attribute to .fleet-agents docs [#127651](https://github.com/elastic/elasticsearch/pull/127651)
+
+Machine Learning:
+* Account for Java direct memory on machine learning nodes to prevent out-of-memory crashes. [#128742](https://github.com/elastic/elasticsearch/pull/128742)
+* Ensure that anomaly detection job state update retries if master node is temoporarily unavailable [#129391](https://github.com/elastic/elasticsearch/pull/129391) (issue: [#126148](https://github.com/elastic/elasticsearch/issues/126148))
+* Prevent ML data retention logic from failing when deleting documents in read-only indices [#125408](https://github.com/elastic/elasticsearch/pull/125408)
+
+Mapping:
+* Check prefixes when constructing synthetic source for flattened fields [#129580](https://github.com/elastic/elasticsearch/pull/129580) (issue: [#129508](https://github.com/elastic/elasticsearch/issues/129508))
+
+Search:
+* Fix NPE in semantic highlighter [#128989](https://github.com/elastic/elasticsearch/pull/128989) (issue: [#128975](https://github.com/elastic/elasticsearch/issues/128975))
+* Fix inner hits + aggregations concurrency bug [#128036](https://github.com/elastic/elasticsearch/pull/128036) (issue: [#122419](https://github.com/elastic/elasticsearch/issues/122419))
+* Fix minmax normalizer handling of single-doc result sets [#128689](https://github.com/elastic/elasticsearch/pull/128689)
+* Fix missing highlighting in `match_all` queries for `semantic_text` fields [#128702](https://github.com/elastic/elasticsearch/pull/128702)
+
+Searchable Snapshots:
+* Adjust unpromotable shard refresh request validation to allow `RefreshResult.NO_REFRESH` [#129176](https://github.com/elastic/elasticsearch/pull/129176) (issue: [#129036](https://github.com/elastic/elasticsearch/issues/129036))
+
+Security:
+* Fix error message when changing the password for a user in the file realm [#127621](https://github.com/elastic/elasticsearch/pull/127621)
+
+
 ## 9.0.2 [elasticsearch-9.0.2-release-notes]
 ```{applies_to}
 stack: coming 9.0.2
@@ -409,8 +482,6 @@ Machine Learning:
 * Support mTLS for the Elastic Inference Service integration inside the inference API [#119679](https://github.com/elastic/elasticsearch/pull/119679)
 * [Inference API] Add node-local rate limiting for the inference API [#120400](https://github.com/elastic/elasticsearch/pull/120400)
 * [Inference API] fix spell words: covertToString to convertToString [#119922](https://github.com/elastic/elasticsearch/pull/119922)
-* Update Linux build images to Rocky Linux 8 with gcc 13.3 [#2773](https://github.com/elastic/ml-cpp/pull/2773)
-
 
 Mapping:
 * Add Optional Source Filtering to Source Loaders [#113827](https://github.com/elastic/elasticsearch/pull/113827)

+ 6 - 0
docs/release-notes/known-issues.md

@@ -7,6 +7,12 @@ mapped_pages:
 # Elasticsearch known issues [elasticsearch-known-issues]
 Known issues are significant defects or limitations that may impact your implementation. These issues are actively being worked on and will be addressed in a future release. Review the Elasticsearch known issues to help you make informed decisions, such as upgrading to a new version.
 
+## 9.0.3 [elasticsearch-9.0.3-known-issues]
+A bug in the merge scheduler in Elasticsearch 9.0.3 may prevent shards from closing when there isn’t enough disk space to complete a merge. As a result, operations such as closing or relocating an index may hang until sufficient disk space becomes available.
+To mitigate this issue, the disk space checker is disabled by default in 9.0.3 by setting `indices.merge.disk.check_interval` to `0` seconds. Manually enabling this setting is not recommended.
+
+This issue is planned to be fixed in future patch release [#129613](https://github.com/elastic/elasticsearch/pull/129613)
+
 ## 9.0.0 [elasticsearch-9.0.0-known-issues]
 * Elasticsearch on Windows might fail to start, or might forbid some file-related operations, when referencing paths with a case different from the one stored by the filesystem. Windows treats paths as case-insensitive, but the filesystem stores them with case. Entitlements, the new security system used by Elasticsearch, treat all paths as case-sensitive, and can therefore prevent access to a path that should be accessible.