elasticsearch/docs/reference/release-notes/8.2.0.asciidoc

[[release-notes-8.2.0]]
== {es} version 8.2.0

// Also see <<breaking-changes-8.2,Breaking changes in 8.2>>.
[[known-issues-8.2.0]]
[float]
=== Known issues

include::8.0.0.asciidoc[tag=jackson-filtering-bug]
[[bug-8.2.0]]
[float]
=== Bug fixes

Aggregations::
* Don't apply the rewrite-as-range optimization if field is multivalued {es-pull}84535[#84535] (issue: {es-issue}82903[#82903])
* Fix `AdaptingAggregator` `toString` method {es-pull}86042[#86042]
* Fix: nested top metrics sort on keyword field {es-pull}85058[#85058]
* Fix: use the correct field name when reading data from multi fields {es-pull}84752[#84752]

Analysis::
* Add tests for `min_hash` configuration and fix settings names {es-pull}84753[#84753] (issue: {es-issue}84578[#84578])

Authorization::
* Add delete privilege to `kibana_system` for APM {es-pull}85085[#85085]
* Ensure API key can only see itself with `QueryApiKey` API {es-pull}84859[#84859]
* Fix ownership of refresh tokens {es-pull}85010[#85010]
* Grant `kibana_system` role read access to APM data streams {es-pull}85744[#85744]
* Handle role descriptor retrieval for internal users {es-pull}85049[#85049]
* Ignore app priv failures when resolving superuser {es-pull}85519[#85519]

EQL::
* Clean any used memory by the sequence matcher and circuit breaker used bytes in case of exception {es-pull}84451[#84451]

Engine::
* Increase store ref before snapshotting index commit {es-pull}84776[#84776]

Geo::
* Fix fields wildcard support to vector tile search API {es-pull}85595[#85595] (issue: {es-issue}85592[#85592])

Highlighting::
* Fix wildcard highlighting on `match_only_text` {es-pull}85500[#85500] (issue: {es-issue}85493[#85493])

ILM+SLM::
* Fix Stacktraces Taking Memory in ILM Error Step Serialization {es-pull}84266[#84266]
* Invoke initial `AsyncActionStep` for newly created indices {es-pull}84541[#84541] (issue: {es-issue}77269[#77269])
* Retry clean and create snapshot if it already exists #83694 {es-pull}84829[#84829] (issue: {es-issue}83694[#83694])
* Skip the shrink step if the number of shards of the shrunk index is the same with the original {es-pull}84434[#84434] (issue: {es-issue}80180[#80180])

Indices APIs::
* Remove existing indices/datastreams/aliases before simulating index template {es-pull}84675[#84675] (issue: {es-issue}84256[#84256])

Infra/Core::
* Fix `NullPointerException` in `SystemIndexMetadataUpgradeService` hidden alias handling {es-pull}84780[#84780] (issue: {es-issue}81411[#81411])
* Prevent `ThreadContext` header leak when sending response {es-pull}68649[#68649] (issue: {es-issue}68278[#68278])
* Relax data path deprecations from critical to warn {es-pull}85952[#85952]
* Require and preserve content type for filtered rest requests {es-pull}84914[#84914] (issue: {es-issue}84784[#84784])
* Return empty version instead of blowing up if we cannot find it {es-pull}85244[#85244]
* Validate index format agreement for system index descriptors {es-pull}85173[#85173]
* Wrap thread creation in `doPrivileged` call {es-pull}85180[#85180]

Infra/Plugins::
* Strengthen elasticsearch plugin version check {es-pull}85340[#85340] (issue: {es-issue}85336[#85336])

Infra/REST API::
* Correctly return `_type` field for documents in V7 compatiblity mode {es-pull}84873[#84873] (issue: {es-issue}84173[#84173])

Ingest::
* Mark `GeoIpDownloaderTask` as completed after cancellation {es-pull}84028[#84028]
* `CompoundProcessor` should also catch exceptions when executing a processor {es-pull}84838[#84838] (issue: {es-issue}84781[#84781])

License::
* Fix license downgrade warnings for API Keys and Tokens {es-pull}85276[#85276] (issue: {es-issue}75271[#75271])

Machine Learning::
* Allow retrieving `boolean` fields from `_source` in DFA jobs {es-pull}85672[#85672]
* Avoid multiple queued quantiles documents in renormalizer {es-pull}85555[#85555] (issue: {es-issue}85539[#85539])
* Disallow new trained model deployments when nodes are different versions {es-pull}85465[#85465]
* Do not fetch source when finding index of last state docs {es-pull}85334[#85334]
* Ensure that inference index primary shards are available before attempting to load model {es-pull}85569[#85569]
* Fix Kibana date format and similar overrides in text structure endpoint {es-pull}84967[#84967]
* Fix race condition when stopping a recently relocated datafeed {es-pull}84636[#84636]
* Fix serialisation of text embedding updates {es-pull}85863[#85863]
* Fixes for multi-line start patterns in text structure endpoint {es-pull}85066[#85066]
* Fixes to making old ML indices hidden {es-pull}85383[#85383]
* Reallocate model deployments on node shutdown events {es-pull}85310[#85310]
* Retry datafeed searches on skipped CCS clusters {es-pull}84052[#84052] (issue: {es-issue}83838[#83838])
* Return all Datafeeds with GET Anomaly Detector {es-pull}84759[#84759]

Mapping::
* Do not fail on duplicated content field filters {es-pull}85382[#85382]
* Runtime fields core-with-mapped tests support tsdb {es-pull}83577[#83577]

Packaging::
* Remove use of Cloudflare zlib {es-pull}84680[#84680]

Rollup::
* Add support for comma delimited index patterns to rollup job configuration {es-pull}47041[#47041] (issue: {es-issue}45591[#45591])

SQL::
* Add range checks to interval multiplication operation {es-pull}83478[#83478] (issue: {es-issue}83336[#83336])
* Avoid empty last pages for GROUP BY queries when possible {es-pull}84356[#84356] (issue: {es-issue}75528[#75528])
* Fix SQLCompatIT.testCursorFromOldNodeFailsOnNewNode {es-pull}85531[#85531] (issue: {es-issue}85520[#85520])
* Fix issues with format=txt when paging through result sets and in mixed node environments {es-pull}83833[#83833] (issues: {es-issue}83581[#83581], {es-issue}83788[#83788])
* Improve ROUND and TRUNCATE to better manage Long values and big Doubles {es-pull}85106[#85106] (issues: {es-issue}85105[#85105], {es-issue}49391[#49391])
* Use exact attributes for script templates from scalar functions {es-pull}84813[#84813] (issue: {es-issue}80551[#80551])
* `RANDOM(<expr>)` always evaluates to `NULL` if `<expr>` is `NULL` {es-pull}84632[#84632] (issue: {es-issue}84627[#84627])

Search::
* Fix point visitor in `DiskUsage` API {es-pull}84909[#84909]
* Fix skip caching factor with `indices.queries.cache.all_segments` {es-pull}85510[#85510]
* Increase store ref before analyzing disk usage {es-pull}84774[#84774]
* Limit concurrent shard requests in disk usage API {es-pull}84900[#84900] (issue: {es-issue}84779[#84779])
* Rewrite `match_all` inside `must_not` {es-pull}85999[#85999]
* `DotExpandingXContentParser` to expose the original token location {es-pull}84970[#84970]
* `TransportBroadcastAction` should always set response for each shard {es-pull}84926[#84926]

Security::
* `Authentication.token` now uses version from the existing authentication {es-pull}85978[#85978]
* Ensure tokens represent effective user's identity in all cases {es-pull}84263[#84263]

Snapshot/Restore::
* Don't fail if there is no symlink for AWS Web Identity Token {es-pull}84697[#84697]
* Expose proxy settings for GCS repositories {es-pull}85785[#85785] (issue: {es-issue}84569[#84569])
* Fix atomic writes in HDFS {es-pull}85210[#85210]
* Fix leaking listeners bug on frozen tier {es-pull}85239[#85239]
* Fix snapshot status messages on node-left {es-pull}85021[#85021]
* Ignore frozen shared cache file during data folder upgrades {es-pull}85638[#85638] (issue: {es-issue}85603[#85603])
* [s3-repository] Lookup AWS Region for STS Client from STS endpoint {es-pull}84585[#84585] (issue: {es-issue}83826[#83826])

Stats::
* Discard intermediate results upon cancellation for stats endpoints {es-pull}82685[#82685] (issue: {es-issue}82337[#82337])

Transform::
* Correctly validate permissions when retention policy is configured {es-pull}85413[#85413] (issue: {es-issue}85409[#85409])

Watcher::
* Avoiding watcher validation errors when a data stream points to more than one index {es-pull}85507[#85507] (issue: {es-issue}85508[#85508])
* Log at WARN level for Watcher cluster state validation errors {es-pull}85632[#85632]
* No longer require master node to install Watcher templates {es-pull}85287[#85287] (issue: {es-issue}85043[#85043])

[[enhancement-8.2.0]]
[float]
=== Enhancements

Aggregations::
* Aggs: no filter-by-filter if `_doc_count` field {es-pull}84427[#84427] (issue: {es-issue}84048[#84048])
* Extract agg bounds from queries in FILTER {es-pull}83902[#83902]
* Give Lucene more opportunities to enable the filter-by-filter optimization {es-pull}85322[#85322]
* Improve performance of `date_histogram` when date histogram is in a BoostingQuery {es-pull}83751[#83751] (issues: {es-issue}82384[#82384], {es-issue}75542[#75542])

Allocation::
* Make allocation explanations more actionable {es-pull}83983[#83983]
* Use static empty store files metadata {es-pull}84034[#84034]

Audit::
* User Profile - Audit security config change for profile APIs {es-pull}84785[#84785]

Authentication::
* Adds domain information to authentication object {es-pull}82639[#82639]
* Improve BWC for persisted authentication headers {es-pull}83913[#83913] (issue: {es-issue}83567[#83567])
* Warn on SAML attributes with special attribute names {es-pull}85248[#85248] (issue: {es-issue}48613[#48613])

Authorization::
* Add elastic/enterprise-search-server service account {es-pull}83325[#83325]
* Add index privileges for logs-enterprise_search.api-default to the enterprise-search-server service account {es-pull}84965[#84965]
* Add indices permissions to Enterprise Search service account {es-pull}85726[#85726]
* Note restricted indices in access denied message {es-pull}85013[#85013]
* Security global privilege for updating profile data of applications {es-pull}83728[#83728]
* [Osquery] Extend `kibana_system` role with an access to `osquery_manager` indices {es-pull}84279[#84279]

CRUD::
* Speed up Reading `RetentionLeases` from the Wire {es-pull}85159[#85159]

Cluster Coordination::
* Avoid deserializing cluster states on master {es-pull}58416[#58416]
* Improve logging for connect-back failures {es-pull}84915[#84915]
* Remove intermediate map from master task execution {es-pull}84406[#84406]
* Reuse `JoinTaskExecutor` {es-pull}85325[#85325]
* Speed up `MetadataStateFormat` Writes {es-pull}85138[#85138]

Data streams::
* Speed up `DatastreamTimestampFieldMapper#postParse` {es-pull}85270[#85270]

Discovery-Plugins::
* Support IMDSv2 for EC2 Discovery {es-pull}84410[#84410] (issue: {es-issue}80398[#80398])

Distributed::
* Add elasticsearch health API {es-pull}83119[#83119]

Geo::
* Add `geohex_grid` aggregation to vector tiles API {es-pull}84553[#84553]
* Added buffer pixels to vector tile spec parsing {es-pull}84710[#84710] (issue: {es-issue}84492[#84492])
* Normalise polygons only when necessary {es-pull}84229[#84229] (issue: {es-issue}35349[#35349])
* Support GeoJSON for `geo_point` {es-pull}85120[#85120]

Health::
* Fix naming in health indicators {es-pull}83587[#83587]
* ILM/SLM health indicator services {es-pull}83440[#83440]
* Introduce dedicated interface for health indicator details {es-pull}83417[#83417]
* Repository integrity health indicator services {es-pull}83445[#83445]
* Shards allocation health indicator services {es-pull}83513[#83513]

ILM+SLM::
* Cache ILM policy name on `IndexMetadata` {es-pull}83603[#83603] (issue: {es-issue}83582[#83582])
* GET _index_template and GET _component_template request support query parameter flat_settings {es-pull}83297[#83297]
* Make rollover cancellable #81763 {es-pull}84584[#84584] (issue: {es-issue}81763[#81763])
* Rollover add max_primary_shard_docs condition {es-pull}80981[#80981]
* Speed up ILM cluster task execution {es-pull}85405[#85405] (issue: {es-issue}82708[#82708])

Indices APIs::
* Batch add index block cluster state updates {es-pull}84374[#84374]
* Batch close-indices cluster state updates {es-pull}84259[#84259]
* Batch open-indices cluster state updates {es-pull}83760[#83760]
* Remove LegacyCTRAL from `TransportRolloverAction` {es-pull}84166[#84166]

Infra/Core::
* Add support for negtive epoch timestamps {es-pull}80208[#80208] (issues: {es-issue}79135[#79135], {es-issue}72123[#72123], {es-issue}40983[#40983])
* Allow yaml values for dynamic node settings {es-pull}85186[#85186] (issue: {es-issue}65577[#65577])
* Improve XContent Array Parser {es-pull}84477[#84477]
* Optimize `ImmutableOpenMap.Builder` {es-pull}85184[#85184]
* Provide 'system' attribute when resolving system indices {es-pull}85042[#85042] (issue: {es-issue}82671[#82671])
* Remove Lucene split packages {es-pull}82132[#82132] (issue: {es-issue}81981[#81981])
* Simplify reading a list and converting it to a map from stream {es-pull}84183[#84183]
* Speed up CompressedXContent Serialization {es-pull}84802[#84802]
* Update `readMap` to avoid resizing map during reading {es-pull}84045[#84045]

Infra/Plugins::
* Warn on slow signature verification {es-pull}84766[#84766] (issue: {es-issue}80480[#80480])

Infra/Scripting::
* Script: Fields API for Dense Vector {es-pull}83550[#83550]

Ingest::
* Do not throw exceptions when resolving paths in ingest documents {es-pull}84659[#84659]
* RemoveProcessor updated to support fieldsToKeep {es-pull}83665[#83665]

Machine Learning::
* Add ML memory stats API {es-pull}83802[#83802]
* Add support for RoBERTa and BART NLP models {es-pull}84777[#84777]
* Add throughput stats for Trained Model Deployments {es-pull}84628[#84628]
* Improve `zero_shot_classification` tokenization performance {es-pull}84988[#84988] (issue: {es-issue}84820[#84820])

Mapping::
* Check the utf8 length of keyword field is not bigger than 32766 in ES, rather than in Lucene. {es-pull}83738[#83738] (issue: {es-issue}80865[#80865])
* Make `FieldMapper.Param` Cheaper to Construct {es-pull}85191[#85191]
* Terms enum support for doc value only keyword fields {es-pull}83482[#83482] (issue: {es-issue}83451[#83451])

Network::
* Use Throttling Netty Write Handler on HTTP Path {es-pull}84751[#84751]

Query Languages::
* Add `unsigned_long` type support {es-pull}65145[#65145] (issue: {es-issue}63312[#63312])

Recovery::
* Improve failure logging in recovery-from-snapshot {es-pull}84910[#84910]

Reindex::
* Use `SecureString` for reindex from remote password {es-pull}85091[#85091]

SQL::
* Add leniency option to SQL CLI {es-pull}83795[#83795] (issue: {es-issue}67436[#67436])
* Forward warning headers to JDBC driver {es-pull}84499[#84499]
* List data streams as VIEWs {es-pull}85168[#85168] (issue: {es-issue}83449[#83449])
* PIT for `GROUP BY` and `PIVOT` queries {es-pull}84605[#84605] (issue: {es-issue}84349[#84349])
* Replace scroll cursors with point-in-time and `search_after` {es-pull}83381[#83381] (issues: {es-issue}61873[#61873], {es-issue}80523[#80523])

Search::
* Add filtering to fieldcaps endpoint {es-pull}83636[#83636] (issue: {es-issue}82966[#82966])
* Group field caps response by index mapping hash {es-pull}83494[#83494] (issues: {es-issue}78665[#78665], {es-issue}82879[#82879])
* Integrate filtering support for ANN {es-pull}84734[#84734] (issue: {es-issue}81788[#81788])
* Speed up merging field-caps response {es-pull}83704[#83704]

Security::
* Bind host all instead of just _site_ when needed {es-pull}83145[#83145]
* Fleet: Add a new mapping for .fleet-actions-results `action_input_type` field {es-pull}84316[#84316]
* Update X509Certificate principal methods {es-pull}85163[#85163] (issue: {es-issue}81008[#81008])
* User Profile - Add APIs for enable/disable profile {es-pull}84548[#84548]
* User Profile - Add rest spec files and tests {es-pull}83307[#83307]
* User Profile - More REST spec, tests, API docs {es-pull}84597[#84597]
* User Profile - Update APIs to work with domain {es-pull}83570[#83570]
* User Profile - Update xpack usage output for domains {es-pull}84747[#84747]
* User Profile - capture domain when creating API keys and tokens {es-pull}84547[#84547]
* User Profile: Add feature flag {es-pull}83347[#83347]
* User Profile: Add initial search profile API {es-pull}83191[#83191]
* User Profile: handle racing on creating new profile {es-pull}84208[#84208]

TSDB::
* TSDB: Expand `_id` on version conflict {es-pull}84957[#84957]
* TSDB: Reject the nested object fields that are configured time_series_dimension {es-pull}83920[#83920]
* TSDB: routingPath object type check improvement {es-pull}83310[#83310]
* TSDB: shrink `_id` inverted index {es-pull}85008[#85008]

Watcher::
* Add list of allowed domains for Watcher email action {es-pull}84894[#84894] (issue: {es-issue}84739[#84739])

[[feature-8.2.0]]
[float]
=== New features

Aggregations::
* New `random_sampler` aggregation for sampling documents in aggregations {es-pull}84363[#84363]

Authentication::
* Add JWT realm support for JWT validation {es-pull}83155[#83155]
* Add smoke test for JWT realm wiring {es-pull}84249[#84249]
* Support mail, name, and dn claims in JWT realms {es-pull}84907[#84907]

Authorization::
* API Key APIs with Security Domain {es-pull}84704[#84704]

Health::
* Add Health Indicator Plugin {es-pull}83205[#83205]
* Adding impacts block to the health info API response {es-pull}84899[#84899] (issue: {es-issue}84773[#84773])

Indices APIs::
* Adding cat api for component template {es-pull}71274[#71274] (issue: {es-issue}68941[#68941])

Infra/Core::
* Introduce an unauthenticated endpoint for readiness checks {es-pull}84375[#84375] (issue: {es-issue}81168[#81168])

Machine Learning::
* Adds new `change_point` pipeline aggregation {es-pull}83428[#83428]

Search::
* Introduce lookup runtime fields {es-pull}82385[#82385]
* Resolve wildcards in disk usage API {es-pull}84832[#84832]

TSDB::
* TSDB: Support GET and DELETE and doc versioning {es-pull}82633[#82633]

[[upgrade-8.2.0]]
[float]
=== Upgrades

Infra/Core::
* Upgrade jackson for x-content to 2.13.2 {es-pull}84905[#84905]

Ingest::
* Bump commons-compress to 1.21 {es-pull}85581[#85581]

Network::
* Upgrade Netty to 4.1.74 {es-pull}84562[#84562]

Packaging::
* Upgrade to JDK 18.0.0+36 {es-pull}85376[#85376] (issue: {es-issue}85357[#85357])

Search::
* Upgrade to lucene 9.1.0-snapshot-5b522487ba8 {es-pull}85025[#85025]