esql-limitations.asciidoc 5.3 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200
  1. [[esql-limitations]]
  2. == {esql} limitations
  3. ++++
  4. <titleabbrev>Limitations</titleabbrev>
  5. ++++
  6. [discrete]
  7. [[esql-max-rows]]
  8. === Result set size limit
  9. By default, an {esql} query returns up to 500 rows. You can increase the number
  10. of rows up to 10,000 using the <<esql-limit>> command.
  11. include::processing-commands/limit.asciidoc[tag=limitation]
  12. [discrete]
  13. [[esql-supported-types]]
  14. === Field types
  15. [discrete]
  16. ==== Supported types
  17. {esql} currently supports the following <<mapping-types,field types>>:
  18. * `alias`
  19. * `boolean`
  20. * `date`
  21. * `double` (`float`, `half_float`, `scaled_float` are represented as `double`)
  22. * `ip`
  23. * `keyword` family including `keyword`, `constant_keyword`, and `wildcard`
  24. * `int` (`short` and `byte` are represented as `int`)
  25. * `long`
  26. * `null`
  27. * `text`
  28. * `unsigned_long`
  29. * `version`
  30. * Spatial types
  31. ** `geo_point`
  32. ** `geo_shape`
  33. ** `point`
  34. ** `shape`
  35. [discrete]
  36. ==== Unsupported types
  37. {esql} does not yet support the following field types:
  38. * TSDB metrics
  39. ** `counter`
  40. ** `position`
  41. ** `aggregate_metric_double`
  42. * Date/time
  43. ** `date_nanos`
  44. ** `date_range`
  45. * Other types
  46. ** `binary`
  47. ** `completion`
  48. ** `dense_vector`
  49. ** `double_range`
  50. ** `flattened`
  51. ** `float_range`
  52. ** `histogram`
  53. ** `integer_range`
  54. ** `ip_range`
  55. ** `long_range`
  56. ** `nested`
  57. ** `rank_feature`
  58. ** `rank_features`
  59. ** `search_as_you_type`
  60. Querying a column with an unsupported type returns an error. If a column with an
  61. unsupported type is not explicitly used in a query, it is returned with `null`
  62. values, with the exception of nested fields. Nested fields are not returned at
  63. all.
  64. [discrete]
  65. [[esql-limitations-full-text-search]]
  66. === Full-text search is not supported
  67. Because of <<esql-limitations-text-fields,the way {esql} treats `text` values>>,
  68. full-text search is not yet supported. Queries on `text` fields are like queries
  69. on `keyword` fields: they are case-sensitive and need to match the full string.
  70. For example, after indexing a field of type `text` with the value `Elasticsearch
  71. query language`, the following `WHERE` clause does not match because the `LIKE`
  72. operator is case-sensitive:
  73. [source,esql]
  74. ----
  75. | WHERE field LIKE "elasticsearch query language"
  76. ----
  77. The following `WHERE` clause does not match either, because the `LIKE` operator
  78. tries to match the whole string:
  79. [source,esql]
  80. ----
  81. | WHERE field LIKE "Elasticsearch"
  82. ----
  83. As a workaround, use wildcards and regular expressions. For example:
  84. [source,esql]
  85. ----
  86. | WHERE field RLIKE "[Ee]lasticsearch.*"
  87. ----
  88. [discrete]
  89. [[esql-limitations-text-fields]]
  90. === `text` fields behave like `keyword` fields
  91. While {esql} supports <<text,`text`>> fields, {esql} does not treat these fields
  92. like the Search API does. {esql} queries do not query or aggregate the
  93. <<analysis,analyzed string>>. Instead, an {esql} query will try to get a `text`
  94. field's subfield of the <<keyword,keyword family type>> and query/aggregate
  95. that. If it's not possible to retrieve a `keyword` subfield, {esql} will get the
  96. string from a document's `_source`. If the `_source` cannot be retrieved, for
  97. example when using synthetic source, `null` is returned.
  98. Note that {esql}'s retrieval of `keyword` subfields may have unexpected
  99. consequences. An {esql} query on a `text` field is case-sensitive. Furthermore,
  100. a subfield may have been mapped with a <<normalizer,normalizer>>, which can
  101. transform the original string. Or it may have been mapped with <<ignore-above>>,
  102. which can truncate the string. None of these mapping operations are applied to
  103. an {esql} query, which may lead to false positives or negatives.
  104. To avoid these issues, a best practice is to be explicit about the field that
  105. you query, and query `keyword` sub-fields instead of `text` fields.
  106. [discrete]
  107. [[esql-tsdb]]
  108. === Time series data streams are not supported
  109. {esql} does not support querying time series data streams (TSDS).
  110. [discrete]
  111. [[esql-limitations-ccs]]
  112. === {ccs-cap} is not supported
  113. {esql} does not support {ccs}.
  114. [discrete]
  115. [[esql-limitations-date-math]]
  116. === Date math limitations
  117. Date math expressions work well when the leftmost expression is a datetime, for
  118. example:
  119. [source,txt]
  120. ----
  121. now() + 1 year - 2hour + ...
  122. ----
  123. But using parentheses or putting the datetime to the right is not always supported yet. For example, the following expressions fail:
  124. [source,txt]
  125. ----
  126. 1year + 2hour + now()
  127. now() + (1year + 2hour)
  128. ----
  129. Date math does not allow subtracting two datetimes, for example:
  130. [source,txt]
  131. ----
  132. now() - 2023-10-26
  133. ----
  134. [discrete]
  135. [[esql-limitations-enrich]]
  136. === Enrich limitations
  137. include::esql-enrich-data.asciidoc[tag=limitations]
  138. [discrete]
  139. [[esql-limitations-dissect]]
  140. === Dissect limitations
  141. include::esql-process-data-with-dissect-grok.asciidoc[tag=dissect-limitations]
  142. [discrete]
  143. [[esql-limitations-grok]]
  144. === Grok limitations
  145. include::esql-process-data-with-dissect-grok.asciidoc[tag=grok-limitations]
  146. [discrete]
  147. [[esql-limitations-mv]]
  148. === Multivalue limitations
  149. {esql} <<esql-multivalued-fields,supports multivalued fields>>, but functions
  150. return `null` when applied to a multivalued field, unless documented otherwise.
  151. Work around this limitation by converting the field to single value with one of
  152. the <<esql-mv-functions,multivalue functions>>.
  153. [discrete]
  154. [[esql-limitations-timezone]]
  155. === Timezone support
  156. {esql} only supports the UTC timezone.
  157. [discrete]
  158. [[esql-limitations-kibana]]
  159. === Kibana limitations
  160. include::esql-kibana.asciidoc[tag=limitations]