esql-limitations.asciidoc 5.3 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201
  1. [[esql-limitations]]
  2. == {esql} limitations
  3. ++++
  4. <titleabbrev>Limitations</titleabbrev>
  5. ++++
  6. [discrete]
  7. [[esql-max-rows]]
  8. === Result set size limit
  9. By default, an {esql} query returns up to 500 rows. You can increase the number
  10. of rows up to 10,000 using the <<esql-limit>> command.
  11. include::processing-commands/limit.asciidoc[tag=limitation]
  12. [discrete]
  13. [[esql-supported-types]]
  14. === Field types
  15. [discrete]
  16. ==== Supported types
  17. {esql} currently supports the following <<mapping-types,field types>>:
  18. * `alias`
  19. * `boolean`
  20. * `date`
  21. * `double` (`float`, `half_float`, `scaled_float` are represented as `double`)
  22. * `ip`
  23. * `keyword` family including `keyword`, `constant_keyword`, and `wildcard`
  24. * `int` (`short` and `byte` are represented as `int`)
  25. * `long`
  26. * `null`
  27. * `text`
  28. * `unsigned_long`
  29. * `version`
  30. * Spatial types
  31. ** `geo_point`
  32. ** `point`
  33. [discrete]
  34. ==== Unsupported types
  35. {esql} does not yet support the following field types:
  36. * TSDB metrics
  37. ** `counter`
  38. ** `position`
  39. ** `aggregate_metric_double`
  40. * Spatial types
  41. ** `geo_shape`
  42. ** `shape`
  43. * Date/time
  44. ** `date_nanos`
  45. ** `date_range`
  46. * Other types
  47. ** `binary`
  48. ** `completion`
  49. ** `dense_vector`
  50. ** `double_range`
  51. ** `flattened`
  52. ** `float_range`
  53. ** `histogram`
  54. ** `integer_range`
  55. ** `ip_range`
  56. ** `long_range`
  57. ** `nested`
  58. ** `rank_feature`
  59. ** `rank_features`
  60. ** `search_as_you_type`
  61. Querying a column with an unsupported type returns an error. If a column with an
  62. unsupported type is not explicitly used in a query, it is returned with `null`
  63. values, with the exception of nested fields. Nested fields are not returned at
  64. all.
  65. [discrete]
  66. [[esql-limitations-full-text-search]]
  67. === Full-text search is not supported
  68. Because of <<esql-limitations-text-fields,the way {esql} treats `text` values>>,
  69. full-text search is not yet supported. Queries on `text` fields are like queries
  70. on `keyword` fields: they are case-sensitive and need to match the full string.
  71. For example, after indexing a field of type `text` with the value `Elasticsearch
  72. query language`, the following `WHERE` clause does not match because the `LIKE`
  73. operator is case-sensitive:
  74. [source,esql]
  75. ----
  76. | WHERE field LIKE "elasticsearch query language"
  77. ----
  78. The following `WHERE` clause does not match either, because the `LIKE` operator
  79. tries to match the whole string:
  80. [source,esql]
  81. ----
  82. | WHERE field LIKE "Elasticsearch"
  83. ----
  84. As a workaround, use wildcards and regular expressions. For example:
  85. [source,esql]
  86. ----
  87. | WHERE field RLIKE "[Ee]lasticsearch.*"
  88. ----
  89. [discrete]
  90. [[esql-limitations-text-fields]]
  91. === `text` fields behave like `keyword` fields
  92. While {esql} supports <<text,`text`>> fields, {esql} does not treat these fields
  93. like the Search API does. {esql} queries do not query or aggregate the
  94. <<analysis,analyzed string>>. Instead, an {esql} query will try to get a `text`
  95. field's subfield of the <<keyword,keyword family type>> and query/aggregate
  96. that. If it's not possible to retrieve a `keyword` subfield, {esql} will get the
  97. string from a document's `_source`. If the `_source` cannot be retrieved, for
  98. example when using synthetic source, `null` is returned.
  99. Note that {esql}'s retrieval of `keyword` subfields may have unexpected
  100. consequences. An {esql} query on a `text` field is case-sensitive. Furthermore,
  101. a subfield may have been mapped with a <<normalizer,normalizer>>, which can
  102. transform the original string. Or it may have been mapped with <<ignore-above>>,
  103. which can truncate the string. None of these mapping operations are applied to
  104. an {esql} query, which may lead to false positives or negatives.
  105. To avoid these issues, a best practice is to be explicit about the field that
  106. you query, and query `keyword` sub-fields instead of `text` fields.
  107. [discrete]
  108. [[esql-tsdb]]
  109. === Time series data streams are not supported
  110. {esql} does not support querying time series data streams (TSDS).
  111. [discrete]
  112. [[esql-limitations-ccs]]
  113. === {ccs-cap} is not supported
  114. {esql} does not support {ccs}.
  115. [discrete]
  116. [[esql-limitations-date-math]]
  117. === Date math limitations
  118. Date math expressions work well when the leftmost expression is a datetime, for
  119. example:
  120. [source,txt]
  121. ----
  122. now() + 1 year - 2hour + ...
  123. ----
  124. But using parentheses or putting the datetime to the right is not always supported yet. For example, the following expressions fail:
  125. [source,txt]
  126. ----
  127. 1year + 2hour + now()
  128. now() + (1year + 2hour)
  129. ----
  130. Date math does not allow subtracting two datetimes, for example:
  131. [source,txt]
  132. ----
  133. now() - 2023-10-26
  134. ----
  135. [discrete]
  136. [[esql-limitations-enrich]]
  137. === Enrich limitations
  138. include::esql-enrich-data.asciidoc[tag=limitations]
  139. [discrete]
  140. [[esql-limitations-dissect]]
  141. === Dissect limitations
  142. include::esql-process-data-with-dissect-grok.asciidoc[tag=dissect-limitations]
  143. [discrete]
  144. [[esql-limitations-grok]]
  145. === Grok limitations
  146. include::esql-process-data-with-dissect-grok.asciidoc[tag=grok-limitations]
  147. [discrete]
  148. [[esql-limitations-mv]]
  149. === Multivalue limitations
  150. {esql} <<esql-multivalued-fields,supports multivalued fields>>, but functions
  151. return `null` when applied to a multivalued field, unless documented otherwise.
  152. Work around this limitation by converting the field to single value with one of
  153. the <<esql-mv-functions,multivalue functions>>.
  154. [discrete]
  155. [[esql-limitations-timezone]]
  156. === Timezone support
  157. {esql} only supports the UTC timezone.
  158. [discrete]
  159. [[esql-limitations-kibana]]
  160. === Kibana limitations
  161. include::esql-kibana.asciidoc[tag=limitations]