put-transform.asciidoc 5.4 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176
  1. [role="xpack"]
  2. [testenv="basic"]
  3. [[put-data-frame-transform]]
  4. === Create {dataframe-transforms} API
  5. [subs="attributes"]
  6. ++++
  7. <titleabbrev>Create {dataframe-transforms}</titleabbrev>
  8. ++++
  9. Instantiates a {dataframe-transform}.
  10. beta[]
  11. [[put-data-frame-transform-request]]
  12. ==== {api-request-title}
  13. `PUT _data_frame/transforms/<data_frame_transform_id>`
  14. [[put-data-frame-transform-prereqs]]
  15. ==== {api-prereq-title}
  16. * If the {es} {security-features} are enabled, you must have
  17. `manage_data_frame_transforms` cluster privileges to use this API. The built-in
  18. `data_frame_transforms_admin` role has these privileges. You must also
  19. have `read` and `view_index_metadata` privileges on the source index and `read`,
  20. `create_index`, and `index` privileges on the destination index. For more
  21. information, see {stack-ov}/security-privileges.html[Security privileges] and
  22. {stack-ov}/built-in-roles.html[Built-in roles].
  23. [[put-data-frame-transform-desc]]
  24. ==== {api-description-title}
  25. IMPORTANT: You must use {kib} or this API to create a {dataframe-transform}.
  26. Do not put a {dataframe-transform} directly into any
  27. `.data-frame-internal*` indices using the Elasticsearch index API.
  28. If {es} {security-features} are enabled, do not give users any
  29. privileges on `.data-frame-internal*` indices.
  30. [[put-data-frame-transform-path-parms]]
  31. ==== {api-path-parms-title}
  32. `<data_frame_transform_id>`::
  33. (Required, string) Identifier for the {dataframe-transform}. This identifier
  34. can contain lowercase alphanumeric characters (a-z and 0-9), hyphens, and
  35. underscores. It must start and end with alphanumeric characters.
  36. [[put-data-frame-transform-query-parms]]
  37. ==== {api-query-parms-title}
  38. `defer_validation`::
  39. (Optional, boolean) When `true`, deferrable validations are not run. This
  40. behavior may be desired if the source index does not exist until after the
  41. {dataframe-transform} is created. Deferred validations are always run when the
  42. {dataframe-transform} is started, with the exception of privilege checks. If the
  43. user who created the transform does not have the required privileges on the
  44. source and destination indices, the transform starts but then fails when it
  45. attempts the unauthorized operation. The default value is `false`.
  46. [[put-data-frame-transform-request-body]]
  47. ==== {api-request-body-title}
  48. `description`::
  49. (Optional, string) Free text description of the {dataframe-transform}.
  50. `dest`::
  51. (Required, object) Required. The destination configuration, which has the
  52. following properties:
  53. `index`:::
  54. (Required, string) The _destination index_ for the {dataframe-transform}.
  55. `pipeline`:::
  56. (Optional, string) The unique identifier for a <<pipeline,pipeline>>.
  57. `frequency`::
  58. (Optional, time units) The interval between checks for changes in the source indices
  59. when the {dataframe-transform} is running continuously. Defaults to `1m`.
  60. The lowest permitted value is `1s`; the highest `1h`.
  61. `pivot`::
  62. (Required, object) Defines the pivot function `group by` fields and the aggregation to
  63. reduce the data. See <<data-frame-transform-pivot>>.
  64. `source`::
  65. (Required, object) The source configuration, which has the following
  66. properties:
  67. `index`:::
  68. (Required, string or array) The _source indices_ for the
  69. {dataframe-transform}. It can be a single index, an index pattern (for
  70. example, `"myindex*"`), or an array of indices (for example,
  71. `["index1", "index2"]`).
  72. `query`:::
  73. (Optional, object) A query clause that retrieves a subset of data from the
  74. source index. See <<query-dsl>>.
  75. `sync`::
  76. (Optional, object) Defines the properties required to run continuously.
  77. `time`:::
  78. (Required, object) Specifies that the {dataframe-transform} uses a time
  79. field to synchronize the source and destination indices.
  80. `field`::::
  81. (Required, string) The date field that is used to identify new documents
  82. in the source.
  83. +
  84. --
  85. TIP: In general, it’s a good idea to use a field that contains the
  86. <<accessing-ingest-metadata,ingest timestamp>>. If you use a different field,
  87. you might need to set the `delay` such that it accounts for data transmission
  88. delays.
  89. --
  90. `delay`::::
  91. (Optional, time units) The time delay between the current time and the
  92. latest input data time. The default value is `60s`.
  93. [[put-data-frame-transform-example]]
  94. ==== {api-examples-title}
  95. [source,js]
  96. --------------------------------------------------
  97. PUT _data_frame/transforms/ecommerce_transform
  98. {
  99. "source": {
  100. "index": "kibana_sample_data_ecommerce",
  101. "query": {
  102. "term": {
  103. "geoip.continent_name": {
  104. "value": "Asia"
  105. }
  106. }
  107. }
  108. },
  109. "pivot": {
  110. "group_by": {
  111. "customer_id": {
  112. "terms": {
  113. "field": "customer_id"
  114. }
  115. }
  116. },
  117. "aggregations": {
  118. "max_price": {
  119. "max": {
  120. "field": "taxful_total_price"
  121. }
  122. }
  123. }
  124. },
  125. "description": "Maximum priced ecommerce data by customer_id in Asia",
  126. "dest": {
  127. "index": "kibana_sample_data_ecommerce_transform",
  128. "pipeline": "add_timestamp_pipeline"
  129. },
  130. "frequency": "5m",
  131. "sync": {
  132. "time": {
  133. "field": "order_date",
  134. "delay": "60s"
  135. }
  136. }
  137. }
  138. --------------------------------------------------
  139. // CONSOLE
  140. // TEST[setup:kibana_sample_data_ecommerce]
  141. When the transform is created, you receive the following results:
  142. [source,js]
  143. ----
  144. {
  145. "acknowledged" : true
  146. }
  147. ----
  148. // TESTRESPONSE