put-job.asciidoc 8.2 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296
  1. [role="xpack"]
  2. [testenv="platinum"]
  3. [[ml-put-job]]
  4. === Create {anomaly-jobs} API
  5. ++++
  6. <titleabbrev>Create jobs</titleabbrev>
  7. ++++
  8. Instantiates an {anomaly-job}.
  9. [[ml-put-job-request]]
  10. ==== {api-request-title}
  11. `PUT _ml/anomaly_detectors/<job_id>`
  12. [[ml-put-job-prereqs]]
  13. ==== {api-prereq-title}
  14. * If the {es} {security-features} are enabled, you must have `manage_ml` or
  15. `manage` cluster privileges to use this API. See
  16. <<security-privileges>>.
  17. [[ml-put-job-desc]]
  18. ==== {api-description-title}
  19. IMPORTANT: You must use {kib} or this API to create an {anomaly-job}. Do not put
  20. a job directly to the `.ml-config` index using the {es} index API. If {es}
  21. {security-features} are enabled, do not give users `write` privileges on the
  22. `.ml-config` index.
  23. [[ml-put-job-path-parms]]
  24. ==== {api-path-parms-title}
  25. `<job_id>`::
  26. (Required, string)
  27. include::{docdir}/ml/ml-shared.asciidoc[tag=job-id-anomaly-detection-define]
  28. [[ml-put-job-request-body]]
  29. ==== {api-request-body-title}
  30. `allow_lazy_open`::
  31. (Optional, boolean)
  32. include::{docdir}/ml/ml-shared.asciidoc[tag=allow-lazy-open]
  33. [[put-analysisconfig]]`analysis_config`::
  34. (Required, object)
  35. include::{docdir}/ml/ml-shared.asciidoc[tag=analysis-config]
  36. `analysis_config`.`bucket_span`:::
  37. (<<time-units,time units>>)
  38. include::{docdir}/ml/ml-shared.asciidoc[tag=bucket-span]
  39. `analysis_config`.`categorization_field_name`:::
  40. (string)
  41. include::{docdir}/ml/ml-shared.asciidoc[tag=categorization-field-name]
  42. `analysis_config`.`categorization_filters`:::
  43. (array of strings)
  44. include::{docdir}/ml/ml-shared.asciidoc[tag=categorization-filters]
  45. `analysis_config`.`categorization_analyzer`:::
  46. (object or string)
  47. include::{docdir}/ml/ml-shared.asciidoc[tag=categorization-analyzer]
  48. `analysis_config`.`detectors`:::
  49. (array) An array of detector configuration objects. Detector configuration
  50. objects specify which data fields a job analyzes. They also specify which
  51. analytical functions are used. You can specify multiple detectors for a job.
  52. +
  53. --
  54. NOTE: If the `detectors` array does not contain at least one detector,
  55. no analysis can occur and an error is returned.
  56. A detector has the following properties:
  57. --
  58. `analysis_config`.`detectors`.`by_field_name`::::
  59. (string)
  60. include::{docdir}/ml/ml-shared.asciidoc[tag=by-field-name]
  61. `analysis_config`.`detectors`.`custom_rules`::::
  62. +
  63. --
  64. (array)
  65. include::{docdir}/ml/ml-shared.asciidoc[tag=custom-rules]
  66. `analysis_config`.`detectors`.`custom_rules`.`actions`:::
  67. (array)
  68. include::{docdir}/ml/ml-shared.asciidoc[tag=custom-rules-actions]
  69. `analysis_config`.`detectors`.`custom_rules`.`scope`:::
  70. (object)
  71. include::{docdir}/ml/ml-shared.asciidoc[tag=custom-rules-scope]
  72. `analysis_config`.`detectors`.`custom_rules`.`scope`.`filter_id`::::
  73. (string)
  74. include::{docdir}/ml/ml-shared.asciidoc[tag=custom-rules-scope-filter-id]
  75. `analysis_config`.`detectors`.`custom_rules`.`scope`.`filter_type`::::
  76. (string)
  77. include::{docdir}/ml/ml-shared.asciidoc[tag=custom-rules-scope-filter-type]
  78. `analysis_config`.`detectors`.`custom_rules`.`conditions`:::
  79. (array)
  80. include::{docdir}/ml/ml-shared.asciidoc[tag=custom-rules-conditions]
  81. `analysis_config`.`detectors`.`custom_rules`.`conditions`.`applies_to`::::
  82. (string)
  83. include::{docdir}/ml/ml-shared.asciidoc[tag=custom-rules-conditions-applies-to]
  84. `analysis_config`.`detectors`.`custom_rules`.`conditions`.`operator`::::
  85. (string)
  86. include::{docdir}/ml/ml-shared.asciidoc[tag=custom-rules-conditions-operator]
  87. `analysis_config`.`detectors`.`custom_rules`.`conditions`.`value`::::
  88. (double)
  89. include::{docdir}/ml/ml-shared.asciidoc[tag=custom-rules-conditions-value]
  90. --
  91. `analysis_config`.`detectors`.`detector_description`::::
  92. (string)
  93. include::{docdir}/ml/ml-shared.asciidoc[tag=detector-description]
  94. `analysis_config`.`detectors`.`detector_index`::::
  95. +
  96. --
  97. (integer)
  98. include::{docdir}/ml/ml-shared.asciidoc[tag=detector-index]
  99. If you specify a value for this property, it is ignored.
  100. --
  101. `analysis_config`.`detectors`.`exclude_frequent`::::
  102. (string)
  103. include::{docdir}/ml/ml-shared.asciidoc[tag=exclude-frequent]
  104. `analysis_config`.`detectors`.`field_name`::::
  105. (string)
  106. include::{docdir}/ml/ml-shared.asciidoc[tag=detector-field-name]
  107. `analysis_config`.`detectors`.`function`::::
  108. (string)
  109. include::{docdir}/ml/ml-shared.asciidoc[tag=function]
  110. `analysis_config`.`detectors`.`over_field_name`::::
  111. (string)
  112. include::{docdir}/ml/ml-shared.asciidoc[tag=over-field-name]
  113. `analysis_config`.`detectors`.`partition_field_name`::::
  114. (string)
  115. include::{docdir}/ml/ml-shared.asciidoc[tag=partition-field-name]
  116. `analysis_config`.`detectors`.`use_null`::::
  117. (boolean)
  118. include::{docdir}/ml/ml-shared.asciidoc[tag=use-null]
  119. `analysis_config`.`influencers`:::
  120. (array of strings)
  121. include::{docdir}/ml/ml-shared.asciidoc[tag=influencers]
  122. `analysis_config`.`latency`:::
  123. (time units)
  124. include::{docdir}/ml/ml-shared.asciidoc[tag=latency]
  125. `analysis_config`.`multivariate_by_fields`:::
  126. (boolean)
  127. include::{docdir}/ml/ml-shared.asciidoc[tag=multivariate-by-fields]
  128. `analysis_config`.`summary_count_field_name`:::
  129. (string)
  130. include::{docdir}/ml/ml-shared.asciidoc[tag=summary-count-field-name]
  131. [[put-analysislimits]]`analysis_limits`::
  132. (Optional, object)
  133. include::{docdir}/ml/ml-shared.asciidoc[tag=analysis-limits]
  134. +
  135. --
  136. The `analysis_limits` object has the following properties:
  137. --
  138. `analysis_limits`.`categorization_examples_limit`:::
  139. (long)
  140. include::{docdir}/ml/ml-shared.asciidoc[tag=categorization-examples-limit]
  141. `analysis_limits`.`model_memory_limit`:::
  142. (long or string)
  143. include::{docdir}/ml/ml-shared.asciidoc[tag=model-memory-limit]
  144. `background_persist_interval`::
  145. (Optional, <<time-units, time units>>)
  146. include::{docdir}/ml/ml-shared.asciidoc[tag=background-persist-interval]
  147. [[put-customsettings]]`custom_settings`::
  148. (Optional, object)
  149. include::{docdir}/ml/ml-shared.asciidoc[tag=custom-settings]
  150. [[put-datadescription]]`data_description`::
  151. (Required, object)
  152. include::{docdir}/ml/ml-shared.asciidoc[tag=data-description]
  153. `description`::
  154. (Optional, string) A description of the job.
  155. `groups`::
  156. (Optional, array of strings)
  157. include::{docdir}/ml/ml-shared.asciidoc[tag=groups]
  158. `model_plot_config`::
  159. (Optional, object)
  160. include::{docdir}/ml/ml-shared.asciidoc[tag=model-plot-config]
  161. `model_plot_config`.`enabled`:::
  162. (boolean)
  163. include::{docdir}/ml/ml-shared.asciidoc[tag=model-plot-config-enabled]
  164. `model_plot_config`.`terms`:::
  165. experimental[] (string)
  166. include::{docdir}/ml/ml-shared.asciidoc[tag=model-plot-config-terms]
  167. `model_snapshot_retention_days`::
  168. (Optional, long)
  169. include::{docdir}/ml/ml-shared.asciidoc[tag=model-snapshot-retention-days]
  170. `renormalization_window_days`::
  171. (Optional, long)
  172. include::{docdir}/ml/ml-shared.asciidoc[tag=renormalization-window-days]
  173. `results_index_name`::
  174. (Optional, string)
  175. include::{docdir}/ml/ml-shared.asciidoc[tag=results-index-name]
  176. `results_retention_days`::
  177. (Optional, long)
  178. include::{docdir}/ml/ml-shared.asciidoc[tag=results-retention-days]
  179. [[ml-put-job-example]]
  180. ==== {api-examples-title}
  181. [source,console]
  182. --------------------------------------------------
  183. PUT _ml/anomaly_detectors/total-requests
  184. {
  185. "description" : "Total sum of requests",
  186. "analysis_config" : {
  187. "bucket_span":"10m",
  188. "detectors": [
  189. {
  190. "detector_description": "Sum of total",
  191. "function": "sum",
  192. "field_name": "total"
  193. }
  194. ]
  195. },
  196. "data_description" : {
  197. "time_field":"timestamp",
  198. "time_format": "epoch_ms"
  199. }
  200. }
  201. --------------------------------------------------
  202. When the job is created, you receive the following results:
  203. [source,console-result]
  204. ----
  205. {
  206. "job_id" : "total-requests",
  207. "job_type" : "anomaly_detector",
  208. "job_version" : "8.0.0",
  209. "description" : "Total sum of requests",
  210. "create_time" : 1562352500629,
  211. "analysis_config" : {
  212. "bucket_span" : "10m",
  213. "detectors" : [
  214. {
  215. "detector_description" : "Sum of total",
  216. "function" : "sum",
  217. "field_name" : "total",
  218. "detector_index" : 0
  219. }
  220. ],
  221. "influencers" : [ ]
  222. },
  223. "analysis_limits" : {
  224. "model_memory_limit" : "1024mb",
  225. "categorization_examples_limit" : 4
  226. },
  227. "data_description" : {
  228. "time_field" : "timestamp",
  229. "time_format" : "epoch_ms"
  230. },
  231. "model_snapshot_retention_days" : 1,
  232. "results_index_name" : "shared",
  233. "allow_lazy_open" : false
  234. }
  235. ----
  236. // TESTRESPONSE[s/"job_version" : "8.0.0"/"job_version" : $body.job_version/]
  237. // TESTRESPONSE[s/1562352500629/$body.$_path/]