get-snapshot.asciidoc 7.3 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240
  1. [role="xpack"]
  2. [testenv="platinum"]
  3. [[ml-get-snapshot]]
  4. === Get model snapshots API
  5. ++++
  6. <titleabbrev>Get model snapshots</titleabbrev>
  7. ++++
  8. Retrieves information about model snapshots.
  9. [[ml-get-snapshot-request]]
  10. ==== {api-request-title}
  11. `GET _ml/anomaly_detectors/<job_id>/model_snapshots` +
  12. `GET _ml/anomaly_detectors/<job_id>/model_snapshots/<snapshot_id>`
  13. [[ml-get-snapshot-prereqs]]
  14. ==== {api-prereq-title}
  15. * If the {es} {security-features} are enabled, you must have `monitor_ml`,
  16. `monitor`, `manage_ml`, or `manage` cluster privileges to use this API. See
  17. <<security-privileges>>.
  18. [[ml-get-snapshot-path-parms]]
  19. ==== {api-path-parms-title}
  20. `<job_id>`::
  21. (Required, string)
  22. include::{docdir}/ml/ml-shared.asciidoc[tag=job-id-anomaly-detection]
  23. `<snapshot_id>`::
  24. (Optional, string)
  25. include::{docdir}/ml/ml-shared.asciidoc[tag=snapshot-id]
  26. +
  27. --
  28. If you do not specify this optional parameter, the API returns information about
  29. all model snapshots.
  30. --
  31. [[ml-get-snapshot-request-body]]
  32. ==== {api-request-body-title}
  33. `desc`::
  34. (Optional, boolean) If true, the results are sorted in descending order.
  35. `end`::
  36. (Optional, date) Returns snapshots with timestamps earlier than this time.
  37. `from`::
  38. (Optional, integer) Skips the specified number of snapshots.
  39. `size`::
  40. (Optional, integer) Specifies the maximum number of snapshots to obtain.
  41. `sort`::
  42. (Optional, string) Specifies the sort field for the requested snapshots. By
  43. default, the snapshots are sorted by their timestamp.
  44. `start`::
  45. (Optional, string) Returns snapshots with timestamps after this time.
  46. [[ml-get-snapshot-results]]
  47. ==== {api-response-body-title}
  48. The API returns an array of model snapshot objects, which have the following
  49. properties:
  50. `description`::
  51. (string) An optional description of the job.
  52. `job_id`::
  53. (string) A numerical character string that uniquely identifies the job that
  54. the snapshot was created for.
  55. `latest_record_time_stamp`::
  56. (date) The timestamp of the latest processed record.
  57. `latest_result_time_stamp`::
  58. (date) The timestamp of the latest bucket result.
  59. `min_version`::
  60. (string) The minimum version required to be able to restore the model snapshot.
  61. `model_size_stats`::
  62. (object) Summary information describing the model.
  63. `model_size_stats`.`bucket_allocation_failures_count`:::
  64. (long) The number of buckets for which entities were not processed due to memory
  65. limit constraints.
  66. `model_size_stats`.`categorized_doc_count`:::
  67. (long) The number of documents that have had a field categorized.
  68. `model_size_stats`.`categorization_status`:::
  69. (string) The status of categorization for this job.
  70. Contains one of the following values.
  71. +
  72. --
  73. * `ok`: Categorization is performing acceptably well (or not being
  74. used at all).
  75. * `warn`: Categorization is detecting a distribution of categories
  76. that suggests the input data is inappropriate for categorization.
  77. Problems could be that there is only one category, more than 90% of
  78. categories are rare, the number of categories is greater than 50% of
  79. the number of categorized documents, there are no frequently
  80. matched categories, or more than 50% of categories are dead.
  81. --
  82. `model_size_stats`.`dead_category_count`:::
  83. (long) The number of categories created by categorization that will
  84. never be assigned again because another category's definition
  85. makes it a superset of the dead category. (Dead categories are a
  86. side effect of the way categorization has no prior training.)
  87. `model_size_stats`.`frequent_category_count`:::
  88. (long) The number of categories that match more than 1% of categorized
  89. documents.
  90. `model_size_stats`.`job_id`:::
  91. (string)
  92. include::{docdir}/ml/ml-shared.asciidoc[tag=job-id-anomaly-detection]
  93. `model_size_stats`.`log_time`:::
  94. (date) The timestamp that the `model_size_stats` were recorded, according to
  95. server-time.
  96. `model_size_stats`.`memory_status`:::
  97. (string) The status of the memory in relation to its `model_memory_limit`.
  98. Contains one of the following values.
  99. +
  100. --
  101. * `hard_limit`: The internal models require more space that the configured
  102. memory limit. Some incoming data could not be processed.
  103. * `ok`: The internal models stayed below the configured value.
  104. * `soft_limit`: The internal models require more than 60% of the configured
  105. memory limit and more aggressive pruning will be performed in order to try to
  106. reclaim space.
  107. --
  108. `model_size_stats`.`model_bytes`:::
  109. (long) An approximation of the memory resources required for this analysis.
  110. `model_size_stats`.`model_bytes_exceeded`:::
  111. (long) The number of bytes over the high limit for memory usage at the last allocation failure.
  112. `model_size_stats`.`model_bytes_memory_limit`:::
  113. (long) The upper limit for memory usage, checked on increasing values.
  114. `model_size_stats`.`rare_category_count`:::
  115. (long) The number of categories that match just one categorized document.
  116. `model_size_stats`.`result_type`:::
  117. (string) Internal. This value is always `model_size_stats`.
  118. `model_size_stats`.`timestamp`:::
  119. (date) The timestamp that the `model_size_stats` were recorded, according to the
  120. bucket timestamp of the data.
  121. `model_size_stats`.`total_by_field_count`:::
  122. (long) The number of _by_ field values analyzed. Note that these are counted
  123. separately for each detector and partition.
  124. `model_size_stats`.`total_category_count`:::
  125. (long) The number of categories created by categorization.
  126. `model_size_stats`.`total_over_field_count`:::
  127. (long) The number of _over_ field values analyzed. Note that these are counted
  128. separately for each detector and partition.
  129. `model_size_stats`.`total_partition_field_count`:::
  130. (long) The number of _partition_ field values analyzed.
  131. `retain`::
  132. (boolean)
  133. include::{docdir}/ml/ml-shared.asciidoc[tag=retain]
  134. `snapshot_id`::
  135. (string) A numerical character string that uniquely identifies the model
  136. snapshot. For example: "1491852978".
  137. `snapshot_doc_count`::
  138. (long) For internal use only.
  139. `timestamp`::
  140. (date) The creation timestamp for the snapshot.
  141. [[ml-get-snapshot-example]]
  142. ==== {api-examples-title}
  143. [source,console]
  144. --------------------------------------------------
  145. GET _ml/anomaly_detectors/high_sum_total_sales/model_snapshots
  146. {
  147. "start": "1575402236000"
  148. }
  149. --------------------------------------------------
  150. // TEST[skip:Kibana sample data]
  151. In this example, the API provides a single result:
  152. [source,js]
  153. ----
  154. {
  155. "count" : 1,
  156. "model_snapshots" : [
  157. {
  158. "job_id" : "high_sum_total_sales",
  159. "min_version" : "6.4.0",
  160. "timestamp" : 1575402237000,
  161. "description" : "State persisted due to job close at 2019-12-03T19:43:57+0000",
  162. "snapshot_id" : "1575402237",
  163. "snapshot_doc_count" : 1,
  164. "model_size_stats" : {
  165. "job_id" : "high_sum_total_sales",
  166. "result_type" : "model_size_stats",
  167. "model_bytes" : 1638816,
  168. "model_bytes_exceeded" : 0,
  169. "model_bytes_memory_limit" : 10485760,
  170. "total_by_field_count" : 3,
  171. "total_over_field_count" : 3320,
  172. "total_partition_field_count" : 2,
  173. "bucket_allocation_failures_count" : 0,
  174. "memory_status" : "ok",
  175. "categorized_doc_count" : 0,
  176. "total_category_count" : 0,
  177. "frequent_category_count" : 0,
  178. "rare_category_count" : 0,
  179. "dead_category_count" : 0,
  180. "categorization_status" : "ok",
  181. "log_time" : 1575402237000,
  182. "timestamp" : 1576965600000
  183. },
  184. "latest_record_time_stamp" : 1576971072000,
  185. "latest_result_time_stamp" : 1576965600000,
  186. "retain" : false
  187. }
  188. ]
  189. }
  190. ----