snapshotresource.asciidoc 3.6 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104
  1. [role="xpack"]
  2. [testenv="platinum"]
  3. [[ml-snapshot-resource]]
  4. === Model snapshot resources
  5. Model snapshots are saved to an internal index within the Elasticsearch cluster.
  6. By default, this is occurs approximately every 3 hours to 4 hours and is
  7. configurable with the `background_persist_interval` property.
  8. By default, model snapshots are retained for one day (twenty-four hours). You
  9. can change this behavior by updating the `model_snapshot_retention_days` for the
  10. job. When choosing a new value, consider the following:
  11. * Persistence enables resilience in the event of a system failure.
  12. * Persistence enables snapshots to be reverted.
  13. * The time taken to persist a job is proportional to the size of the model in memory.
  14. A model snapshot resource has the following properties:
  15. `description`::
  16. (string) An optional description of the job.
  17. `job_id`::
  18. (string) A numerical character string that uniquely identifies the job that
  19. the snapshot was created for.
  20. `min_version`::
  21. (string) The minimum version required to be able to restore the model snapshot.
  22. `latest_record_time_stamp`::
  23. (date) The timestamp of the latest processed record.
  24. `latest_result_time_stamp`::
  25. (date) The timestamp of the latest bucket result.
  26. `model_size_stats`::
  27. (object) Summary information describing the model.
  28. See <<ml-snapshot-stats,Model Size Statistics>>.
  29. `retain`::
  30. (boolean) If true, this snapshot will not be deleted during automatic cleanup
  31. of snapshots older than `model_snapshot_retention_days`.
  32. However, this snapshot will be deleted when the job is deleted.
  33. The default value is false.
  34. `snapshot_id`::
  35. (string) A numerical character string that uniquely identifies the model
  36. snapshot. For example: "1491852978".
  37. `snapshot_doc_count`::
  38. (long) For internal use only.
  39. `timestamp`::
  40. (date) The creation timestamp for the snapshot.
  41. NOTE: All of these properties are informational with the exception of
  42. `description` and `retain`.
  43. [float]
  44. [[ml-snapshot-stats]]
  45. ==== Model Size Statistics
  46. The `model_size_stats` object has the following properties:
  47. `bucket_allocation_failures_count`::
  48. (long) The number of buckets for which entities were not processed due to
  49. memory limit constraints.
  50. `job_id`::
  51. (string) A numerical character string that uniquely identifies the job.
  52. `log_time`::
  53. (date) The timestamp that the `model_size_stats` were recorded, according to
  54. server-time.
  55. `memory_status`::
  56. (string) The status of the memory in relation to its `model_memory_limit`.
  57. Contains one of the following values.
  58. `ok`::: The internal models stayed below the configured value.
  59. `soft_limit`::: The internal models require more than 60% of the configured
  60. memory limit and more aggressive pruning will
  61. be performed in order to try to reclaim space.
  62. `hard_limit`::: The internal models require more space that the configured
  63. memory limit. Some incoming data could not be processed.
  64. `model_bytes`::
  65. (long) An approximation of the memory resources required for this analysis.
  66. `result_type`::
  67. (string) Internal. This value is always set to "model_size_stats".
  68. `timestamp`::
  69. (date) The timestamp that the `model_size_stats` were recorded, according to the bucket timestamp of the data.
  70. `total_by_field_count`::
  71. (long) The number of _by_ field values analyzed. Note that these are counted separately for each detector and partition.
  72. `total_over_field_count`::
  73. (long) The number of _over_ field values analyzed. Note that these are counted separately for each detector and partition.
  74. `total_partition_field_count`::
  75. (long) The number of _partition_ field values analyzed.
  76. NOTE: All of these properties are informational; you cannot change their values.