put-data-frame-analytics.asciidoc 6.7 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165
  1. --
  2. :api: put-data-frame-analytics
  3. :request: PutDataFrameAnalyticsRequest
  4. :response: PutDataFrameAnalyticsResponse
  5. --
  6. [role="xpack"]
  7. [id="{upid}-{api}"]
  8. === Put {dfanalytics-jobs} API
  9. Creates a new {dfanalytics-job}.
  10. The API accepts a +{request}+ object as a request and returns a +{response}+.
  11. [id="{upid}-{api}-request"]
  12. ==== Put {dfanalytics-jobs} request
  13. A +{request}+ requires the following argument:
  14. ["source","java",subs="attributes,callouts,macros"]
  15. --------------------------------------------------
  16. include-tagged::{doc-tests-file}[{api}-request]
  17. --------------------------------------------------
  18. <1> The configuration of the {dfanalytics-job} to create
  19. [id="{upid}-{api}-config"]
  20. ==== {dfanalytics-cap} configuration
  21. The `DataFrameAnalyticsConfig` object contains all the details about the {dfanalytics-job}
  22. configuration and contains the following arguments:
  23. ["source","java",subs="attributes,callouts,macros"]
  24. --------------------------------------------------
  25. include-tagged::{doc-tests-file}[{api}-config]
  26. --------------------------------------------------
  27. <1> The {dfanalytics-job} ID
  28. <2> The source index and query from which to gather data
  29. <3> The destination index
  30. <4> The analysis to be performed
  31. <5> The fields to be included in / excluded from the analysis
  32. <6> The memory limit for the model created as part of the analysis process
  33. <7> Optionally, a human-readable description
  34. [id="{upid}-{api}-query-config"]
  35. ==== SourceConfig
  36. The index and the query from which to collect data.
  37. ["source","java",subs="attributes,callouts,macros"]
  38. --------------------------------------------------
  39. include-tagged::{doc-tests-file}[{api}-source-config]
  40. --------------------------------------------------
  41. <1> Constructing a new DataFrameAnalyticsSource
  42. <2> The source index
  43. <3> The query from which to gather the data. If query is not set, a `match_all` query is used by default.
  44. <4> Source filtering to select which fields will exist in the destination index.
  45. ===== QueryConfig
  46. The query with which to select data from the source.
  47. ["source","java",subs="attributes,callouts,macros"]
  48. --------------------------------------------------
  49. include-tagged::{doc-tests-file}[{api}-query-config]
  50. --------------------------------------------------
  51. ==== DestinationConfig
  52. The index to which data should be written by the {dfanalytics-job}.
  53. ["source","java",subs="attributes,callouts,macros"]
  54. --------------------------------------------------
  55. include-tagged::{doc-tests-file}[{api}-dest-config]
  56. --------------------------------------------------
  57. <1> Constructing a new DataFrameAnalyticsDest
  58. <2> The destination index
  59. ==== Analysis
  60. The analysis to be performed.
  61. Currently, the supported analyses include: +OutlierDetection+, +Classification+, +Regression+.
  62. ===== Outlier detection
  63. +OutlierDetection+ analysis can be created in one of two ways:
  64. ["source","java",subs="attributes,callouts,macros"]
  65. --------------------------------------------------
  66. include-tagged::{doc-tests-file}[{api}-outlier-detection-default]
  67. --------------------------------------------------
  68. <1> Constructing a new OutlierDetection object with default strategy to determine outliers
  69. or
  70. ["source","java",subs="attributes,callouts,macros"]
  71. --------------------------------------------------
  72. include-tagged::{doc-tests-file}[{api}-outlier-detection-customized]
  73. --------------------------------------------------
  74. <1> Constructing a new OutlierDetection object
  75. <2> The method used to perform the analysis
  76. <3> Number of neighbors taken into account during analysis
  77. <4> The min `outlier_score` required to compute feature influence
  78. <5> Whether to compute feature influence
  79. <6> The proportion of the data set that is assumed to be outlying prior to outlier detection
  80. <7> Whether to apply standardization to feature values
  81. ===== Classification
  82. +Classification+ analysis requires to set which is the +dependent_variable+ and
  83. has a number of other optional parameters:
  84. ["source","java",subs="attributes,callouts,macros"]
  85. --------------------------------------------------
  86. include-tagged::{doc-tests-file}[{api}-classification]
  87. --------------------------------------------------
  88. <1> Constructing a new Classification builder object with the required dependent variable
  89. <2> The lambda regularization parameter. A non-negative double.
  90. <3> The gamma regularization parameter. A non-negative double.
  91. <4> The applied shrinkage. A double in [0.001, 1].
  92. <5> The maximum number of trees the forest is allowed to contain. An integer in [1, 2000].
  93. <6> The fraction of features which will be used when selecting a random bag for each candidate split. A double in (0, 1].
  94. <7> If set, feature importance for the top most important features will be computed.
  95. <8> The name of the prediction field in the results object.
  96. <9> The percentage of training-eligible rows to be used in training. Defaults to 100%.
  97. <10> The seed to be used by the random generator that picks which rows are used in training.
  98. <11> The number of top classes to be reported in the results. Defaults to 2.
  99. ===== Regression
  100. +Regression+ analysis requires to set which is the +dependent_variable+ and
  101. has a number of other optional parameters:
  102. ["source","java",subs="attributes,callouts,macros"]
  103. --------------------------------------------------
  104. include-tagged::{doc-tests-file}[{api}-regression]
  105. --------------------------------------------------
  106. <1> Constructing a new Regression builder object with the required dependent variable
  107. <2> The lambda regularization parameter. A non-negative double.
  108. <3> The gamma regularization parameter. A non-negative double.
  109. <4> The applied shrinkage. A double in [0.001, 1].
  110. <5> The maximum number of trees the forest is allowed to contain. An integer in [1, 2000].
  111. <6> The fraction of features which will be used when selecting a random bag for each candidate split. A double in (0, 1].
  112. <7> If set, feature importance for the top most important features will be computed.
  113. <8> The name of the prediction field in the results object.
  114. <9> The percentage of training-eligible rows to be used in training. Defaults to 100%.
  115. <10> The seed to be used by the random generator that picks which rows are used in training.
  116. ==== Analyzed fields
  117. FetchContext object containing fields to be included in / excluded from the analysis
  118. ["source","java",subs="attributes,callouts,macros"]
  119. --------------------------------------------------
  120. include-tagged::{doc-tests-file}[{api}-analyzed-fields]
  121. --------------------------------------------------
  122. include::../execution.asciidoc[]
  123. [id="{upid}-{api}-response"]
  124. ==== Response
  125. The returned +{response}+ contains the newly created {dfanalytics-job}.
  126. ["source","java",subs="attributes,callouts,macros"]
  127. --------------------------------------------------
  128. include-tagged::{doc-tests-file}[{api}-response]
  129. --------------------------------------------------