using.asciidoc 8.8 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285
  1. [[modules-scripting-using]]
  2. === How to use scripts
  3. Wherever scripting is supported in the Elasticsearch API, the syntax follows
  4. the same pattern:
  5. [source,js]
  6. -------------------------------------
  7. "script": {
  8. "lang": "...", <1>
  9. "inline" | "stored" | "file": "...", <2>
  10. "params": { ... } <3>
  11. }
  12. -------------------------------------
  13. // NOTCONSOLE
  14. <1> The language the script is written in, which defaults to `painless`.
  15. <2> The script itself which may be specified as `inline`, `stored`, or `file`.
  16. <3> Any named parameters that should be passed into the script.
  17. For example, the following script is used in a search request to return a
  18. <<search-request-script-fields, scripted field>>:
  19. [source,js]
  20. -------------------------------------
  21. PUT my_index/my_type/1
  22. {
  23. "my_field": 5
  24. }
  25. GET my_index/_search
  26. {
  27. "script_fields": {
  28. "my_doubled_field": {
  29. "script": {
  30. "lang": "expression",
  31. "inline": "doc['my_field'] * multiplier",
  32. "params": {
  33. "multiplier": 2
  34. }
  35. }
  36. }
  37. }
  38. }
  39. -------------------------------------
  40. // CONSOLE
  41. [float]
  42. === Script Parameters
  43. `lang`::
  44. Specifies the language the script is written in. Defaults to `painless` but
  45. may be set to any of languages listed in <<modules-scripting>>. The
  46. default language may be changed in the `elasticsearch.yml` config file by
  47. setting `script.default_lang` to the appropriate language.
  48. `inline`, `stored`, `file`::
  49. Specifies the source of the script. An `inline` script is specified
  50. `inline` as in the example above, a `stored` script is specified `stored`
  51. and is retrieved from the cluster state (see <<modules-scripting-stored-scripts,Stored Scripts>>),
  52. and a `file` script is retrieved from a file in the `config/scripts`
  53. directory (see <<modules-scripting-file-scripts, File Scripts>>).
  54. +
  55. While languages like `expression` and `painless` can be used out of the box as
  56. inline or stored scripts, other languages can only be
  57. specified as `file` unless you first adjust the default
  58. <<modules-scripting-security,scripting security settings>>.
  59. `params`::
  60. Specifies any named parameters that are passed into the script as
  61. variables.
  62. [IMPORTANT]
  63. [[prefer-params]]
  64. .Prefer parameters
  65. ========================================
  66. The first time Elasticsearch sees a new script, it compiles it and stores the
  67. compiled version in a cache. Compilation can be a heavy process.
  68. If you need to pass variables into the script, you should pass them in as
  69. named `params` instead of hard-coding values into the script itself. For
  70. example, if you want to be able to multiply a field value by different
  71. multipliers, don't hard-code the multiplier into the script:
  72. [source,js]
  73. ----------------------
  74. "inline": "doc['my_field'] * 2"
  75. ----------------------
  76. // NOTCONSOLE
  77. Instead, pass it in as a named parameter:
  78. [source,js]
  79. ----------------------
  80. "inline": "doc['my_field'] * multiplier",
  81. "params": {
  82. "multiplier": 2
  83. }
  84. ----------------------
  85. // NOTCONSOLE
  86. The first version has to be recompiled every time the multiplier changes. The
  87. second version is only compiled once.
  88. If you compile too many unique scripts within a small amount of time,
  89. Elasticsearch will reject the new dynamic scripts with a
  90. `circuit_breaking_exception` error. By default, up to 15 inline scripts per
  91. minute will be compiled. You can change this setting dynamically by setting
  92. `script.max_compilations_per_minute`.
  93. ========================================
  94. [float]
  95. [[modules-scripting-file-scripts]]
  96. === File-based Scripts
  97. To increase security, non-sandboxed languages can only be specified in script
  98. files stored on every node in the cluster. File scripts must be saved in the
  99. `scripts` directory whose default location depends on whether you use the
  100. <<zip-targz-layout,`zip`/`tar.gz`>> (`$ES_HOME/config/scripts/`),
  101. <<rpm-layout,RPM>>, or <<deb-layout,Debian>> package. The default may be
  102. changed with the `path.scripts` setting.
  103. The languages which are assumed to be safe by default are: `painless`,
  104. `expression`, and `mustache` (used for search and query templates).
  105. Any files placed in the `scripts` directory will be compiled automatically
  106. when the node starts up and then <<reload-scripts,every 60 seconds thereafter>>.
  107. The file should be named as follows: `{script-name}.{lang}`. For instance,
  108. the following example creates a Groovy script called `calculate-score`:
  109. [source,sh]
  110. --------------------------------------------------
  111. cat "Math.log(_score * 2) + params.my_modifier" > config/scripts/calculate_score.painless
  112. --------------------------------------------------
  113. This script can be used as follows:
  114. [source,js]
  115. --------------------------------------------------
  116. GET my_index/_search
  117. {
  118. "query": {
  119. "script": {
  120. "script": {
  121. "lang": "painless", <1>
  122. "file": "calculate_score", <2>
  123. "params": {
  124. "my_modifier": 2
  125. }
  126. }
  127. }
  128. }
  129. }
  130. --------------------------------------------------
  131. // CONSOLE
  132. // TEST[continued]
  133. <1> The language of the script, which should correspond with the script file suffix.
  134. <2> The name of the script, which should be the name of the file.
  135. The `script` directory may contain sub-directories, in which case the
  136. hierarchy of directories is flattened and concatenated with underscores. A
  137. script in `group1/group2/my_script.painless` should use `group1_group2_myscript`
  138. as the `file` name.
  139. [[reload-scripts]]
  140. [float]
  141. ==== Automatic script reloading
  142. The `scripts` directory will be rescanned every `60s` (configurable with the
  143. `resource.reload.interval` setting) and new, changed, or removed scripts will
  144. be compiled, updated, or deleted from the script cache.
  145. Script reloading can be completely disabled by setting
  146. `script.auto_reload_enabled` to `false`.
  147. [float]
  148. [[modules-scripting-stored-scripts]]
  149. === Stored Scripts
  150. Scripts may be stored in and retrieved from the cluster state using the
  151. `_scripts` end-point.
  152. ==== Deprecated Namespace
  153. The namespace for stored scripts using both `lang` and `id` as a unique
  154. identifier has been deprecated. The new namespace for stored scripts will
  155. only use `id`. Stored scripts with the same `id`, but different `lang`'s
  156. will no longer be allowed in 6.0. To comply with the new namespace for
  157. stored scripts, existing stored scripts should be deleted and put again.
  158. Any scripts that share an `id` but have different `lang`s will need to
  159. be re-named. For example, take the following:
  160. "id": "example", "lang": "painless"
  161. "id": "example", "lang": "expressions"
  162. The above scripts will conflict under the new namespace since the id's are
  163. the same. At least one will have to be re-named to comply with the new
  164. namespace of only `id`.
  165. As a final caveat, stored search templates and stored scripts share
  166. the same namespace, so if a search template has the same `id` as a
  167. stored script, one of the two will have to be re-named as well using
  168. delete and put requests.
  169. ==== Request Examples
  170. The following are examples of using a stored script that lives at
  171. `/_scripts/{id}`.
  172. First, create the script called `calculate-score` in the cluster state:
  173. [source,js]
  174. -----------------------------------
  175. POST _scripts/calculate-score
  176. {
  177. "script": {
  178. "lang": "painless",
  179. "code": "Math.log(_score * 2) + params.my_modifier"
  180. }
  181. }
  182. -----------------------------------
  183. // CONSOLE
  184. This same script can be retrieved with:
  185. [source,js]
  186. -----------------------------------
  187. GET _scripts/calculate-score
  188. -----------------------------------
  189. // CONSOLE
  190. // TEST[continued]
  191. Stored scripts can be used by specifying the `stored` parameters as follows:
  192. [source,js]
  193. --------------------------------------------------
  194. GET _search
  195. {
  196. "query": {
  197. "script": {
  198. "script": {
  199. "stored": "calculate-score",
  200. "params": {
  201. "my_modifier": 2
  202. }
  203. }
  204. }
  205. }
  206. }
  207. --------------------------------------------------
  208. // CONSOLE
  209. // TEST[continued]
  210. And deleted with:
  211. [source,js]
  212. -----------------------------------
  213. DELETE _scripts/calculate-score
  214. -----------------------------------
  215. // CONSOLE
  216. // TEST[continued]
  217. [float]
  218. [[modules-scripting-using-caching]]
  219. === Script Caching
  220. All scripts are cached by default so that they only need to be recompiled
  221. when updates occur. File scripts keep a static cache and will always reside
  222. in memory. Both inline and stored scripts are stored in a cache that can evict
  223. residing scripts. By default, scripts do not have a time-based expiration, but
  224. you can change this behavior by using the `script.cache.expire` setting.
  225. You can configure the size of this cache by using the `script.cache.max_size` setting.
  226. By default, the cache size is `100`.
  227. NOTE: The size of stored scripts is limited to 65,535 bytes. This can be
  228. changed by setting `script.max_size_in_bytes` setting to increase that soft
  229. limit, but if scripts are really large then alternatives like
  230. <<modules-scripting-native,native>> scripts should be considered instead.