index-templates.asciidoc 5.2 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170
  1. [[index-templates]]
  2. = Index templates
  3. NOTE: This topic describes the composable index templates introduced in {es} 7.8.
  4. For information about how index templates worked previously,
  5. see the <<indices-templates-v1,legacy template documentation>>.
  6. [[getting]]
  7. An index template is a way to tell {es} how to configure an index when it is
  8. created. For data streams, the index template configures the stream's backing
  9. indices as they are created. Templates are configured
  10. *prior to index creation*. When an index is created - either manually or
  11. through indexing a document - the template settings are used as a basis for
  12. creating the index.
  13. There are two types of templates: index templates and <<indices-component-template,component templates>>. Component templates are reusable building
  14. blocks that configure mappings, settings, and aliases. While you can use
  15. component templates to construct index templates, they aren't directly applied
  16. to a set of indices. Index templates can contain a collection of component
  17. templates, as well as directly specify settings, mappings, and aliases.
  18. The following conditions apply to index templates:
  19. * Composable templates take precedence over legacy templates. If no composable
  20. template matches a given index, a legacy template may still match and be
  21. applied.
  22. * If an index is created with explicit settings and also matches an index
  23. template, the settings from the <<indices-create-index,create index>> request
  24. take precedence over settings specified in the index template and its component
  25. templates.
  26. * Settings specified in the index template itself take precedence over the settings
  27. in its component templates.
  28. * If a new data stream or index matches more than one index template, the index
  29. template with the highest priority is used.
  30. [[avoid-index-pattern-collisions]]
  31. .Avoid index pattern collisions
  32. ****
  33. {es} has built-in index templates, each with a priority of `100`, for the
  34. following index patterns:
  35. // tag::built-in-index-template-patterns[]
  36. - `logs-*-*`
  37. - `metrics-*-*`
  38. - `synthetics-*-*`
  39. - `profiling-*`
  40. - `security_solution-*-*`
  41. // end::built-in-index-template-patterns[]
  42. {fleet-guide}/fleet-overview.html[{agent}] uses these templates to create
  43. data streams. Index templates created by {fleet} integrations use similar
  44. overlapping index patterns and have a priority up to `200`.
  45. If you use {fleet} or {agent}, assign your index templates a priority lower than
  46. `100` to avoid overriding these templates. Otherwise, to avoid accidentally
  47. applying the templates, do one or more of the following:
  48. - To disable all built-in index and component templates, set
  49. <<stack-templates-enabled,`stack.templates.enabled`>> to `false` using the
  50. <<cluster-update-settings,cluster update settings API>>.
  51. - Use a non-overlapping index pattern.
  52. - Assign templates with an overlapping pattern a `priority` higher than `500`.
  53. For example, if you don't use {fleet} or {agent} and want to create a template
  54. for the `logs-*` index pattern, assign your template a priority of `500`. This
  55. ensures your template is applied instead of the built-in template for
  56. `logs-*-*`.
  57. - To avoid naming collisions with built-in and Fleet-managed index templates, avoid using `@` as part of the name of your own index templates.
  58. ****
  59. [discrete]
  60. [[create-index-templates]]
  61. == Create index template
  62. Use the <<indices-put-template,index template>> and <<indices-component-template,put component template>> APIs to create and update index templates.
  63. You can also <<index-mgmt,manage index templates>> from Stack
  64. Management in {kib}.
  65. The following requests create two component templates.
  66. [source,console]
  67. ----
  68. PUT _component_template/component_template1
  69. {
  70. "template": {
  71. "mappings": {
  72. "properties": {
  73. "@timestamp": {
  74. "type": "date"
  75. }
  76. }
  77. }
  78. }
  79. }
  80. PUT _component_template/runtime_component_template
  81. {
  82. "template": {
  83. "mappings": {
  84. "runtime": { <1>
  85. "day_of_week": {
  86. "type": "keyword",
  87. "script": {
  88. "source": "emit(doc['@timestamp'].value.dayOfWeekEnum.getDisplayName(TextStyle.FULL, Locale.ENGLISH))"
  89. }
  90. }
  91. }
  92. }
  93. }
  94. }
  95. ----
  96. <1> This component template adds a <<runtime-mapping-fields,runtime field>>
  97. named `day_of_week` to the mappings when a new index matches the template.
  98. The following request creates an index template that is _composed of_ these
  99. component templates.
  100. [source,console]
  101. ----
  102. PUT _index_template/template_1
  103. {
  104. "index_patterns": ["te*", "bar*"],
  105. "template": {
  106. "settings": {
  107. "number_of_shards": 1
  108. },
  109. "mappings": {
  110. "_source": {
  111. "enabled": true
  112. },
  113. "properties": {
  114. "host_name": {
  115. "type": "keyword"
  116. },
  117. "created_at": {
  118. "type": "date"
  119. }
  120. }
  121. },
  122. "aliases": {
  123. "mydata": { }
  124. }
  125. },
  126. "priority": 500,
  127. "composed_of": ["component_template1", "runtime_component_template"], <1>
  128. "version": 3,
  129. "_meta": {
  130. "description": "my custom"
  131. }
  132. }
  133. ----
  134. // TEST[continued]
  135. ////
  136. [source,console]
  137. ----
  138. DELETE _index_template/template_1
  139. DELETE _component_template/runtime_component_template
  140. DELETE _component_template/component_template1
  141. ----
  142. // TEST[continued]
  143. ////
  144. include::simulate-multi-component-templates.asciidoc[]
  145. include::ignore-missing-component-templates.asciidoc[]