index-templates.asciidoc 4.9 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163
  1. [[index-templates]]
  2. = Index templates
  3. NOTE: This topic describes the composable index templates introduced in {es} 7.8.
  4. For information about how index templates worked previously,
  5. see the <<indices-templates-v1,legacy template documentation>>.
  6. [[getting]]
  7. An index template is a way to tell {es} how to configure an index when it is
  8. created. For data streams, the index template configures the stream's backing
  9. indices as they are created. Templates are configured
  10. *prior to index creation*. When an index is created - either manually or
  11. through indexing a document - the template settings are used as a basis for
  12. creating the index.
  13. There are two types of templates: index templates and <<indices-component-template,component templates>>. Component templates are reusable building
  14. blocks that configure mappings, settings, and aliases. While you can use
  15. component templates to construct index templates, they aren't directly applied
  16. to a set of indices. Index templates can contain a collection of component
  17. templates, as well as directly specify settings, mappings, and aliases.
  18. The following conditions apply to index templates:
  19. * Composable templates take precedence over legacy templates. If no composable
  20. template matches a given index, a legacy template may still match and be
  21. applied.
  22. * If an index is created with explicit settings and also matches an index
  23. template, the settings from the <<indices-create-index,create index>> request
  24. take precedence over settings specified in the index template and its component
  25. templates.
  26. * If a new data stream or index matches more than one index template, the index
  27. template with the highest priority is used.
  28. [[avoid-index-pattern-collisions]]
  29. .Avoid index pattern collisions
  30. ****
  31. {es} has built-in index templates, each with a priority of `100`, for the
  32. following index patterns:
  33. // tag::built-in-index-template-patterns[]
  34. - `logs-*-*`
  35. - `metrics-*-*`
  36. - `synthetics-*-*`
  37. // end::built-in-index-template-patterns[]
  38. {fleet-guide}/fleet-overview.html[{agent}] uses these templates to create
  39. data streams. Index templates created by {fleet} integrations use similar
  40. overlapping index patterns and have a priority up to `200`.
  41. If you use {fleet} or {agent}, assign your index templates a priority lower than
  42. `100` to avoid overriding these templates. Otherwise, to avoid accidentally
  43. applying the templates, do one or more of the following:
  44. - To disable all built-in index and component templates, set
  45. <<stack-templates-enabled,`stack.templates.enabled`>> to `false` using the
  46. <<cluster-update-settings,cluster update settings API>>.
  47. - Use a non-overlapping index pattern.
  48. - Assign templates with an overlapping pattern a `priority` higher than `200`.
  49. For example, if you don't use {fleet} or {agent} and want to create a template
  50. for the `logs-*` index pattern, assign your template a priority of `500`. This
  51. ensures your template is applied instead of the built-in template for
  52. `logs-*-*`.
  53. ****
  54. [discrete]
  55. [[create-index-templates]]
  56. == Create index template
  57. Use the <<indices-put-template,index template>> and <<indices-component-template,put component template>> APIs to create and update index templates.
  58. You can also <<index-mgmt,manage index templates>> from Stack
  59. Management in {kib}.
  60. The following requests create two component templates.
  61. [source,console]
  62. ----
  63. PUT _component_template/component_template1
  64. {
  65. "template": {
  66. "mappings": {
  67. "properties": {
  68. "@timestamp": {
  69. "type": "date"
  70. }
  71. }
  72. }
  73. }
  74. }
  75. PUT _component_template/runtime_component_template
  76. {
  77. "template": {
  78. "mappings": {
  79. "runtime": { <1>
  80. "day_of_week": {
  81. "type": "keyword",
  82. "script": {
  83. "source": "emit(doc['@timestamp'].value.dayOfWeekEnum.getDisplayName(TextStyle.FULL, Locale.ROOT))"
  84. }
  85. }
  86. }
  87. }
  88. }
  89. }
  90. ----
  91. <1> This component template adds a <<runtime-mapping-fields,runtime field>>
  92. named `day_of_week` to the mappings when a new index matches the template.
  93. The following request creates an index template that is _composed of_ these
  94. component templates.
  95. [source,console]
  96. ----
  97. PUT _index_template/template_1
  98. {
  99. "index_patterns": ["te*", "bar*"],
  100. "template": {
  101. "settings": {
  102. "number_of_shards": 1
  103. },
  104. "mappings": {
  105. "_source": {
  106. "enabled": true
  107. },
  108. "properties": {
  109. "host_name": {
  110. "type": "keyword"
  111. },
  112. "created_at": {
  113. "type": "date",
  114. "format": "EEE MMM dd HH:mm:ss Z yyyy"
  115. }
  116. }
  117. },
  118. "aliases": {
  119. "mydata": { }
  120. }
  121. },
  122. "priority": 500,
  123. "composed_of": ["component_template1", "runtime_component_template"], <1>
  124. "version": 3,
  125. "_meta": {
  126. "description": "my custom"
  127. }
  128. }
  129. ----
  130. // TEST[continued]
  131. ////
  132. [source,console]
  133. ----
  134. DELETE _index_template/template_1
  135. DELETE _component_template/runtime_component_template
  136. DELETE _component_template/component_template1
  137. ----
  138. // TEST[continued]
  139. ////
  140. include::simulate-multi-component-templates.asciidoc[]