rolling_upgrade.asciidoc 5.2 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173
  1. [[rolling-upgrades]]
  2. == Rolling upgrades
  3. A rolling upgrade allows an Elasticsearch cluster to be upgraded one node at
  4. a time so upgrading does not interrupt service. Running multiple versions of
  5. Elasticsearch in the same cluster beyond the duration of an upgrade is
  6. not supported, as shards cannot be replicated from upgraded nodes to nodes
  7. running the older version.
  8. Rolling upgrades can be performed between minor versions. Elasticsearch
  9. 6.x supports rolling upgrades from *Elasticsearch 5.6*.
  10. Upgrading from earlier 5.x versions requires a <<restart-upgrade,
  11. full cluster restart>>. You must <<reindex-upgrade,reindex to upgrade>> from
  12. versions prior to 5.x.
  13. WARNING: If the {es} {security-features} are enabled on your 5.x cluster, before
  14. you can do a rolling upgrade you must encrypt the internode-communication with
  15. SSL/TLS, which requires a full cluster restart. For more information about this
  16. requirement and the associated bootstrap check, see <<bootstrap-checks-tls>>.
  17. To perform a rolling upgrade:
  18. . *Disable shard allocation*.
  19. +
  20. --
  21. include::disable-shard-alloc.asciidoc[]
  22. --
  23. . *Stop non-essential indexing and perform a synced flush.* (Optional)
  24. +
  25. --
  26. While you can continue indexing during the upgrade, shard recovery
  27. is much faster if you temporarily stop non-essential indexing and perform a
  28. <<indices-synced-flush, synced-flush>>.
  29. include::synced-flush.asciidoc[]
  30. --
  31. . *Stop any machine learning jobs that are running.* See
  32. {xpack-ref}/stopping-ml.html[Stopping Machine Learning].
  33. . [[upgrade-node]] *Shut down a single node*.
  34. +
  35. --
  36. include::shut-down-node.asciidoc[]
  37. --
  38. . *Upgrade the node you shut down.*
  39. +
  40. --
  41. include::remove-xpack.asciidoc[]
  42. --
  43. +
  44. --
  45. include::upgrade-node.asciidoc[]
  46. include::set-paths-tip.asciidoc[]
  47. --
  48. . *Upgrade any plugins.*
  49. +
  50. Use the `elasticsearch-plugin` script to install the upgraded version of each
  51. installed Elasticsearch plugin. All plugins must be upgraded when you upgrade
  52. a node.
  53. . *Start the upgraded node.*
  54. +
  55. --
  56. Start the newly-upgraded node and confirm that it joins the cluster by checking
  57. the log file or by submitting a `_cat/nodes` request:
  58. [source,sh]
  59. --------------------------------------------------
  60. GET _cat/nodes
  61. --------------------------------------------------
  62. // CONSOLE
  63. --
  64. . *Reenable shard allocation.*
  65. +
  66. --
  67. Once the node has joined the cluster, remove the `cluster.routing.allocation.enable`
  68. setting to enable shard allocation and start using the node:
  69. [source,js]
  70. --------------------------------------------------
  71. PUT _cluster/settings
  72. {
  73. "persistent": {
  74. "cluster.routing.allocation.enable": null
  75. }
  76. }
  77. --------------------------------------------------
  78. // CONSOLE
  79. --
  80. . *Wait for the node to recover.*
  81. +
  82. --
  83. Before upgrading the next node, wait for the cluster to finish shard allocation.
  84. You can check progress by submitting a <<cat-health,`_cat/health`>> request:
  85. [source,sh]
  86. --------------------------------------------------
  87. GET _cat/health
  88. --------------------------------------------------
  89. // CONSOLE
  90. Wait for the `status` column to switch from `yellow` to `green`. Once the
  91. node is `green`, all primary and replica shards have been allocated.
  92. [IMPORTANT]
  93. ====================================================
  94. During a rolling upgrade, primary shards assigned to a node running the new
  95. version cannot have their replicas assigned to a node with the old
  96. version. The new version might have a different data format that is
  97. not understood by the old version.
  98. If it is not possible to assign the replica shards to another node
  99. (there is only one upgraded node in the cluster), the replica
  100. shards remain unassigned and status stays `yellow`.
  101. In this case, you can proceed once there are no initializing or relocating shards
  102. (check the `init` and `relo` columns).
  103. As soon as another node is upgraded, the replicas can be assigned and the
  104. status will change to `green`.
  105. ====================================================
  106. Shards that were not <<indices-synced-flush,sync-flushed>> might take longer to
  107. recover. You can monitor the recovery status of individual shards by
  108. submitting a <<cat-recovery,`_cat/recovery`>> request:
  109. [source,sh]
  110. --------------------------------------------------
  111. GET _cat/recovery
  112. --------------------------------------------------
  113. // CONSOLE
  114. If you stopped indexing, it is safe to resume indexing as soon as
  115. recovery completes.
  116. --
  117. . *Repeat*
  118. +
  119. --
  120. When the node has recovered and the cluster is stable, repeat these steps
  121. for each node that needs to be updated.
  122. --
  123. . *Restart machine learning jobs.*
  124. [IMPORTANT]
  125. ====================================================
  126. During a rolling upgrade, the cluster continues to operate normally. However,
  127. any new functionality is disabled or operates in a backward compatible mode
  128. until all nodes in the cluster are upgraded. New functionality
  129. becomes operational once the upgrade is complete and all nodes are running the
  130. new version. Once that has happened, there's no way to return to operating
  131. in a backward compatible mode. Nodes running the previous major version will
  132. not be allowed to join the fully-updated cluster.
  133. In the unlikely case of a network malfunction during the upgrade process that
  134. isolates all remaining old nodes from the cluster, you must take the
  135. old nodes offline and upgrade them to enable them to join the cluster.
  136. ====================================================