routing-field.asciidoc 4.2 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134
  1. [[mapping-routing-field]]
  2. === `_routing` field
  3. A document is routed to a particular shard in an index using the following
  4. formula:
  5. shard_num = hash(_routing) % num_primary_shards
  6. The default value used for `_routing` is the document's <<mapping-id-field,`_id`>>.
  7. Custom routing patterns can be implemented by specifying a custom `routing`
  8. value per document. For instance:
  9. [source,console]
  10. ------------------------------
  11. PUT my-index-000001/_doc/1?routing=user1&refresh=true <1>
  12. {
  13. "title": "This is a document"
  14. }
  15. GET my-index-000001/_doc/1?routing=user1 <2>
  16. ------------------------------
  17. // TESTSETUP
  18. <1> This document uses `user1` as its routing value, instead of its ID.
  19. <2> The same `routing` value needs to be provided when
  20. <<docs-get,getting>>, <<docs-delete,deleting>>, or <<docs-update,updating>>
  21. the document.
  22. The value of the `_routing` field is accessible in queries:
  23. [source,console]
  24. --------------------------
  25. GET my-index-000001/_search
  26. {
  27. "query": {
  28. "terms": {
  29. "_routing": [ "user1" ] <1>
  30. }
  31. }
  32. }
  33. --------------------------
  34. <1> Querying on the `_routing` field (also see the <<query-dsl-ids-query,`ids` query>>)
  35. NOTE: Data streams do not support custom routing. Instead, target the
  36. appropriate backing index for the stream.
  37. ==== Searching with custom routing
  38. Custom routing can reduce the impact of searches. Instead of having to fan
  39. out a search request to all the shards in an index, the request can be sent to
  40. just the shard that matches the specific routing value (or values):
  41. [source,console]
  42. ------------------------------
  43. GET my-index-000001/_search?routing=user1,user2 <1>
  44. {
  45. "query": {
  46. "match": {
  47. "title": "document"
  48. }
  49. }
  50. }
  51. ------------------------------
  52. <1> This search request will only be executed on the shards associated with the `user1` and `user2` routing values.
  53. ==== Making a routing value required
  54. When using custom routing, it is important to provide the routing value
  55. whenever <<docs-index_,indexing>>, <<docs-get,getting>>,
  56. <<docs-delete,deleting>>, or <<docs-update,updating>> a document.
  57. Forgetting the routing value can lead to a document being indexed on more than
  58. one shard. As a safeguard, the `_routing` field can be configured to make a
  59. custom `routing` value required for all CRUD operations:
  60. [source,console]
  61. ------------------------------
  62. PUT my-index-000002
  63. {
  64. "mappings": {
  65. "_routing": {
  66. "required": true <1>
  67. }
  68. }
  69. }
  70. PUT my-index-000002/_doc/1 <2>
  71. {
  72. "text": "No routing value provided"
  73. }
  74. ------------------------------
  75. // TEST[catch:bad_request]
  76. <1> Routing is required for all documents.
  77. <2> This index request throws a `routing_missing_exception`.
  78. ==== Unique IDs with custom routing
  79. When indexing documents specifying a custom `_routing`, the uniqueness of the
  80. `_id` is not guaranteed across all of the shards in the index. In fact,
  81. documents with the same `_id` might end up on different shards if indexed with
  82. different `_routing` values.
  83. It is up to the user to ensure that IDs are unique across the index.
  84. [[routing-index-partition]]
  85. ==== Routing to an index partition
  86. An index can be configured such that custom routing values will go to a subset of the shards rather
  87. than a single shard. This helps mitigate the risk of ending up with an imbalanced cluster while still
  88. reducing the impact of searches.
  89. This is done by providing the index level setting <<routing-partition-size,`index.routing_partition_size`>> at index creation.
  90. As the partition size increases, the more evenly distributed the data will become at the
  91. expense of having to search more shards per request.
  92. When this setting is present, the formula for calculating the shard becomes:
  93. shard_num = (hash(_routing) + hash(_id) % routing_partition_size) % num_primary_shards
  94. That is, the `_routing` field is used to calculate a set of shards within the index and then the
  95. `_id` is used to pick a shard within that set.
  96. To enable this feature, the `index.routing_partition_size` should have a value greater than 1 and
  97. less than `index.number_of_shards`.
  98. Once enabled, the partitioned index will have the following limitations:
  99. * Mappings with <<parent-join,`join` field>> relationships cannot be created within it.
  100. * All mappings within the index must have the `_routing` field marked as required.