migrate_3_0.asciidoc 13 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326
  1. [[breaking-changes-3.0]]
  2. == Breaking changes in 3.0
  3. This section discusses the changes that you need to be aware of when migrating
  4. your application to Elasticsearch 3.0.
  5. === Search changes
  6. ==== `search_type=count` removed
  7. The `count` search type was deprecated since version 2.0.0 and is now removed.
  8. In order to get the same benefits, you just need to set the value of the `size`
  9. parameter to `0`.
  10. For instance, the following request:
  11. [source,sh]
  12. ---------------
  13. GET /my_index/_search?search_type=count
  14. {
  15. "aggs": {
  16. "my_terms": {
  17. "terms": {
  18. "field": "foo"
  19. }
  20. }
  21. }
  22. }
  23. ---------------
  24. can be replaced with:
  25. [source,sh]
  26. ---------------
  27. GET /my_index/_search
  28. {
  29. "size": 0,
  30. "aggs": {
  31. "my_terms": {
  32. "terms": {
  33. "field": "foo"
  34. }
  35. }
  36. }
  37. }
  38. ---------------
  39. ==== `search_type=scan` removed
  40. The `scan` search type was deprecated since version 2.1.0 and is now removed.
  41. All benefits from this search type can now be achieved by doing a scroll
  42. request that sorts documents in `_doc` order, for instance:
  43. [source,sh]
  44. ---------------
  45. GET /my_index/_search?scroll=2m
  46. {
  47. "sort": [
  48. "_doc"
  49. ]
  50. }
  51. ---------------
  52. Scroll requests sorted by `_doc` have been optimized to more efficiently resume
  53. from where the previous request stopped, so this will have the same performance
  54. characteristics as the former `scan` search type.
  55. === Parent/Child changes
  56. The `children` aggregation, parent child inner hits and `has_child` and `has_parent` queries will not work on indices
  57. with `_parent` field mapping created before version `2.0.0`. The data of these indices need to be re-indexed into a new index.
  58. The format of the join between parent and child documents have changed with the `2.0.0` release. The old
  59. format can't read from version `3.0.0` and onwards. The new format allows for a much more efficient and
  60. scalable join between parent and child documents and the join data structures are stored on on disk
  61. data structures as opposed as before the join data structures were stored in the jvm heap space.
  62. ==== `score_type` has been removed
  63. The `score_type` option has been removed from the `has_child` and `has_parent` queries in favour of the `score_mode` option
  64. which does the exact same thing.
  65. ==== `sum` score mode removed
  66. The `sum` score mode has been removed in favour of the `total` mode which doesn the same and is already available in
  67. previous versions.
  68. ==== `max_children` option
  69. When `max_children` was set to `0` on the `has_child` query then there was no upper limit on how many children documents
  70. are allowed to match. This has changed and `0` now really means to zero child documents are allowed. If no upper limit
  71. is needed then the `max_children` option shouldn't be defined at all on the `has_child` query.
  72. === Settings changes ===
  73. ==== Analysis settings
  74. The `index.analysis.analyzer.default_index` analyzer is not supported anymore.
  75. If you wish to change the analyzer to use for indexing, change the
  76. `index.analysis.analyzer.default` analyzer instead.
  77. ==== Ping timeout settings
  78. Previously, there were three settings for the ping timeout: `discovery.zen.initial_ping_timeout`,
  79. `discovery.zen.ping.timeout` and `discovery.zen.ping_timeout`. The former two have been removed and
  80. the only setting key for the ping timeout is now `discovery.zen.ping_timeout`. The default value for
  81. ping timeouts remains at three seconds.
  82. === Plugins
  83. Plugins implementing custom queries need to implement the `fromXContent(QueryParseContext)` method in their
  84. `QueryParser` subclass rather than `parse`. This method will take care of parsing the query from `XContent` format
  85. into an intermediate query representation that can be streamed between the nodes in binary format, effectively the
  86. query object used in the java api. Also, the query parser needs to implement the `getBuilderPrototype` method that
  87. returns a prototype of the `NamedWriteable` query, which allows to deserialize an incoming query by calling
  88. `readFrom(StreamInput)` against it, which will create a new object, see usages of `Writeable`. The `QueryParser`
  89. also needs to declare the generic type of the query that it supports and it's able to parse.
  90. The query object can then transform itself into a lucene query through the new `toQuery(QueryShardContext)` method,
  91. which returns a lucene query to be executed on the data node.
  92. Similarly, plugins implementing custom score functions need to implement the `fromXContent(QueryParseContext)`
  93. method in their `ScoreFunctionParser` subclass rather than `parse`. This method will take care of parsing
  94. the function from `XContent` format into an intermediate function representation that can be streamed between
  95. the nodes in binary format, effectively the function object used in the java api. Also, the query parser needs
  96. to implement the `getBuilderPrototype` method that returns a prototype of the `NamedWriteable` function, which
  97. allows to deserialize an incoming function by calling `readFrom(StreamInput)` against it, which will create a
  98. new object, see usages of `Writeable`. The `ScoreFunctionParser` also needs to declare the generic type of the
  99. function that it supports and it's able to parse. The function object can then transform itself into a lucene
  100. function through the new `toFunction(QueryShardContext)` method, which returns a lucene function to be executed
  101. on the data node.
  102. ==== Cloud AWS plugin
  103. Cloud AWS plugin has been split in two plugins:
  104. * {plugins}/discovery-ec2.html[Discovery EC2 plugin]
  105. * {plugins}/repository-s3.html[Repository S3 plugin]
  106. ==== Cloud Azure plugin
  107. Cloud Azure plugin has been split in three plugins:
  108. * {plugins}/discovery-azure.html[Discovery Azure plugin]
  109. * {plugins}/repository-azure.html[Repository Azure plugin]
  110. * {plugins}/store-smb.html[Store SMB plugin]
  111. ==== Cloud GCE plugin
  112. Cloud GCE plugin has been renamed to {plugins}/discovery-gce.html[Discovery GCE plugin].
  113. === Java-API
  114. ==== Count api has been removed
  115. The deprecated count api has been removed from the Java api, use the search api instead and set size to 0.
  116. The following call
  117. ```
  118. client.prepareCount(indices).setQuery(query).get();
  119. ```
  120. can be replaced with
  121. ```
  122. client.prepareSearch(indices).setSource(new SearchSourceBuilder().size(0).query(query)).get();
  123. ```
  124. ==== BoostingQueryBuilder
  125. Removed setters for mandatory positive/negative query. Both arguments now have
  126. to be supplied at construction time already and have to be non-null.
  127. ==== SpanContainingQueryBuilder
  128. Removed setters for mandatory big/little inner span queries. Both arguments now have
  129. to be supplied at construction time already and have to be non-null. Updated
  130. static factory methods in QueryBuilders accordingly.
  131. ==== SpanOrQueryBuilder
  132. Making sure that query contains at least one clause by making initial clause mandatory
  133. in constructor.
  134. ==== SpanNearQueryBuilder
  135. Removed setter for mandatory slop parameter, needs to be set in constructor now. Also
  136. making sure that query contains at least one clause by making initial clause mandatory
  137. in constructor. Updated the static factory methods in QueryBuilders accordingly.
  138. ==== SpanNotQueryBuilder
  139. Removed setter for mandatory include/exclude span query clause, needs to be set in constructor now.
  140. Updated the static factory methods in QueryBuilders and tests accordingly.
  141. ==== SpanWithinQueryBuilder
  142. Removed setters for mandatory big/little inner span queries. Both arguments now have
  143. to be supplied at construction time already and have to be non-null. Updated
  144. static factory methods in QueryBuilders accordingly.
  145. ==== QueryFilterBuilder
  146. Removed the setter `queryName(String queryName)` since this field is not supported
  147. in this type of query. Use `FQueryFilterBuilder.queryName(String queryName)` instead
  148. when in need to wrap a named query as a filter.
  149. ==== WrapperQueryBuilder
  150. Removed `wrapperQueryBuilder(byte[] source, int offset, int length)`. Instead simply
  151. use `wrapperQueryBuilder(byte[] source)`. Updated the static factory methods in
  152. QueryBuilders accordingly.
  153. ==== QueryStringQueryBuilder
  154. Removed ability to pass in boost value using `field(String field)` method in form e.g. `field^2`.
  155. Use the `field(String, float)` method instead.
  156. ==== Operator
  157. Removed the enums called `Operator` from `MatchQueryBuilder`, `QueryStringQueryBuilder`,
  158. `SimpleQueryStringBuilder`, and `CommonTermsQueryBuilder` in favour of using the enum
  159. defined in `org.elasticsearch.index.query.Operator` in an effort to consolidate the
  160. codebase and avoid duplication.
  161. ==== queryName and boost support
  162. Support for `queryName` and `boost` has been streamlined to all of the queries. That is
  163. a breaking change till queries get sent over the network as serialized json rather
  164. than in `Streamable` format. In fact whenever additional fields are added to the json
  165. representation of the query, older nodes might throw error when they find unknown fields.
  166. ==== InnerHitsBuilder
  167. InnerHitsBuilder now has a dedicated addParentChildInnerHits and addNestedInnerHits methods
  168. to differentiate between inner hits for nested vs. parent / child documents. This change
  169. makes the type / path parameter mandatory.
  170. ==== MatchQueryBuilder
  171. Moving MatchQueryBuilder.Type and MatchQueryBuilder.ZeroTermsQuery enum to MatchQuery.Type.
  172. Also reusing new Operator enum.
  173. ==== MoreLikeThisQueryBuilder
  174. Removed `MoreLikeThisQueryBuilder.Item#id(String id)`, `Item#doc(BytesReference doc)`,
  175. `Item#doc(XContentBuilder doc)`. Use provided constructors instead.
  176. Removed `MoreLikeThisQueryBuilder#addLike` in favor of texts and/or items beeing provided
  177. at construction time. Using arrays there instead of lists now.
  178. Removed `MoreLikeThisQueryBuilder#addUnlike` in favor to using the `unlike` methods
  179. which take arrays as arguments now rather than the lists used before.
  180. The deprecated `docs(Item... docs)`, `ignoreLike(Item... docs)`,
  181. `ignoreLike(String... likeText)`, `addItem(Item... likeItems)` have been removed.
  182. ==== GeoDistanceQueryBuilder
  183. Removing individual setters for lon() and lat() values, both values should be set together
  184. using point(lon, lat).
  185. ==== GeoDistanceRangeQueryBuilder
  186. Removing setters for to(Object ...) and from(Object ...) in favour of the only two allowed input
  187. arguments (String, Number). Removing setter for center point (point(), geohash()) because parameter
  188. is mandatory and should already be set in constructor.
  189. Also removing setters for lt(), lte(), gt(), gte() since they can all be replaced by equivallent
  190. calls to to/from() and inludeLower()/includeUpper().
  191. ==== GeoPolygonQueryBuilder
  192. Require shell of polygon already to be specified in constructor instead of adding it pointwise.
  193. This enables validation, but makes it necessary to remove the addPoint() methods.
  194. ==== MultiMatchQueryBuilder
  195. Moving MultiMatchQueryBuilder.ZeroTermsQuery enum to MatchQuery.ZeroTermsQuery.
  196. Also reusing new Operator enum.
  197. Removed ability to pass in boost value using `field(String field)` method in form e.g. `field^2`.
  198. Use the `field(String, float)` method instead.
  199. ==== MissingQueryBuilder
  200. The two individual setters for existence() and nullValue() were removed in favour of
  201. optional constructor settings in order to better capture and validate their interdependent
  202. settings at construction time.
  203. ==== NotQueryBuilder
  204. The NotQueryBuilder which was deprecated in 2.1.0 is removed. As a replacement use BoolQueryBuilder
  205. with added mustNot() clause. So instead of using `new NotQueryBuilder(filter)` now use
  206. `new BoolQueryBuilder().mustNot(filter)`.
  207. ==== TermsQueryBuilder
  208. Remove the setter for `termsLookup()`, making it only possible to either use a TermsLookup object or
  209. individual values at construction time. Also moving individual settings for the TermsLookup (lookupIndex,
  210. lookupType, lookupId, lookupPath) to the separate TermsLookup class, using constructor only and moving
  211. checks for validation there. Removed `TermsLookupQueryBuilder` in favour of `TermsQueryBuilder`.
  212. ==== FunctionScoreQueryBuilder
  213. `add` methods have been removed, all filters and functions must be provided as constructor arguments by
  214. creating an array of `FunctionScoreQueryBuilder.FilterFunctionBuilder` objects, containing one element
  215. for each filter/function pair.
  216. `scoreMode` and `boostMode` can only be provided using corresponding enum members instead
  217. of string values: see `FilterFunctionScoreQuery.ScoreMode` and `CombineFunction`.
  218. `CombineFunction.MULT` has been renamed to `MULTIPLY`.
  219. ==== IdsQueryBuilder
  220. For simplicity, only one way of adding the ids to the existing list (empty by default) is left: `addIds(String...)`
  221. ==== DocumentAlreadyExistsException removed
  222. `DocumentAlreadyExistsException` is removed and a `VersionConflictException` is thrown instead (with a better
  223. error description). This will influence code that use the `IndexRequest.opType()` or `IndexRequest.create()`
  224. to index a document only if it doesn't already exist.
  225. === Cache concurrency level settings removed
  226. Two cache concurrency level settings `indices.requests.cache.concurrency_level` and
  227. `indices.fielddata.cache.concurrency_level` because they no longer apply to the cache implementation used for the
  228. request cache and the field data cache.