1
0

hadoop.asciidoc 1.2 KB

123456789101112131415161718192021222324252627282930313233343536
  1. [[modules-gateway-hadoop]]
  2. === Hadoop Gateway
  3. *The hadoop gateway is deprecated and will be removed in a future
  4. version. Please use the
  5. <<modules-gateway-local,local gateway>>
  6. instead.*
  7. The hadoop (HDFS) based gateway stores the cluster meta and indices data
  8. in hadoop. Hadoop support is provided as a plugin and installing is
  9. explained https://github.com/elasticsearch/elasticsearch-hadoop[here] or
  10. downloading the hadoop plugin and placing it under the `plugins`
  11. directory. Here is an example config to enable it:
  12. [source,js]
  13. --------------------------------------------------
  14. gateway:
  15. type: hdfs
  16. hdfs:
  17. uri: hdfs://myhost:8022
  18. --------------------------------------------------
  19. [float]
  20. ==== Settings
  21. The hadoop gateway requires two simple settings. The `gateway.hdfs.uri`
  22. controls the URI to connect to the hadoop cluster, for example:
  23. `hdfs://myhost:8022`. The `gateway.hdfs.path` controls the path under
  24. which the gateway will store the data.
  25. [float]
  26. ==== concurrent_streams
  27. The `gateway.hdfs.concurrent_streams` allow to throttle the number of
  28. streams (per node) opened against the shared gateway performing the
  29. snapshot operation. It defaults to `5`.