s3.asciidoc 1.6 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051
  1. [[modules-gateway-s3]]
  2. === S3 Gateway
  3. *The S3 gateway is deprecated and will be removed in a future version.
  4. Please use the <<modules-gateway-local,local
  5. gateway>> instead.*
  6. S3 based gateway allows to do long term reliable async persistency of
  7. the cluster state and indices directly to Amazon S3. Here is how it can
  8. be configured:
  9. [source,js]
  10. --------------------------------------------------
  11. cloud:
  12. aws:
  13. access_key: AKVAIQBF2RECL7FJWGJQ
  14. secret_key: vExyMThREXeRMm/b/LRzEB8jWwvzQeXgjqMX+6br
  15. gateway:
  16. type: s3
  17. s3:
  18. bucket: bucket_name
  19. --------------------------------------------------
  20. You’ll need to install the `cloud-aws` plugin, by running
  21. `bin/plugin install cloud-aws` before (re)starting elasticsearch.
  22. The following are a list of settings (prefixed with `gateway.s3`) that
  23. can further control the S3 gateway:
  24. [cols="<,<",options="header",]
  25. |=======================================================================
  26. |Setting |Description
  27. |`chunk_size` |Big files are broken down into chunks (to overcome AWS 5g
  28. limit and use concurrent snapshotting). Default set to `100m`.
  29. |=======================================================================
  30. [float]
  31. ==== concurrent_streams
  32. The `gateway.s3.concurrent_streams` allow to throttle the number of
  33. streams (per node) opened against the shared gateway performing the
  34. snapshot operation. It defaults to `5`.
  35. [float]
  36. ==== Region
  37. The `cloud.aws.region` can be set to a region and will automatically use
  38. the relevant settings for both `ec2` and `s3`. The available values are:
  39. `us-east-1`, `us-west-1`, `ap-southeast-1`, `eu-west-1`.