integrations.asciidoc 6.4 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171
  1. [[integrations]]
  2. == Integrations
  3. Integrations are not plugins, but are external tools or modules that make it easier to work with Elasticsearch.
  4. [discrete]
  5. [[cms-integrations]]
  6. === CMS integrations
  7. [discrete]
  8. ==== Supported by the community:
  9. * https://wordpress.org/plugins/elasticpress/[ElasticPress]:
  10. Elasticsearch WordPress Plugin
  11. * https://doc.tiki.org/Elasticsearch[Tiki Wiki CMS Groupware]:
  12. Tiki has native support for Elasticsearch. This provides faster & better
  13. search (facets, etc), along with some Natural Language Processing features
  14. (ex.: More like this)
  15. * https://extensions.xwiki.org/xwiki/bin/view/Extension/Elastic+Search+Macro/[XWiki Next Generation Wiki]:
  16. XWiki has an Elasticsearch and Kibana macro allowing to run Elasticsearch queries and display the results in XWiki pages using XWiki's scripting language as well as include Kibana Widgets in XWiki pages
  17. [discrete]
  18. [[data-integrations]]
  19. === Data import/export and validation
  20. NOTE: Rivers were used to import data from external systems into Elasticsearch prior to the 2.0 release. Elasticsearch
  21. releases 2.0 and later do not support rivers.
  22. [discrete]
  23. ==== Supported by Elastic:
  24. * {logstash-ref}/plugins-outputs-elasticsearch.html[Logstash output to Elasticsearch]:
  25. The Logstash `elasticsearch` output plugin.
  26. * {logstash-ref}/plugins-inputs-elasticsearch.html[Elasticsearch input to Logstash]
  27. The Logstash `elasticsearch` input plugin.
  28. * {logstash-ref}/plugins-filters-elasticsearch.html[Elasticsearch event filtering in Logstash]
  29. The Logstash `elasticsearch` filter plugin.
  30. * {logstash-ref}/plugins-codecs-es_bulk.html[Elasticsearch bulk codec]
  31. The Logstash `es_bulk` plugin decodes the Elasticsearch bulk format into individual events.
  32. [discrete]
  33. ==== Supported by the community:
  34. * https://github.com/spinscale/cookiecutter-elasticsearch-ingest-processor[Ingest processor template]:
  35. A template for creating new ingest processors.
  36. * https://github.com/BigDataDevs/kafka-elasticsearch-consumer[Kafka Standalone Consumer (Indexer)]:
  37. Kafka Standalone Consumer [Indexer] will read messages from Kafka in batches, processes(as implemented) and bulk-indexes them into Elasticsearch. Flexible and scalable. More documentation in above GitHub repo's Wiki.
  38. * https://github.com/Aconex/scrutineer[Scrutineer]:
  39. A high performance consistency checker to compare what you've indexed
  40. with your source of truth content (e.g. DB)
  41. * https://github.com/dadoonet/fscrawler[FS Crawler]:
  42. The File System (FS) crawler allows to index documents (PDF, Open Office...) from your local file system and over SSH. (by David Pilato)
  43. * https://github.com/senacor/elasticsearch-evolution[Elasticsearch Evolution]:
  44. A library to migrate elasticsearch mappings.
  45. * https://pgsync.com[PGSync]:
  46. A tool for syncing data from Postgres to Elasticsearch.
  47. [discrete]
  48. [[deployment]]
  49. === Deployment
  50. [discrete]
  51. ==== Supported by the community:
  52. * https://github.com/elastic/ansible-elasticsearch[Ansible]:
  53. Ansible playbook for Elasticsearch.
  54. * https://github.com/elastic/puppet-elasticsearch[Puppet]:
  55. Elasticsearch puppet module.
  56. * https://github.com/elastic/cookbook-elasticsearch[Chef]:
  57. Chef cookbook for Elasticsearch
  58. [discrete]
  59. [[framework-integrations]]
  60. === Framework integrations
  61. [discrete]
  62. ==== Supported by the community:
  63. * https://camel.apache.org/components/2.x/elasticsearch-component.html[Apache Camel Integration]:
  64. An Apache camel component to integrate Elasticsearch
  65. * https://metacpan.org/pod/Catmandu::Store::ElasticSearch[Catmandu]:
  66. An Elasticsearch backend for the Catmandu framework.
  67. * https://github.com/FriendsOfSymfony/FOSElasticaBundle[FOSElasticaBundle]:
  68. Symfony2 Bundle wrapping Elastica.
  69. * https://plugins.grails.org/plugin/puneetbehl/elasticsearch[Grails]:
  70. Elasticsearch Grails plugin.
  71. * https://hibernate.org/search/[Hibernate Search]
  72. Integration with Hibernate ORM, from the Hibernate team. Automatic synchronization of write operations, yet exposes full Elasticsearch capabilities for queries. Can return either Elasticsearch native or re-map queries back into managed entities loaded within transaction from the reference database.
  73. * https://github.com/spring-projects/spring-data-elasticsearch[Spring Data Elasticsearch]:
  74. Spring Data implementation for Elasticsearch
  75. * https://github.com/dadoonet/spring-elasticsearch[Spring Elasticsearch]:
  76. Spring Factory for Elasticsearch
  77. * https://zeebe.io[Zeebe]:
  78. An Elasticsearch exporter acts as a bridge between Zeebe and Elasticsearch
  79. * https://pulsar.apache.org/docs/en/io-elasticsearch[Apache Pulsar]:
  80. The Elasticsearch Sink Connector is used to pull messages from Pulsar topics
  81. and persist the messages to a index.
  82. * https://micronaut-projects.github.io/micronaut-elasticsearch/latest/guide/index.html[Micronaut Elasticsearch Integration]:
  83. Integration of Micronaut with Elasticsearch
  84. * https://streampipes.apache.org[Apache StreamPipes]:
  85. StreamPipes is a framework that enables users to work with IoT data sources.
  86. * https://metamodel.apache.org/[Apache MetaModel]:
  87. Providing a common interface for discovery, exploration of metadata and querying of different types of data sources.
  88. * https://micrometer.io[Micrometer]:
  89. Vendor-neutral application metrics facade. Think SLF4j, but for metrics.
  90. [discrete]
  91. [[hadoop-integrations]]
  92. === Hadoop integrations
  93. [discrete]
  94. ==== Supported by Elastic:
  95. * link:/guide/en/elasticsearch/hadoop/current/[es-hadoop]: Elasticsearch real-time
  96. search and analytics natively integrated with Hadoop. Supports Map/Reduce,
  97. Cascading, Apache Hive, Apache Pig, Apache Spark and Apache Storm.
  98. [discrete]
  99. ==== Supported by the community:
  100. * https://github.com/criteo/garmadon[Garmadon]:
  101. Garmadon is a solution for Hadoop Cluster realtime introspection.
  102. [discrete]
  103. [[monitoring-integrations]]
  104. === Health and Performance Monitoring
  105. [discrete]
  106. ==== Supported by the community:
  107. * https://sematext.com/spm/index.html[SPM for Elasticsearch]:
  108. Performance monitoring with live charts showing cluster and node stats, integrated
  109. alerts, email reports, etc.
  110. * https://www.zabbix.com/integrations/elasticsearch[Zabbix monitoring template]:
  111. Monitor the performance and status of your {es} nodes and cluster with Zabbix
  112. and receive events information.
  113. [[other-integrations]]
  114. [discrete]
  115. === Other integrations
  116. [discrete]
  117. ==== Supported by the community:
  118. * https://www.wireshark.org/[Wireshark]:
  119. Protocol dissection for HTTP and the transport protocol
  120. * https://www.itemsapi.com/[ItemsAPI]:
  121. Search backend for mobile and web