integrations.asciidoc 7.6 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199
  1. [[integrations]]
  2. == Integrations
  3. Integrations are not plugins, but are external tools or modules that make it easier to work with Elasticsearch.
  4. [discrete]
  5. [[cms-integrations]]
  6. === CMS integrations
  7. [discrete]
  8. ==== Supported by the community:
  9. * https://drupal.org/project/search_api_elasticsearch[Drupal]:
  10. Drupal Elasticsearch integration via Search API.
  11. * https://drupal.org/project/elasticsearch_connector[Drupal]:
  12. Drupal Elasticsearch integration.
  13. * https://wordpress.org/plugins/elasticpress/[ElasticPress]:
  14. Elasticsearch WordPress Plugin
  15. * https://wordpress.org/plugins/wpsolr-search-engine/[WPSOLR]:
  16. Elasticsearch (and Apache Solr) WordPress Plugin
  17. * https://doc.tiki.org/Elasticsearch[Tiki Wiki CMS Groupware]:
  18. Tiki has native support for Elasticsearch. This provides faster & better
  19. search (facets, etc), along with some Natural Language Processing features
  20. (ex.: More like this)
  21. * https://extensions.xwiki.org/xwiki/bin/view/Extension/Elastic+Search+Macro/[XWiki Next Generation Wiki]:
  22. XWiki has an Elasticsearch and Kibana macro allowing to run Elasticsearch queries and display the results in XWiki pages using XWiki's scripting language as well as include Kibana Widgets in XWiki pages
  23. [discrete]
  24. [[data-integrations]]
  25. === Data import/export and validation
  26. NOTE: Rivers were used to import data from external systems into Elasticsearch prior to the 2.0 release. Elasticsearch
  27. releases 2.0 and later do not support rivers.
  28. [discrete]
  29. ==== Supported by Elasticsearch:
  30. * {logstash-ref}/plugins-outputs-elasticsearch.html[Logstash output to Elasticsearch]:
  31. The Logstash `elasticsearch` output plugin.
  32. * {logstash-ref}/plugins-inputs-elasticsearch.html[Elasticsearch input to Logstash]
  33. The Logstash `elasticsearch` input plugin.
  34. * {logstash-ref}/plugins-filters-elasticsearch.html[Elasticsearch event filtering in Logstash]
  35. The Logstash `elasticsearch` filter plugin.
  36. * {logstash-ref}/plugins-codecs-es_bulk.html[Elasticsearch bulk codec]
  37. The Logstash `es_bulk` plugin decodes the Elasticsearch bulk format into individual events.
  38. [discrete]
  39. ==== Supported by the community:
  40. * https://github.com/jprante/elasticsearch-jdbc[JDBC importer]:
  41. The Java Database Connection (JDBC) importer allows to fetch data from JDBC sources for indexing into Elasticsearch (by Jörg Prante)
  42. * https://github.com/BigDataDevs/kafka-elasticsearch-consumer [Kafka Standalone Consumer(Indexer)]:
  43. Kafka Standalone Consumer [Indexer] will read messages from Kafka in batches, processes(as implemented) and bulk-indexes them into Elasticsearch. Flexible and scalable. More documentation in above GitHub repo's Wiki.
  44. * https://github.com/ozlerhakan/mongolastic[Mongolastic]:
  45. A tool that clones data from Elasticsearch to MongoDB and vice versa
  46. * https://github.com/Aconex/scrutineer[Scrutineer]:
  47. A high performance consistency checker to compare what you've indexed
  48. with your source of truth content (e.g. DB)
  49. * https://github.com/salyh/elasticsearch-imap[IMAP/POP3/Mail importer]:
  50. The Mail importer allows to fetch data from IMAP and POP3 servers for indexing into Elasticsearch (by Hendrik Saly)
  51. * https://github.com/dadoonet/fscrawler[FS Crawler]:
  52. The File System (FS) crawler allows to index documents (PDF, Open Office...) from your local file system and over SSH. (by David Pilato)
  53. * https://github.com/senacor/elasticsearch-evolution[Elasticsearch Evolution]:
  54. A library to migrate elasticsearch mappings.
  55. [discrete]
  56. [[deployment]]
  57. === Deployment
  58. [discrete]
  59. ==== Supported by Elasticsearch:
  60. * https://github.com/elastic/ansible-elasticsearch[Ansible playbook for Elasticsearch]:
  61. An officially supported ansible playbook for Elasticsearch. Tested with the latest version of 5.x and 6.x on Ubuntu 14.04/16.04, Debian 8, Centos 7.
  62. * https://github.com/elastic/puppet-elasticsearch[Puppet]:
  63. Elasticsearch puppet module.
  64. [discrete]
  65. ==== Supported by the community:
  66. * https://github.com/elastic/cookbook-elasticsearch[Chef]:
  67. Chef cookbook for Elasticsearch
  68. [discrete]
  69. [[framework-integrations]]
  70. === Framework integrations
  71. [discrete]
  72. ==== Supported by the community:
  73. * https://camel.apache.org/elasticsearch.html[Apache Camel Integration]:
  74. An Apache camel component to integrate Elasticsearch
  75. * https://metacpan.org/pod/Catmandu::Store::ElasticSearch[Catmandu]:
  76. An Elasticsearch backend for the Catmandu framework.
  77. * https://github.com/FriendsOfSymfony/FOSElasticaBundle[FOSElasticaBundle]:
  78. Symfony2 Bundle wrapping Elastica.
  79. * https://plugins.grails.org/plugin/puneetbehl/elasticsearch[Grails]:
  80. Elasticsearch Grails plugin.
  81. * https://haystacksearch.org/[Haystack]:
  82. Modular search for Django
  83. * https://hibernate.org/search/[Hibernate Search]
  84. Integration with Hibernate ORM, from the Hibernate team. Automatic synchronization of write operations, yet exposes full Elasticsearch capabilities for queries. Can return either Elasticsearch native or re-map queries back into managed entities loaded within transaction from the reference database.
  85. * https://github.com/spring-projects/spring-data-elasticsearch[Spring Data Elasticsearch]:
  86. Spring Data implementation for Elasticsearch
  87. * https://github.com/dadoonet/spring-elasticsearch[Spring Elasticsearch]:
  88. Spring Factory for Elasticsearch
  89. * https://github.com/twitter/storehaus[Twitter Storehaus]:
  90. Thin asynchronous Scala client for Storehaus.
  91. * https://zeebe.io[Zeebe]:
  92. An Elasticsearch exporter acts as a bridge between Zeebe and Elasticsearch
  93. * https://pulsar.apache.org/docs/en/io-elasticsearch[Apache Pulsar]:
  94. The Elasticsearch Sink Connector is used to pull messages from Pulsar topics
  95. and persist the messages to a index.
  96. * https://micronaut-projects.github.io/micronaut-elasticsearch/latest/guide/index.html[Micronaut Elasticsearch Integration]:
  97. Integration of Micronaut with Elasticsearch
  98. * https://streampipes.apache.org[Apache StreamPipes]:
  99. StreamPipes is a framework that enables users to work with IoT data sources.
  100. * https://metamodel.apache.org/[Apache MetaModel]:
  101. Providing a common interface for discovery, exploration of metadata and querying of different types of data sources.
  102. * https://jooby.org/doc/elasticsearch/[Jooby Framework]:
  103. Scalable, fast and modular micro web framework for Java.
  104. * https://micrometer.io[Micrometer]:
  105. Vendor-neutral application metrics facade. Think SLF4j, but for metrics.
  106. [discrete]
  107. [[hadoop-integrations]]
  108. === Hadoop integrations
  109. [discrete]
  110. ==== Supported by Elasticsearch:
  111. * link:/guide/en/elasticsearch/hadoop/current/[es-hadoop]: Elasticsearch real-time
  112. search and analytics natively integrated with Hadoop. Supports Map/Reduce,
  113. Cascading, Apache Hive, Apache Pig, Apache Spark and Apache Storm.
  114. [discrete]
  115. ==== Supported by the community:
  116. * https://github.com/criteo/garmadon[Garmadon]:
  117. Garmadon is a solution for Hadoop Cluster realtime introspection.
  118. [discrete]
  119. [[monitoring-integrations]]
  120. === Health and Performance Monitoring
  121. [discrete]
  122. ==== Supported by the community:
  123. * https://github.com/radu-gheorghe/check-es[check-es]:
  124. Nagios/Shinken plugins for checking on Elasticsearch
  125. * https://sematext.com/spm/index.html[SPM for Elasticsearch]:
  126. Performance monitoring with live charts showing cluster and node stats, integrated
  127. alerts, email reports, etc.
  128. * https://www.zabbix.com/integrations/elasticsearch[Zabbix monitoring template]:
  129. Monitor the performance and status of your {es} nodes and cluster with Zabbix
  130. and receive events information.
  131. [[other-integrations]]
  132. [discrete]
  133. === Other integrations
  134. [discrete]
  135. ==== Supported by the community:
  136. * https://www.wireshark.org/[Wireshark]:
  137. Protocol dissection for HTTP and the transport protocol
  138. * https://www.itemsapi.com/[ItemsAPI]:
  139. Search backend for mobile and web