integrations.asciidoc 8.3 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212
  1. [[integrations]]
  2. == Integrations
  3. Integrations are not plugins, but are external tools or modules that make it easier to work with Elasticsearch.
  4. [float]
  5. [[cms-integrations]]
  6. === CMS integrations
  7. [float]
  8. ==== Supported by the community:
  9. * http://drupal.org/project/search_api_elasticsearch[Drupal]:
  10. Drupal Elasticsearch integration via Search API.
  11. * https://drupal.org/project/elasticsearch_connector[Drupal]:
  12. Drupal Elasticsearch integration.
  13. * https://wordpress.org/plugins/elasticpress/[ElasticPress]:
  14. Elasticsearch WordPress Plugin
  15. * https://wordpress.org/plugins/wpsolr-search-engine/[WPSOLR]:
  16. Elasticsearch (and Apache Solr) WordPress Plugin
  17. * https://doc.tiki.org/Elasticsearch[Tiki Wiki CMS Groupware]:
  18. Tiki has native support for Elasticsearch. This provides faster & better
  19. search (facets, etc), along with some Natural Language Processing features
  20. (ex.: More like this)
  21. * http://extensions.xwiki.org/xwiki/bin/view/Extension/Elastic+Search+Macro/[XWiki Next Generation Wiki]:
  22. XWiki has an Elasticsearch and Kibana macro allowing to run Elasticsearch queries and display the results in XWiki pages using XWiki's scripting language as well as include Kibana Widgets in XWiki pages
  23. [float]
  24. [[data-integrations]]
  25. === Data import/export and validation
  26. NOTE: Rivers were used to import data from external systems into Elasticsearch prior to the 2.0 release. Elasticsearch
  27. releases 2.0 and later do not support rivers.
  28. [float]
  29. ==== Supported by Elasticsearch:
  30. * {logstash-ref}/plugins-outputs-elasticsearch.html[Logstash output to Elasticsearch]:
  31. The Logstash `elasticsearch` output plugin.
  32. * {logstash-ref}/plugins-inputs-elasticsearch.html[Elasticsearch input to Logstash]
  33. The Logstash `elasticsearch` input plugin.
  34. * {logstash-ref}/plugins-filters-elasticsearch.html[Elasticsearch event filtering in Logstash]
  35. The Logstash `elasticsearch` filter plugin.
  36. * {logstash-ref}/plugins-codecs-es_bulk.html[Elasticsearch bulk codec]
  37. The Logstash `es_bulk` plugin decodes the Elasticsearch bulk format into individual events.
  38. [float]
  39. ==== Supported by the community:
  40. * https://github.com/jprante/elasticsearch-jdbc[JDBC importer]:
  41. The Java Database Connection (JDBC) importer allows to fetch data from JDBC sources for indexing into Elasticsearch (by Jörg Prante)
  42. * https://github.com/reachkrishnaraj/kafka-elasticsearch-standalone-consumer/tree/branch2.0[Kafka Standalone Consumer(Indexer)]:
  43. Kafka Standalone Consumer [Indexer] will read messages from Kafka in batches, processes(as implemented) and bulk-indexes them into Elasticsearch. Flexible and scalable. More documentation in above GitHub repo's Wiki.(Please use branch 2.0)!
  44. * https://github.com/ozlerhakan/mongolastic[Mongolastic]:
  45. A tool that clones data from Elasticsearch to MongoDB and vice versa
  46. * https://github.com/Aconex/scrutineer[Scrutineer]:
  47. A high performance consistency checker to compare what you've indexed
  48. with your source of truth content (e.g. DB)
  49. * https://github.com/salyh/elasticsearch-imap[IMAP/POP3/Mail importer]:
  50. The Mail importer allows to fetch data from IMAP and POP3 servers for indexing into Elasticsearch (by Hendrik Saly)
  51. * https://github.com/dadoonet/fscrawler[FS Crawler]:
  52. The File System (FS) crawler allows to index documents (PDF, Open Office...) from your local file system and over SSH. (by David Pilato)
  53. [float]
  54. [[deployment]]
  55. === Deployment
  56. [float]
  57. ==== Supported by Elasticsearch:
  58. * https://github.com/elastic/ansible-elasticsearch[Ansible playbook for Elasticsearch]:
  59. An officially supported ansible playbook for Elasticsearch. Tested with the latest version of 5.x and 6.x on Ubuntu 14.04/16.04, Debian 8, Centos 7.
  60. * https://github.com/elastic/puppet-elasticsearch[Puppet]:
  61. Elasticsearch puppet module.
  62. [float]
  63. ==== Supported by the community:
  64. * https://github.com/elastic/cookbook-elasticsearch[Chef]:
  65. Chef cookbook for Elasticsearch
  66. [float]
  67. [[framework-integrations]]
  68. === Framework integrations
  69. [float]
  70. ==== Supported by the community:
  71. * http://www.searchtechnologies.com/aspire-for-elasticsearch[Aspire for Elasticsearch]:
  72. Aspire, from Search Technologies, is a powerful connector and processing
  73. framework designed for unstructured data. It has connectors to internal and
  74. external repositories including SharePoint, Documentum, Jive, RDB, file
  75. systems, websites and more, and can transform and normalize this data before
  76. indexing in Elasticsearch.
  77. * https://camel.apache.org/elasticsearch.html[Apache Camel Integration]:
  78. An Apache camel component to integrate Elasticsearch
  79. * https://metacpan.org/release/Catmandu-Store-ElasticSearch[Catmanadu]:
  80. An Elasticsearch backend for the Catmandu framework.
  81. * https://github.com/tlrx/elasticsearch-test[elasticsearch-test]:
  82. Elasticsearch Java annotations for unit testing with
  83. http://www.junit.org/[JUnit]
  84. * https://github.com/FriendsOfSymfony/FOSElasticaBundle[FOSElasticaBundle]:
  85. Symfony2 Bundle wrapping Elastica.
  86. * http://grails.org/plugin/elasticsearch[Grails]:
  87. Elasticsearch Grails plugin.
  88. * http://haystacksearch.org/[Haystack]:
  89. Modular search for Django
  90. * http://hibernate.org/search/[Hibernate Search]
  91. Integration with Hibernate ORM, from the Hibernate team. Automatic synchronization of write operations, yet exposes full Elasticsearch capabilities for queries. Can return either Elasticsearch native or re-map queries back into managed entities loaded within transaction from the reference database.
  92. * https://github.com/cleverage/play2-elasticsearch[play2-elasticsearch]:
  93. Elasticsearch module for Play Framework 2.x
  94. * https://github.com/spring-projects/spring-data-elasticsearch[Spring Data Elasticsearch]:
  95. Spring Data implementation for Elasticsearch
  96. * https://github.com/dadoonet/spring-elasticsearch[Spring Elasticsearch]:
  97. Spring Factory for Elasticsearch
  98. * https://github.com/twitter/storehaus[Twitter Storehaus]:
  99. Thin asynchronous Scala client for Storehaus.
  100. [float]
  101. [[hadoop-integrations]]
  102. === Hadoop integrations
  103. [float]
  104. ==== Supported by Elasticsearch:
  105. * link:/guide/en/elasticsearch/hadoop/current/[es-hadoop]: Elasticsearch real-time
  106. search and analytics natively integrated with Hadoop. Supports Map/Reduce,
  107. Cascading, Apache Hive, Apache Pig, Apache Spark and Apache Storm.
  108. [float]
  109. [[monitoring-integrations]]
  110. === Health and Performance Monitoring
  111. [float]
  112. ==== Supported by the community:
  113. * https://github.com/anchor/nagios-plugin-elasticsearch[check_elasticsearch]:
  114. An Elasticsearch availability and performance monitoring plugin for
  115. Nagios.
  116. * https://github.com/radu-gheorghe/check-es[check-es]:
  117. Nagios/Shinken plugins for checking on Elasticsearch
  118. * https://github.com/mattweber/es2graphite[es2graphite]:
  119. Send cluster and indices stats and status to Graphite for monitoring and graphing.
  120. * https://itunes.apple.com/us/app/elasticocean/id955278030?ls=1&mt=8[ElasticOcean]:
  121. Elasticsearch & DigitalOcean iOS Real-Time Monitoring tool to keep an eye on DigitalOcean Droplets or Elasticsearch instances or both of them on-a-go.
  122. * https://github.com/rbramley/Opsview-elasticsearch[opsview-elasticsearch]:
  123. Opsview plugin written in Perl for monitoring Elasticsearch
  124. * https://scoutapp.com[Scout]: Provides plugins for monitoring Elasticsearch https://scoutapp.com/plugin_urls/1331-elasticsearch-node-status[nodes], https://scoutapp.com/plugin_urls/1321-elasticsearch-cluster-status[clusters], and https://scoutapp.com/plugin_urls/1341-elasticsearch-index-status[indices].
  125. * http://sematext.com/spm/index.html[SPM for Elasticsearch]:
  126. Performance monitoring with live charts showing cluster and node stats, integrated
  127. alerts, email reports, etc.
  128. [[other-integrations]]
  129. [float]
  130. === Other integrations
  131. [float]
  132. ==== Supported by the community:
  133. * https://github.com/kodcu/pes[Pes]:
  134. A pluggable elastic Javascript query DSL builder for Elasticsearch
  135. * https://www.wireshark.org/[Wireshark]:
  136. Protocol dissection for Zen discovery, HTTP and the binary protocol
  137. * https://www.itemsapi.com/[ItemsAPI]:
  138. Search backend for mobile and web
  139. These projects appear to have been abandoned:
  140. * http://www.github.com/neogenix/daikon[daikon]:
  141. Daikon Elasticsearch CLI
  142. * https://github.com/fullscale/dangle[dangle]:
  143. A set of AngularJS directives that provide common visualizations for Elasticsearch based on
  144. D3.
  145. * https://github.com/OlegKunitsyn/eslogd[eslogd]:
  146. Linux daemon that replicates events to a central Elasticsearch server in realtime