Home Explore Help
Register Sign In
lqb
/
elasticsearch
mirror of https://gitee.com/mirrors/elasticsearch.git
1
0
Fork 0
Files Issues 0 Wiki
Tree: b7c0d2830a
Branches Tags
elasticsearch
/
docs
/
reference
/
analysis
/
tokenfilters.asciidoc

tokenfilters.asciidoc 2.9 KB
History Raw

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102 
  1. [[analysis-tokenfilters]]
    2. 

  2. == Token Filters
    3. 

  3. 

  4. Token filters accept a stream of tokens from a
    5. 

  5. <<analysis-tokenizers,tokenizer>> and can modify tokens
    6. 

  6. (eg lowercasing), delete tokens (eg remove stopwords)
    7. 

  7. or add tokens (eg synonyms).
    8. 

  8. 

  9. Elasticsearch has a number of built in token filters which can be
    10. 

  10. used to build <<analysis-custom-analyzer,custom analyzers>>.
    11. 

  11. 

  12. include::tokenfilters/standard-tokenfilter.asciidoc[]
    13. 

  13. 

  14. include::tokenfilters/asciifolding-tokenfilter.asciidoc[]
    15. 

  15. 

  16. include::tokenfilters/flatten-graph-tokenfilter.asciidoc[]
    17. 

  17. 

  18. include::tokenfilters/length-tokenfilter.asciidoc[]
    19. 

  19. 

  20. include::tokenfilters/lowercase-tokenfilter.asciidoc[]
    21. 

  21. 

  22. include::tokenfilters/uppercase-tokenfilter.asciidoc[]
    23. 

  23. 

  24. include::tokenfilters/ngram-tokenfilter.asciidoc[]
    25. 

  25. 

  26. include::tokenfilters/edgengram-tokenfilter.asciidoc[]
    27. 

  27. 

  28. include::tokenfilters/porterstem-tokenfilter.asciidoc[]
    29. 

  29. 

  30. include::tokenfilters/shingle-tokenfilter.asciidoc[]
    31. 

  31. 

  32. include::tokenfilters/stop-tokenfilter.asciidoc[]
    33. 

  33. 

  34. include::tokenfilters/word-delimiter-tokenfilter.asciidoc[]
    35. 

  35. 

  36. include::tokenfilters/word-delimiter-graph-tokenfilter.asciidoc[]
    37. 

  37. 

  38. include::tokenfilters/multiplexer-tokenfilter.asciidoc[]
    39. 

  39. 

  40. include::tokenfilters/stemmer-tokenfilter.asciidoc[]
    41. 

  41. 

  42. include::tokenfilters/stemmer-override-tokenfilter.asciidoc[]
    43. 

  43. 

  44. include::tokenfilters/keyword-marker-tokenfilter.asciidoc[]
    45. 

  45. 

  46. include::tokenfilters/keyword-repeat-tokenfilter.asciidoc[]
    47. 

  47. 

  48. include::tokenfilters/kstem-tokenfilter.asciidoc[]
    49. 

  49. 

  50. include::tokenfilters/snowball-tokenfilter.asciidoc[]
    51. 

  51. 

  52. include::tokenfilters/phonetic-tokenfilter.asciidoc[]
    53. 

  53. 

  54. include::tokenfilters/synonym-tokenfilter.asciidoc[]
    55. 

  55. 

  56. include::tokenfilters/synonym-graph-tokenfilter.asciidoc[]
    57. 

  57. 

  58. include::tokenfilters/compound-word-tokenfilter.asciidoc[]
    59. 

  59. 

  60. include::tokenfilters/reverse-tokenfilter.asciidoc[]
    61. 

  61. 

  62. include::tokenfilters/elision-tokenfilter.asciidoc[]
    63. 

  63. 

  64. include::tokenfilters/truncate-tokenfilter.asciidoc[]
    65. 

  65. 

  66. include::tokenfilters/unique-tokenfilter.asciidoc[]
    67. 

  67. 

  68. include::tokenfilters/pattern-capture-tokenfilter.asciidoc[]
    69. 

  69. 

  70. include::tokenfilters/pattern_replace-tokenfilter.asciidoc[]
    71. 

  71. 

  72. include::tokenfilters/trim-tokenfilter.asciidoc[]
    73. 

  73. 

  74. include::tokenfilters/limit-token-count-tokenfilter.asciidoc[]
    75. 

  75. 

  76. include::tokenfilters/hunspell-tokenfilter.asciidoc[]
    77. 

  77. 

  78. include::tokenfilters/common-grams-tokenfilter.asciidoc[]
    79. 

  79. 

  80. include::tokenfilters/normalization-tokenfilter.asciidoc[]
    81. 

  81. 

  82. include::tokenfilters/cjk-width-tokenfilter.asciidoc[]
    83. 

  83. 

  84. include::tokenfilters/cjk-bigram-tokenfilter.asciidoc[]
    85. 

  85. 

  86. include::tokenfilters/delimited-payload-tokenfilter.asciidoc[]
    87. 

  87. 

  88. include::tokenfilters/keep-words-tokenfilter.asciidoc[]
    89. 

  89. 

  90. include::tokenfilters/keep-types-tokenfilter.asciidoc[]
    91. 

  91. 

  92. include::tokenfilters/classic-tokenfilter.asciidoc[]
    93. 

  93. 

  94. include::tokenfilters/apostrophe-tokenfilter.asciidoc[]
    95. 

  95. 

  96. include::tokenfilters/decimal-digit-tokenfilter.asciidoc[]
    97. 

  97. 

  98. include::tokenfilters/fingerprint-tokenfilter.asciidoc[]
    99. 

  99. 

  100. include::tokenfilters/minhash-tokenfilter.asciidoc[]
    101. 

  101. 

  102. include::tokenfilters/remove-duplicates-tokenfilter.asciidoc[]
    103.