Home Explore Help
Sign In
lqb
/
elasticsearch
mirror of https://gitee.com/mirrors/elasticsearch.git
1
0
Fork 0
Files Issues 0 Wiki
Tree: fdb5eb6555
Branches Tags
elasticsearch
/
docs
/
reference
/
analysis
/
tokenfilters.asciidoc

tokenfilters.asciidoc 2.2 KB
History Raw

12345678910111213141516171819202122232425262728293031323334353637383940414243444546474849505152535455565758596061626364656667686970717273747576 
  1. [[analysis-tokenfilters]]
    2. 

  2. == Token Filters
    3. 

  3. 

  4. Token filters accept a stream of tokens from a 
    5. 

  5. <<analysis-tokenizers,tokenizer>> and can modify tokens
    6. 

  6. (eg lowercasing), delete tokens (eg remove stopwords)
    7. 

  7. or add tokens (eg synonyms).
    8. 

  8. 

  9. Elasticsearch has a number of built in token filters which can be
    10. 

  10. used to build <<analysis-custom-analyzer,custom analyzers>>.
    11. 

  11. 

  12. include::tokenfilters/standard-tokenfilter.asciidoc[]
    13. 

  13. 

  14. include::tokenfilters/asciifolding-tokenfilter.asciidoc[]
    15. 

  15. 

  16. include::tokenfilters/length-tokenfilter.asciidoc[]
    17. 

  17. 

  18. include::tokenfilters/lowercase-tokenfilter.asciidoc[]
    19. 

  19. 

  20. include::tokenfilters/uppercase-tokenfilter.asciidoc[]
    21. 

  21. 

  22. include::tokenfilters/ngram-tokenfilter.asciidoc[]
    23. 

  23. 

  24. include::tokenfilters/edgengram-tokenfilter.asciidoc[]
    25. 

  25. 

  26. include::tokenfilters/porterstem-tokenfilter.asciidoc[]
    27. 

  27. 

  28. include::tokenfilters/shingle-tokenfilter.asciidoc[]
    29. 

  29. 

  30. include::tokenfilters/stop-tokenfilter.asciidoc[]
    31. 

  31. 

  32. include::tokenfilters/word-delimiter-tokenfilter.asciidoc[]
    33. 

  33. 

  34. include::tokenfilters/stemmer-tokenfilter.asciidoc[]
    35. 

  35. 

  36. include::tokenfilters/stemmer-override-tokenfilter.asciidoc[]
    37. 

  37. 

  38. include::tokenfilters/keyword-marker-tokenfilter.asciidoc[]
    39. 

  39. 

  40. include::tokenfilters/keyword-repeat-tokenfilter.asciidoc[]
    41. 

  41. 

  42. include::tokenfilters/kstem-tokenfilter.asciidoc[]
    43. 

  43. 

  44. include::tokenfilters/snowball-tokenfilter.asciidoc[]
    45. 

  45. 

  46. include::tokenfilters/phonetic-tokenfilter.asciidoc[]
    47. 

  47. 

  48. include::tokenfilters/synonym-tokenfilter.asciidoc[]
    49. 

  49. 

  50. include::tokenfilters/compound-word-tokenfilter.asciidoc[]
    51. 

  51. 

  52. include::tokenfilters/reverse-tokenfilter.asciidoc[]
    53. 

  53. 

  54. include::tokenfilters/elision-tokenfilter.asciidoc[]
    55. 

  55. 

  56. include::tokenfilters/truncate-tokenfilter.asciidoc[]
    57. 

  57. 

  58. include::tokenfilters/unique-tokenfilter.asciidoc[]
    59. 

  59. 

  60. include::tokenfilters/pattern-capture-tokenfilter.asciidoc[]
    61. 

  61. 

  62. include::tokenfilters/pattern_replace-tokenfilter.asciidoc[]
    63. 

  63. 

  64. include::tokenfilters/trim-tokenfilter.asciidoc[]
    65. 

  65. 

  66. include::tokenfilters/limit-token-count-tokenfilter.asciidoc[]
    67. 

  67. 

  68. include::tokenfilters/hunspell-tokenfilter.asciidoc[]
    69. 

  69. 

  70. include::tokenfilters/common-grams-tokenfilter.asciidoc[]
    71. 

  71. 

  72. include::tokenfilters/normalization-tokenfilter.asciidoc[]
    73. 

  73. 

  74. include::tokenfilters/delimited-payload-tokenfilter.asciidoc[]
    75. 

  75. 

  76. include::tokenfilters/keep-words-tokenfilter.asciidoc[]
    77.