| 123456789101112131415 | [[analysis-lowercase-tokenizer]]=== Lowercase TokenizerA tokenizer of type `lowercase` that performs the function of<<analysis-letter-tokenizer,LetterTokenizer>> and<<analysis-lowercase-tokenfilter,LowerCase Token Filter>> together. It divides text at non-letters and convertsthem to lower case. While it is functionally equivalent to thecombination of<<analysis-letter-tokenizer,LetterTokenizer>> and<<analysis-lowercase-tokenfilter,LowerCase Token Filter>>, there is a performance advantage to doing the twotasks at once, hence this (redundant) implementation.
 |