whitespace-tokenizer.asciidoc 126 B

1234
  1. [[analysis-whitespace-tokenizer]]
  2. === Whitespace Tokenizer
  3. A tokenizer of type `whitespace` that divides text at whitespace.