Basic text search analyzers
A text analyzer prescribes how text is indexed.
A text analyzer converts input text into tokens that are indexed.
Analyzers differ in the ways that they process the following text attributes:
- Letter case
- Stopwords
- Chinese, Japanese, and Korean characters
- Numbers and non-alphabetic characters
- White spaces
- Word stems
- Word pronunciation
If your needs are different than any of the basic text search analyzers, you can create a user-defined analyzer.