Creating a table > NLP and tokenization > Low-level tokenization (opens in new tab)
When text is indexed in Manticore, it is split into words and case folding is done so that words like "Abc", "ABC", and "abc" are treated as the same word.
Read the original article