nltk.tokenize.regexp_tokenize¶
- nltk.tokenize.regexp_tokenize(text, pattern, gaps=False, discard_empty=True, flags=RegexFlag.None)[source]¶
Return a tokenized copy of text. See
RegexpTokenizerfor descriptions of the arguments.
Return a tokenized copy of text. See RegexpTokenizer
for descriptions of the arguments.