Tokenizer Definition
noun
(computing) A system that parses an input stream into tokens.
Wiktionary
Other Word Forms of Tokenizer
Noun
Singular:
tokenizer
Plural:
tokenizersFind Similar Words
Find similar words to tokenizer using the buttons below.