English Explanatory Dictionary

tokenize

English dictionary entry

Meanings

verb
  1. To reduce to a token or set of tokens by lexical analysis.
  2. To substitute sensitive data with meaningless placeholders.
  3. To treat as a token minority.

Pronunciation

/ˈtoʊ.kən.aɪz/

Word forms

tokenize tokenizes tokenizing tokenized tokenise

Etymology

From token + -ize.

Related words

tokenism

Derived words

tokenizable tokenization tokenizer
This entry uses open data from Wiktionary (CC BY-SA/GFDL). Word forms are used for search and are not indexed as separate pages.
Back to search All on T Russian dictionary Dahl dictionary