English Explanatory Dictionary

detokenize

English dictionary entry

Meanings

verb
  1. To convert (a tokenized representation) back to the original form.

Word forms

detokenize detokenizes detokenizing detokenized

Etymology

From de- + tokenize.

Derived words

detokenizer
This entry uses open data from Wiktionary (CC BY-SA/GFDL). Word forms are used for search and are not indexed as separate pages.
Back to search All on D Russian dictionary Dahl dictionary