THESAURUS

Tokenize Thesaurus

(transitive, computing) To reduce to a token or set of tokens by lexical analysis.

Related Words

Related dictionary entries include tokenise, detokenize, disassociate, analyze, unpack, delexicalize.

Continue With Tokenize

Relationships are shown only after the shared lexical validator accepts them. A suggestion is not automatically an exact replacement.