en
tokenizer
(
n
)
An
English
term in
ConceptNet 5.8
Sources:
OpenCyc 2012
,
English Wiktionary
, and
French Wiktionary
View this term in the API
Documentation
FAQ
Chat
Blog
Documentation
FAQ
Chat
Blog
Related terms
en
input
➜
en
parse
➜
en
stream
➜
en
system
➜
en
token
➜
en
tokenization
➜
en
tokenize
➜
fr
parseur
➜
fr
token
➜
Word forms
en
tokeniser
➜
Context of this term
en
computing
➜
tokenizer is a type of…
en
software agent
(
n
)
➜
Links to other resources
sw.opencyc.org
/2012/05/10/concept/en/Tokenizer