en
tokenizer
An
English
term in
ConceptNet 5.8
Sources:
OpenCyc 2012
,
English Wiktionary
, and
French Wiktionary
View this term in the API
Documentation
FAQ
Chat
Blog
Documentation
FAQ
Chat
Blog
Related terms
en
tokeniser
(
n
)
➜
en
tokenization
(
n
)
➜
en
tokenize
(
v
)
➜
en
input
➜
en
parse
➜
en
stream
➜
en
system
➜
en
token
➜
en
tokenization
➜
en
tokenize
➜
fr
parseur
➜
fr
token
➜
en
tokenizers
(
n
)
➜
Word forms
en
tokeniser
➜
en
tokeniser
(
n
)
➜
en
tokenizers
(
n
)
➜
Derived from
en
tokenize
➜
en
tokenize
(
v
)
➜
Context of this term
en
computing
➜
tokenizer is a type of…
en
software agent
(
n
)
➜
Links to other resources
umbel.org
/umbel/sc/Tokenizer
sw.opencyc.org
/2012/05/10/concept/en/Tokenizer
en.wiktionary.org
tokenizer
fr.wiktionary.org
tokenizer