Home > Term: tokenizer
tokenizer
A text segmentation program that scans text and determines if and when a series of characters can be recognized as a token.
- Vārdšķira: noun
- Nozare/domēns: Software
- Category: Globalization software service
- Company: IBM
0
Autors
- Peteh
-
(V.I.P) 14225 points - 100% positive feedback
