Home > Term: Unicode-based white space segmentation
Unicode-based white space segmentation
A method of tokenization that uses Unicode character properties to distinguish between token and separator characters.
- Vārdšķira: noun
- Nozare/domēns: Software
- Category: Globalization software service
- Company: IBM
0
Autors
- PWH617
-
(Gold) 1905 points - 100% positive feedback
