wiki#tokenization#tokenization1page tagged with "tokenization"programmingfast zero-dependency sentence splitting in python with nupunkt— pure python and rust sentence boundary detection — 91% precision, 10M+ chars/sec, zero dependencies, trained on legal text but used across domainsback to wiki