wiki #tokenization #tokenization 1 page tagged with "tokenization" programming fast zero-dependency sentence splitting in python with nupunkt — pure python and rust sentence boundary detection — 91% precision, 10M+ chars/sec, zero dependencies, trained on legal text but used across domains back to wiki