#pretraining

1page tagged with "pretraining"

models

mimelens: small encoders for content-type detection on any byte window— pretrained byte-level and bpe BERT encoders that classify file content from a 4 kb chunk anywhere inside a file — including a single 1.4 kb udp packet.