#huggingface
11pages tagged with "huggingface"
programming
- attention interface— unified attentioninterface for centralized attention method management with runtime switching
- building a 150K-word english dictionary with llms: opengloss— synthetic encyclopedic dictionary and semantic knowledge graph — 537K sense definitions, 9.14M edges, and a live api, generated in under a week for under $1,000
- modular transformers— modular transformers architecture for reduced code duplication and easier model contributions
- quantization— 18+ quantization methods as first-class citizens in transformers v5.0
- serving and continuous batching— transformers serve command and continuous batching with paged attention for efficient inference
- tokenizer backend changes— unified tokenizer backend system eliminating the fast/slow distinction in transformers v5.0
- TokenizersBackend does not exist— how to fix the "Tokenizer class TokenizersBackend does not exist or is not currently imported" error when loading models
- tokenizing raw executables for malware analysis with bbpe— pretrained huggingface-compatible bpe tokenizers for raw binaries — use them for malware classification, binary similarity, and reverse engineering with transformers
- transformers v5.0— hugging face transformers v5.0 release overview, features, and migration guide
- transformers v5.0 migration guide— breaking changes and migration guide for upgrading from transformers v4.x to v5.0
- vllm and sglang integration— transformers as backend for vllm and sglang inference engines with near-native performance