VocabX Cuts Inference Costs 77% by Specializing Language Model Vocabularies for Single Domains
Researchers show that swapping a general-purpose tokenizer for a domain-specialized vocabulary in small language models can reduce inference costs by 77% without retraining the base model.