PyTorch MLP Profiling: How nn.Linear Transposes Weights Before Matrix Multiplication
Hugging Face's second profiling guide reveals the hidden transpose operation in PyTorch's Linear layer and demonstrates kernel fusion techniques for production MLPs.
Hugging Face Launches PyTorch Profiler Tutorial Series for Performance Optimization
A new multi-part guide demystifies torch.profiler traces, starting with matrix operations and scaling to large language model optimization.
bitsandbytes: The Open-Source Engine Behind Accessible LLM Fine-Tuning
The bitsandbytes library applies 4-bit and 8-bit quantization to PyTorch models, making 70B+ parameter LLMs runnable on consumer GPUs and underpinning the QLoRA fine-tuning wave.