DiScoFormer Unifies Density and Score Estimation in a Single Transformer
Researchers introduce a transformer architecture that estimates both probability density and score functions across distributions without retraining.
#transformers
Hybrid Models Excel at Semantic Tokens, Transformers Hold Ground on Exact Recall
Allen AI's analysis of Olmo Hybrid versus Olmo 3 reveals architectural trade-offs: recurrent layers outperform attention on meaning-bearing tokens but lose ground on verbatim repetition.
Hugging Face Benchmarks Open Models on Agent-Friendly APIs
Hugging Face introduces tool-specific benchmarking methodology that measures not just correctness but token efficiency for coding agents interacting with library APIs.
Google's AI Overview struggles with basic spelling, revealing token-level architectural limits
Google's AI Overview has generated spelling errors including misspelling 'Google' as 'Googel' and 'journalism' as 'j-o-u-r-n-a-d-i-s-m'—a recurring challenge for transformer-based LLMs.
OlmoEarth v1.1 cuts satellite-imagery inference costs by 3x through token optimization
Allen Institute releases OlmoEarth v1.1, a more efficient earth-observation model family that maintains v1 performance while reducing compute through shorter token sequences.
PaddleOCR 3.5 Adds Transformers Backend, Easing Document Parsing Integration
PaddleOCR 3.5 now supports Hugging Face Transformers as an inference runtime, letting developers run OCR and document parsing models directly within Transformers-centered stacks.
Teaching the World to Build GPT: A Line-by-Line LLM Tutorial Takes GitHub by Storm
A new open-source repository walks developers through building a modern large language model from scratch, with every line of code annotated and explained in plain language.