Thinking Machines Releases Inkling, a 1-Trillion-Parameter Multimodal Open Model
Inkling combines native image, audio, and text processing with a 1M-token context window and sparse MoE architecture for efficient multimodal reasoning.
#mixture-of-experts
Cohere Releases North Mini Code, a 30B-Parameter MoE Model for Agentic Software Engineering
Cohere's first coding-specialized model combines sparse mixture-of-experts architecture with reinforcement learning for agent-based development tasks.
JetBrains Releases Mellum2, a 12B Sparse Model for Sub-Second Inference
JetBrains' new Mixture-of-Experts model achieves 2x speedup over dense peers while activating just 2.5B parameters per token.