HOPE: A New Method for Pruning Mixture-of-Experts Models Without Losing Performance
Hugging Face introduces Higher-Order Pruning of Experts (HOPE), a technique that accounts for expert interactions when removing redundant parameters from MoE language models.