Mixture-of-Experts 1 Mixture of Experts: Architecture, Training, and Production Trade-Offs Dec 14, 2025