Tencent Announces Hy4 AI Model with Open Weights Coming Soon
Tencent has announced Hy4, a new flagship Mixture-of-Experts AI model developed by the Tencent Hy Team, with its open weights scheduled for release soon. This upcoming release introduces a massive new open-weights contender to the AI ecosystem, offering researchers and developers access to advanced capabilities spanning language and vision. The Hy4 preview model features a total of 770B to 780B parameters, utilizing a Mixture-of-Experts architecture where 49B parameters are activated per token across 78 layers.
## BACKGROUND
Open weights refer to the publicly released numerical parameters of a trained artificial intelligence model, allowing third parties to download, run, and fine-tune the model. Mixture-of-Experts (MoE) is a neural network architecture that routes each input token to a subset of specialized subnetworks, increasing model capacity while maintaining computational efficiency.