Leaked Photos Reveal Moonshot AI Celebrating Kimi K3 and Hinting at K4
Leaked photos from a celebration party in Beijing show Moonshot AI celebrating the launch of its Kimi K3 model. The event featured slogans hinting at the development and optimization of their next-generation model, Kimi K4. This celebration highlights Moonshot AI's rapid development cycle, transitioning focus to Kimi K4 shortly after releasing their flagship K3 model. It signals intense competition in the Chinese AI sector, particularly in scaling parameters and context windows. The Kimi K3 model features 2.8 trillion parameters and a 1-million-token context window, utilizing Kimi Delta Attention (KDA) for long-range programming and knowledge tasks. The leaked party slogans explicitly urged the team to push the upcoming "K4" model to its absolute limit.
## BACKGROUND
Moonshot AI is a prominent Chinese artificial intelligence startup known for its Kimi chatbot and large language models. The company has focused heavily on processing long-context inputs, starting with a 128,000-token limit in its early versions and scaling up to the massive 2.8-trillion-parameter Kimi K3 model.