Baidu Announces Tianchi 1024-Card Supernode to Support Trillion-Parameter Models
Baidu announced the Tianchi 1024-card supernode at Baidu World 2026, which is scheduled to hit the market next year and supports training for models up to 5 trillion parameters. This development represents a major leap in AI hardware infrastructure, significantly boosting cluster-level training and long-context inference performance for giant language models. The supernode leverages optical engine technology to triple card-to-card interconnection bandwidth, alongside a G3.5 KV Cache memory acceleration cabinet that reduces TTFT by 90%.
## BACKGROUND
KV Cache is a core optimization technique in Transformer-based models that stores previously computed key-value vectors to avoid redundant calculations during autoregressive generation. TTFT, or Time To First Token, measures the waiting duration from sending a prompt to receiving the initial text output, serving as a key metric for user experience in conversational AI.