Samsung Reports Development of zNAND-T and zNAND-I Flash Memory
Samsung Electronics is reportedly developing two new specialized NAND flash products, zNAND-T and zNAND-I, alongside the previously announced zNAND-O to target distinct artificial intelligence workloads. These products represent a strategic shift toward customizing storage hardware for specialized data center requirements. As large-scale artificial intelligence operations place unprecedented demands on data centers, conventional general-purpose storage solutions are increasingly proving inadequate. Tailoring NAND flash memory variants for throughput and random input/output performance helps alleviate major bottlenecks in high-performance computing and large language model inference. The zNAND-T variant focuses on throughput by utilizing TSV stacked NAND Die to enhance read and write bandwidth for data center AI hardware. Meanwhile, zNAND-I targets random performance metrics like IOPS to excel in frequent, small-data operations such as KV cache offloading.
## BACKGROUND
In large language model inference, KV cache offloading involves storing key-value pairs of previous tokens to accelerate text generation, but it demands low latency and high random access performance from storage systems. TSV (Throughput Silicon Via) stacking is an advanced semiconductor packaging technology that enables vertical electrical connections through silicon dies, drastically increasing data transfer speeds and density.