~/HARDWARE/marvell-and-penguin-launch-industry-s-first-multi-rack-optical-i-o

Marvell and Penguin Launch Industry's First Multi-Rack Optical I/O Memory Pool

Marvell and Penguin have partnered to introduce the MemoryAI Photonic Appliance, the industry's first multi-rack optical I/O memory pool, alongside a DDR4 CXL memory expansion card. The system is scheduled for sample delivery to select customers in the second half of 2027. This solution addresses the critical AI memory wall by allowing multiple XPUs to share HBM-level memory bandwidth over several meters using optical I/O, thereby improving DRAM utilization efficiency. It provides a foundational infrastructure to support the massive data transfer rates and energy efficiencies required by modern large-scale AI workloads. Built on the Marvell Photonic Fabric platform, the appliance utilizes silicon photonics technology to scale up to 16TB of DDR5 RDIMM and 578GB of HBM3E, achieving a total device bandwidth of 57.6 Tbps. It supports direct HBM access, direct DDR5 access, and HBM-DDR5 caching modes for intelligent memory allocation.

## BACKGROUND

The AI memory wall refers to the performance bottleneck caused by the growing disparity between processor computing power and memory bandwidth/capacity, which restricts the efficiency of large models. Silicon photonics integrates optical components onto silicon chips to enable high-speed, low-energy data transmission over longer distances, replacing traditional electrical I/O that suffers from high energy losses at scale.

## REFERENCES

## KEYWORDS

#Hardware#AI Infrastructure#Memory Pool#Optical I/O#Silicon Photonics

$ subscribe --daily

Marvell and Penguin Launch Industry's First Multi-Rack Optical I/O Memory Pool | Daily News