~/HARDWARE/enthusiast-connects-six-gpus-to-a-single-pcie-slot-using-a-switch

Enthusiast Connects Six GPUs to a Single PCIe Slot Using a Switch

A hardware enthusiast successfully demonstrated running four Radeon AI PRO R9700 GPUs and two RTX 3090 GPUs through a single PCIe x16 slot. This impressive setup was achieved by utilizing a PCIe switch to expand the single slot's connectivity. This creative hardware hack showcases high-density GPU configurations for local AI workloads without needing enterprise server hardware. It offers a potential path for enthusiasts looking to scale VRAM and compute power efficiently on consumer motherboards. The configuration combines a mix of AMD Radeon and Nvidia RTX architectures across a single bottlenecked x16 interface. While bandwidth sharing across six cards will introduce performance limits, it remains a remarkable proof-of-concept for high-density local model inference.

## BACKGROUND

PCIe (Peripheral Component Interconnect Express) is a high-speed standard used to connect hardware components like graphics cards inside computers using lanes that send and receive data. A PCIe switch allows multiple devices to share a single PCIe slot by routing data traffic dynamically between the host system and the connected expansion cards.

## REFERENCES

## KEYWORDS

#Hardware#GPU#LocalLLaMA#PCIe#AI Infrastructure

$ subscribe --daily