Proposing BitTorrent for Decentralized Hosting of Large Language Models
A discussion on the r/LocalLLaMA subreddit proposes using BitTorrent as a decentralized, cost-effective alternative to Hugging Face for hosting and distributing large language model (LLM) files. This approach aims to leverage community bandwidth to alleviate the high infrastructure costs associated with centralized hosting. As open-source AI models grow larger, hosting platforms like Hugging Face face massive bandwidth costs. Transitioning to decentralized protocols like BitTorrent could democratize model distribution and ensure long-term availability without relying on single centralized entities. Since open-source model weights are free and legally shareable, torrenting avoids copyright issues typically associated with peer-to-peer sharing. However, challenges remain regarding version control, searchability, and the need for persistent seeders to ensure fast download speeds.
## BACKGROUND
Hugging Face is currently the primary centralized repository for hosting open-source AI models, datasets, and web applications. BitTorrent is a peer-to-peer (P2P) file-sharing protocol that distributes the bandwidth load of downloading large files across multiple users instead of a single server.