LocalLLaMA Community Explores Use Cases for K2 Horizon MoVA 36B-A4B
Members of the r/LocalLLaMA community are seeking real-world user feedback and deployment scenarios for K2-Horizon-MoVA-36B-A4B, a recently released open Mixture-of-Experts model. Developed by the Institute of Foundation Models (IFM), the model features 36 billion total parameters with only 4 billion active parameters per token. Sparse Mixture-of-Experts (MoE) architectures allow local AI enthusiasts to run high-capacity models with significantly reduced computational inference costs. Community feedback helps open-source developers determine whether models like K2 Horizon MoVA offer practical advantages over traditional dense models on consumer hardware. K2 Horizon MoVA 36B-A4B performs close to the dense Horizon 32B model while utilizing drastically fewer active parameters and natively supporting up to a 512K context window. Released under the Apache-2.0 license, it provides day-zero support for popular inference engines including vLLM, SGLang, and Ollama.
## BACKGROUND
Mixture of Experts (MoE) is an architecture that routes tokens to specialized sub-networks, enabling low per-token inference overhead compared to dense models where every parameter active. IFM's K2 Horizon collection is a fully open suite of models that provides open weights, training code, and datasets. By using sparse routing, 36B-A4B aims to deliver high-quality outputs while keeping memory bandwidth requirements accessible for local hardware.