Arcon: Exploring Agentic Scaffolding for Small 4B Local Models

Developer /u/Feathered-Beast introduced Arcon, an open-source project exploring how to turn a small 4B local language model into a capable AI assistant. The project uses a Qwen 4B base model fine-tuned with LoRA, wrapping it in scaffolding that manages persistent memory, personality state, tool use, and pre-response processing. Small 4B models are lightweight enough to run locally on consumer hardware, but they often lack the innate reasoning abilities of much larger models. Demonstrating that agentic scaffolding—such as memory systems and planning loops—can significantly boost the capabilities of small models could accelerate the adoption of privacy-focused, low-resource local AI assistants. Arcon relies on LoRA fine-tuning to adapt the Qwen 4B base model for agentic behavior without high computational overhead. The architecture includes internal state tracking for personality and mood, allowing the model to perform background reasoning steps and call tools before presenting its final response.