Reddit Thread Explores Real-World Usage and Preferences for Local LLMs
A popular thread on the r/LocalLLaMA subreddit has developers and AI enthusiasts sharing their actual usage statistics, workflows, and preferred local large language models (LLMs) for daily tasks. The original poster shared their setup of tracking usage via a JSON file, combining local models with tools like OpenRouter and Codex CLI. Understanding real-world developer adoption and usage patterns helps highlight the practical viability of open-source local models compared to proprietary cloud APIs. It also showcases how developers integrate local LLMs with commercial developer tools for hybrid workflows. Users in the thread discuss utilizing various open-weight models, including cost-effective Chinese models accessed via OpenRouter, alongside local setups. The discussion highlights tools like Codex CLI for professional work and custom JSON-based tracking systems to monitor tokens-per-second performance.
## BACKGROUND
Local LLMs are AI models run directly on a user's hardware, offering privacy, offline access, and cost savings compared to cloud-hosted APIs. OpenRouter is a platform that provides a unified API to access and route requests to hundreds of different AI models, while Codex CLI is an AI coding agent that runs locally in the terminal.