Codex AI Agent Can Now Directly Control Physical iOS and Android Smartphones
OpenAI's Codex AI agent can now directly operate physical iOS and Android smartphones using a new integration called "mobile-harness". This tool enables the agent to interact with real devices, simulators, or emulators. This development marks a significant step forward in mobile automation and agentic AI, expanding Codex's capabilities from software engineering to real-world device interaction. It could streamline mobile app testing, automation, and user interface interaction tasks. The "mobile-harness" tool, developed by MobAI-App, allows direct control of devices using a Domain Specific Language (DSL) and Python-based helpers. It supports automation and testing workflows on both physical phones and emulated environments.
## BACKGROUND
Codex is an AI coding agent developed by OpenAI, originally designed for software engineering tasks like writing code and fixing bugs. While initially released as a CLI and IDE integration, OpenAI has been positioning Codex as a broader enterprise agent platform. "Mobile-harness" is an AI skill that facilitates device interaction by executing Python scripts and helper functions to automate mobile tasks.