DeepSeek-V4-Flash Debuts at #21 Overall in Agent Arena Benchmark
DeepSeek-V4-Flash-20260731 has debuted at #21 overall and #3 among open-source models on the Agent Arena leaderboard. The model outperformed the Pro version of DeepSeek-V4 by six ranks, showing a net improvement of 1.98% based on over 12,500 real-world agentic sessions. This release demonstrates that lightweight "Flash" models can outperform larger "Pro" variants in complex, agentic workflows that require tool orchestration. It highlights the rapid progress of open-source AI in handling real-world tasks, closing the gap with proprietary models. Across key performance signals, the model achieved a 6.99% increase in confirmed success and a 2.53% improvement in bash recovery, though it saw a 2.31% decline in steerability. It also showed a 1.2% improvement in mitigating tool hallucinations.
## BACKGROUND
Agent Arena is a benchmark that evaluates how effectively AI models orchestrate external tools to complete real-world tasks. Tool hallucination refers to a common failure mode where AI agents fabricate or misuse APIs, leading to incorrect task execution.