Artificial Analysis Releases Intelligence Index v5 Major Update
Artificial Analysis has released the Intelligence Index v5, a major benchmark update that aggregates nine challenging evaluations to measure AI capabilities. This update significantly widens the performance gap between open-weight and closed-source models. This update shifts the perceived gap between open-weight and proprietary models in the AI industry, impacting how developers and enterprises choose LLMs. However, the methodology has sparked debate regarding its reproducibility and accuracy. Version 5 relies on private test sets or held-out answers for 60% of the index, making independent reproduction impossible. It reports that the gap for open weights has widened from 3 points to 12 points.
## BACKGROUND
Artificial Analysis is an independent AI benchmarking organization that aggregates various performance metrics into composite scores. Open-weight models refer to AI models whose trained parameter weights are publicly accessible, though not always fully open-source.