The cost of intelligence: How CIOs can manage AI demand at scale

Articles & Reports
 |  
Jul 2026
 |  
McKinsey
Save to favorites
Your item is now saved. It can take a few minutes to sync into your saved list.

What: CIOs need stronger AI cost governance as enterprise adoption shifts from isolated pilots to large-scale, usage-based deployment.

Why it is important: This shift matters because retailers scaling AI face the same pressure to connect usage, governance, and investment discipline to measurable business outcomes.

McKinsey argues that enterprise AI spending is becoming harder to control as companies move from isolated pilots to broad deployment. AI costs can rise faster than traditional technology budgets because usage is fragmented across business units, vendors, software platforms, and employee-built workflows. According to McKinsey’s May 2026 Enterprise AI FinOps survey, AI spend increases nearly fourfold as organisations scale adoption, while 93 percent of respondents report exceeding their AI budgets. A majority also expect AI spending to rise by at least 25 percent over the next 12 months. The article identifies several causes: unpredictable token usage, consumption-based pricing, immature governance, unclear model-selection rules, and citizen developers creating AI workflows outside central IT. McKinsey recommends treating AI cost management as “enterprise AI tokenomics,” or FinOps for AI. CIOs should build visibility into spend, track token consumption, allocate costs to business outcomes, forecast demand, and optimise usage through measures such as model routing, prompt caching, and stronger governance. Thoughtful AI consumption can reduce costs by 20–30 percent while redirecting investment toward higher-value use cases.

IADS Notes: AI cost management is becoming a strategic retail issue because the sector is moving from scattered experimentation to enterprise-wide deployment without always having the governance, operating models, or financial discipline needed to control usage. In July 2026, ERE Media warned that current AI pricing may be artificially low, making automation and workforce decisions vulnerable to future cost increases. WWD in July 2026 similarly showed that retailers are increasing AI investment but still struggling to convert automation into measurable returns without workflow redesign, data quality, and human-machine collaboration. BCG in June 2026 reinforced that the winners in retail and CPG are those linking AI use cases to financial outcomes, while its February 2026 analysis argued that AI requires a broader redesign of business models, workforce structures, and investment priorities. Forbes in October 2025 added that AI agents are already reshaping pricing, planning, and store operations, making governance, training, and clear boundaries essential as autonomous systems move deeper into retail operations.

The cost of intelligence: How CIOs can manage AI demand at scale