Your AI ROI Is Hiding in the Judgment Layer
Everyone installed the AI stack. Nobody sharpened the judgment that converts spend into return.
You did what the field told you to do. You installed the stack, you stood up the human review loop, and you partially rewrote the roles. 94% of HR leaders say they plan to redefine job roles to reflect how AI is changing day-to-day work2, so you are on schedule. Yet, your board is still asking where the return is.
Conor Grennan, who founded AI Mindset and teaches at NYU Stern, named the phenomenon on July 317. “Every other technology you’ve ever bought came with its own meter in the box,” he wrote. AI shipped without one. Nothing on the invoice tells you what the judgment behind the output was worth.
The spend is real. The tools work. The return is waiting on a decision nobody has made.
Your return did not go missing. It is hiding, and that is a different problem with a different fix. The stack is the machine, and the machine is running dull. Judgment is the edge to sharpen.
📬 Every week I translate research into actionable plays you can run in your organization to discover the ROI hidden in your AI spend. Receive the AI Playbook in your inbox and use it as part of your strategic plan for the week.
The Return Isn’t Gone—It’s Hiding in the Judgment Layer
The return is not hiding in the model. It is hiding in the decisions that turn AI output into priced, shipped, invoiced work. Which draft ships. Which forecast finance acts on. Which confident but hallucinated answer a person kills before a customer ever sees it.
Four instruments that leverage or evaluate judgment landed in seven days. Each one points at that crucial decision layer; I’ll name each one here and reference back as I lay out the rest of my analysis.
Finn’s WEF piece, July 29. Jessica Finn leads health, life sciences and education for Cognizant in Australia. On the World Economic Forum‘s site, she told companies to rebuild work into “development loops, where judgment, context and accountability are what is learned, tested and trusted”1. She prescribes the loop. She never names who runs it.
Grennan’s meter, July 31. The diagnosis above, with a prescription attached: define what your people produce today, then name which numbers should move if AI made them faster7. He stops at setting the target.
Carter’s judgment audit, August 1. David Paul Carter advises founder-led companies between $2M and $15M in revenue. He published a six-field decision journal: the call, the prediction, your confidence, and what would prove you wrong4. It grades a founder’s own past decisions.
The HBR finding, July 28. Harvard Business Review reported on a study of early-career professionals5. How junior staff actually use AI day to day predicts how well they perform. It predicts better than the skills on their résumé, and better than any AI training they have taken. Behavior beats credentials.
If no one owns the judgment your AI depends on, who converts the hours it saves into revenue?
One source sits underneath two of those four, so it earns its own grounding. The Cognizant–Pearson survey, published June 18, is Wakefield’s poll of 750 HR leaders at director level and above, at companies of 1,000 employees or more in the US, UK and India2. It supplies every workforce figure in this Call, and it measures what HR leaders expect rather than what anyone observed. The distance between what they expect and what they fund is the finding.
That timing matters. The WEF pages I drew on three weeks ago for The Apprenticeship the Machine Ate went further this week10, but Finn’s argument rests on that same March–April fieldwork. Her codification is new; the evidence is not.
All four measure judgment or prompt it. None of them converts it into a measurable P&L lever. Finn prescribes the “loop” and leaves the owner’s chair empty. Grennan hands you the meter and stops at the target. Carter grades a founder’s own calls. HBR tells you to train people but never says who decides what those people must learn to judge.
I named this pattern in The Judgement Premium on June 3, 2026, and carried it through The Sophistication Gap a week later8,9. Last week four separate practitioners shipped instruments aimed at that same layer. The pattern is no longer mine alone to argue.
What a Dull Judgment Layer Costs
The four instruments describe the gap. Nirit Cohen explains how it opened. Cohen held senior global people roles at Intel. She now runs Workfutures, a practice on the future of work. On Ross Dawson’s Humans + AI podcast on July 29, she named the mechanism6. Cohen argued that people used to earn judgment by doing the work that qualified them to review someone else’s. When you automate that work the qualification never happens. “If I’ve never seen what good versus bad looks like, how will I be able to tell?”
Dawson, the futurist I credited in The Judgement Premium when I gave that metric its three indicators, took her point one step further. He argues that when you park people as approval mechanisms without the guidance to discern output quality for themselves, it’s “naturally going to erode judgment and expertise”6.
There’s a step beyond the mechanistic “loop” supervision Dawson and Cohen describe that is not captured by their argument. If a “loop” is meant to make a process more efficient, that is, save time–who determines how those saved hours are spent? Saved hours do not magically convert themselves into output that moves your P&L. Automate the work, leave the judgment layer dull, and the machine runs at full speed while your workforce loses the ability to judge what it produces and the organization squanders the opportunity to re-direct efficiencies towards revenue.
A dull edge doesn’t stop the machine. It quietly forfeits every cut the machine was bought to make.
Two surveys now price that lack of ownership, one from inside the workforce and one from the leadership suite.
Inside the workforce
The Cognizant–Pearson survey measures what the people closest to the work expect, and what their organizations are funding against it.
Companies fund the expectation at half strength. 96% of HR leaders expect entry-level roles to become jobs that supervise AI within 5 years. 46% are not proactively investing in AI training1,2. That is a 50-point gap between the future they say is coming and the development they are investing in to actually reach it.
Demand outruns capacity. 91% report that employee requests for AI training rose over the past year. Another 60% say their learning and development programs cannot keep up with how fast AI is changing job functions2.
The hiring release-valve is closing. 64% say they cannot find the right talent, because AI keeps changing what they need to hire for2.
From the leadership suite
The KPMG Pulse finds the same shape among the people who sign the cheques. KPMG surveyed 2,145 senior leaders across 20 markets, at companies above $100M in revenue, between late April and late May3. Two of its numbers belong on your board deck.
Only 7% report established ROI on AI. Nearly one in four, 24%, already face investor pressure to prove value3.
Only 24% say their CEO is accountable for AI-driven business outcomes. Another 29% point to “the broader C-suite,” which KPMG reads, in its own words, as responsibility that “often stops at the sponsorship level rather than true accountability”3.
Then the number that should stop a board meeting. Companies that name accountability clearly report established ROI at 14%, against 4% for companies that do not3. That is 3.5 times the rate and a 10-point spread. KPMG sells AI advisory, so weigh their framing accordingly, and note what the numbers do on their own: the returns materialize 3.5x when there’s a named owner for AI ROI in the leadership suite.
The Four Motions That Capture and Build Return in the Judgment Layer
If the return is hiding in the judgment layer, then capturing it is a sequence rather than a purchase. Four moves, in order:
Locate. Find the decisions where human judgment turns AI output into revenue, cost, or cycle time. Most organizations have never written that list down.
Name. Say who owns each of those decisions today, and what it would cost you to lose them. An owner turns a capability into something one person owns.
Sharpen. Aim development at sharpening those specific decisions rather than at general AI fluency. Not funding training is a problem; funding the wrong training is a more expensive one.
Instrument. Put the return on board-reportable metrics. The Judgement Premium named three: decision-cycle reduction, decision-reversal rate, and board-level visibility.8
You cannot sharpen what you have not located. You cannot capture what nobody owns.
Judgment is the lead lever in that sequence. It is not the only one though. Role redesign, clean data, psychological safety, training and many other factors capture hidden revenue. A serious read of a business finds the factors that unlock the most return.
I’ve named and instrumented that sequence as The AI ROI Map: a systemic analysis that determines where your AI spend is paying, where it’s forfeiting return, and the moves that capture it. This is the missing motion in the expert analysis and survey data so far. Every instrument that shipped last week1,4,7 points at the gap and offers no mechanism for finding or capturing the revenue. The AI ROI Map completes the motion and uncovers the ROI hiding in your AI spend.
Carter’s founder judgement audit instrument is the sharpest on decision refinement, and he is clear about its limits. “The ideas are theirs”; he writes of Tetlock’s calibration research and Annie Duke’s kill criteria4. “The format is mine,” he concludes. A founder scores a personal record in five minutes per decision. That is a good instrument, but it was never built to be an organizational-wide audit.
Where the Field Agrees, and What It Leaves on the Table
The first objection: Finn already delivered quietly. Her definition contains the word: judgment, context and accountability as the instructive asset in the automation loop.
Finn’s loop teaches accountability. It does not name an owner. Those are two different acts. A curriculum tells people what accountability means; governance names the person who owns it. Read her piece end to end and you will not find accountability defined as owned responsibility for outcomes. No one owns the loop. No one grades the judgment it produces. No one decides what judgment the business will need next quarter.
Cohen in conversation with Dawson is the most candid voice in the whole conversation. Dawson asked her directly how organizations grow expertise when nobody does the work that used to build it. Her answer, on the record: “I don’t know that there is an answer yet”6. The field’s sharpest thinker on judgment formation has named the problem and stopped at the edge of the answer.
The second objection is structural: scholars, practitioners and researchers point to AI failure statistics. A shortfall is not a strategy. Counting what failed only uncovers part of the story; it doesn’t tell you where ROI went, or how to capture it.
64% of HR leaders say they can no longer hire the skills they need. The judgment you cannot buy, you have to build.
The field does agree on direction, however. HBR concluded that leaders must train people to work with AI rather than assume skilled employees will figure it out5. Kathy Diaz, Cognizant’s CHRO, said the same of her own function: AI “is reshaping the talent landscape and exposing the limits of traditional talent and learning models”2. Everyone agrees on the diagnosis. Nobody decoded the capture mechanism.
So when you sit down with the AI implementations your team built this quarter, the question is not which instrument to buy next. Three motions actually replace that procurement question:
Define which decisions still turn AI output into revenue,
Decide who owns those decisions specifically, and
Be strategic about the capabilities your training budget actually develops.
This is one of the sequences I advise on. I don’t promise AI ROI. This is one of the ways I instrument it. The Human Dividend is the compounding return on the human capability your AI investment already depends on.
In The Apprenticeship the Machine Ate I closed by saying that the measurements to rebuild that junior talent on-ramp was territory for a coming Call. This is that Call: The AI ROI Map reveals where your AI spend is paying, where it’s forfeiting return, and instruments the moves that capture it. The machine is already yours. The first move is to sharpen the judgment layer that keeps your AI implementation paying.
Untrained judgment forfeits the return. Sharpened judgment captures it.
You’ve already done the hard part—you know which decisions in your business actually matter. Sharpen that edge and start capturing more AI ROI.
The AI Leadership Playbook
Strategic Questions [Copy-paste ready for an email to your CFO and CHRO.]
Which decisions in our operation still require human judgment to turn AI output into revenue, cost savings, or reduced cycle time; and where is that list written down? If it is not written down anywhere, who is drafting it this quarter?
Who owns each of those decisions today, by name, and what would it cost us if we lose them? Start by naming who we’d hire if those decision owners resigned on Friday.
What is our AI training budget aimed at, specifically? Tool fluency, or sharpening the decisions above?
Your Next Plays
Run a judgment inventory on one workflow, not the whole company. Pick the workflow where AI output sits closest to revenue. List every decision a person still owns, and mark the ones a new hire could not make. That marked list is your judgment layer.
Put a name next to the automation. Every AI deployment gets an owner. Each owner scores that deployment’s output against a codified standard, meaning a written description of what good looks like for that output in your business. An unowned AI deployment reports activity. An owned one reports capability.
Instrument three decisions before you instrument the enterprise. Track how long they take, how often someone reverses them, and how often they reach the board. Three tracked decisions give you a baseline; a dashboard with no baseline gives you a chart.
📅 Book a complimentary 1:1 Strategy Session—45 minutes to start the conversation about mapping the revenue hidden in your AI spend.
📬 Every week I translate research into actionable plays you can run in your organization to discover the ROI hidden in your AI spend. Receive the AI Playbook in your inbox and use it as part of your strategic plan for the week.
Sources
4. David Paul Carter, “The Judgment Audit, Part 2: Building the Scoreboard,” August 1, 2026.
6. Ross Dawson with Nirit Cohen, Humans + AI, Episode 52, July 29, 2026.
7. Conor Grennan, “How to Actually Measure ROI of AI,” AI Mindset, July 31, 2026.
8. Paola Sanmiguel, “The Judgement Premium,” CognivaLab, June 3, 2026.
9. Paola Sanmiguel, “The Sophistication Gap,” CognivaLab, June 9, 2026.
10. Paola Sanmiguel, “The Apprenticeship the Machine Ate,” CognivaLab, July 14, 2026.