The pattern nobody wants to admit: our metrics are mostly theater
Look across those headlines and a single theme jumps out: the machines are getting smarter, the channels are getting weirder, and our measurement is still stuck in 2016.
AI is rewriting search results, rewriting your copy, deciding what your content “means,” and even rewriting your LinkedIn posts. Meanwhile:
- Zero-click searches are eating your top-of-funnel.
- AI-driven ad products are bundling targeting, bidding, and creative into black boxes.
- Incrementality is suddenly a CTV buzzword because CFOs are done funding vibes.
- Most “performance” dashboards are still CTR, CPC, ROAS, and channel-reported conversions.
In other words: the environment is AI-native, but the metrics are pre-AI. That gap is where a lot of wasted budget and bad decisions live.
This is not a “measure what matters” pep talk. This is a practical operating system for CMOs and performance leaders who need to stop optimizing for pretty screenshots and start building an AI-era measurement stack that survives:
- Zero-click search and AI overviews
- Black-box ad products (Performance Max, Advantage+, etc.)
- Cross-device journeys that attribution tools barely see
- Short-termism and CFO scrutiny
The three jobs your measurement system must do now
If you strip away dashboards and vendor decks, a modern measurement system has three non-negotiable jobs:
- Prove that marketing grows the business (to finance and the board).
- Guide where the next dollar goes (channel, creative, audience, offer).
- Detect when the environment changes (AI search, new formats, algorithm shifts).
Most teams are over-invested in job #2 (micro-optimization) and under-built on #1 and #3. That’s why “most marketing metrics are misleading” resonates so hard.
The fix is not “more data.” It’s a different hierarchy.
The AI-era measurement hierarchy
Think of your measurement stack as four layers. If you’re arguing about click-through rate and you don’t have layer 1 and 2 in place, you’re doing analytics cosplay.
Layer 1: Business outcomes (your non-negotiables)
This is the stuff that survives any tool, channel, or algorithm:
- Revenue (by segment, by product, by cohort)
- Profit / contribution margin (after media and discounts)
- Customer acquisition cost (CAC) and payback period
- Customer lifetime value (LTV) and retention
- Pipeline and closed-won (for B2B)
These should be owned by finance and marketing together. If your “performance” dashboard doesn’t ladder cleanly into this view, you’re not optimizing performance; you’re optimizing platform reports.
Layer 2: Causal truth (what actually moves those outcomes)
This is where most orgs are light. You need at least one reliable way to answer:
“If we turned this thing off, what would actually happen to the business?”
In an AI-driven, black-box world, this layer matters more than ever. Practical options:
- Geo experiments / holdouts: Turn media off in specific regions or DMAs and compare revenue, leads, or sign-ups vs. controls.
- Platform experiments: Use built-in lift tests (Meta Conversion Lift, YouTube Brand Lift, CTV incrementality tests) but treat them as inputs, not gospel.
- Media mix modeling (MMM): Lightweight, high-frequency MMM that ingests spend, outcomes, and external factors to estimate channel contributions.
- Offer and journey tests: Experiment with different offers, landing experiences, and sales motions to see what actually closes revenue, not just drives clicks.
If you can’t point to at least one live experiment or model that shows incremental impact per major channel, you’re flying blind-no matter how good your ROAS looks.
Layer 3: Diagnostic metrics (where and how to improve)
This is where CTR, CPC, conversion rate, scroll depth, and all the usual suspects live. They are useful, but only if:
- They are explicitly mapped to a business outcome.
- They are used to diagnose, not to declare victory.
- They are interpreted in the context of experiments and MMM, not instead of them.
Example: a 37% increase in “business inquiries” is only meaningful if:
- You know how many turned into qualified opportunities.
- You know whether those opportunities closed at comparable rates.
- You can see whether that lift was incremental vs. other channels or brand demand.
Layer 4: Platform vanity (what makes nice screenshots)
This is the stuff AI is best at gaming and platforms are best at selling:
- Engagement rate on social posts
- Impressions, reach, view-throughs
- “Optimized” ROAS from black-box campaigns
- AI content volume, keyword rankings in isolation
You don’t ignore these; you just never make budget decisions based solely on them. They’re supporting evidence, not the case.
AI is breaking your old metrics faster than you think
The headlines tell a consistent story:
- AI decides what your content means-and often gets it wrong.
- Search is shifting from “10 blue links” to AI overviews and persuasion.
- Zero-click searches are collapsing top-of-funnel visibility.
- AI-generated content is everywhere, and “is AI content bad for SEO?” is the wrong question.
The real question is: What happens to your funnel when the interface between you and the user is an AI layer you don’t control?
That has three big implications for measurement.
Implication 1: You can’t count on clicks as your primary signal
Zero-click and AI answers mean:
- More brand impact without site visits.
- More assist value from content that never shows up in your analytics.
- More decision-making happening inside Google, TikTok, LinkedIn, or a model’s context window.
If your only view of performance is “traffic and conversions from our site,” you’ll under-invest in the parts of the journey AI now controls.
Practical move: add brand and demand metrics that don’t depend on clicks:
- Search volume for branded and category terms.
- Direct traffic and “dark social” proxies (e.g., “how did you hear about us?” fields).
- Share of voice in AI overviews and answer boxes (manual checks for now; tools are emerging).
Implication 2: Attribution is getting worse, not better
AI-driven ad products bundle:
- Targeting
- Bidding
- Creative selection
- Placement
…into a single campaign type with a single performance number. Great for scale, terrible for understanding what’s actually working.
That’s why CTV and AI-driven ads are suddenly talking about “incrementality” again. It’s the only sane way to justify spend when your line of sight into the path is fading.
Practical move: treat attribution as a directional tool, not a source of truth. Use:
- Last-touch / data-driven attribution for tactical optimization.
- Experiments and MMM for strategic budget allocation.
- Simple sanity checks: if platform-reported conversions spike but revenue doesn’t, believe revenue.
Implication 3: “More content” is not a strategy; persuasion is
AI can write infinite blog posts, ads, and landing pages. That’s why we’re seeing:
- Keyword cannibalization problems at scale.
- Title tag rewrites by the thousands.
- AI content that technically ranks but doesn’t convert.
Search is moving from “who has the most content” to “who is most persuasive to the model and the user.” That means your metrics need to move from volume to conversion quality and persuasion power.
Practical moves:
- Track qualified conversions, not just form fills or leads.
- Measure sales cycle length and close rate by content touchpoint where possible.
- Instrument on-page behavior for high-intent signals (e.g., pricing interactions, feature comparisons) instead of generic “time on site.”
The operator’s playbook: five changes to make this quarter
You don’t need a five-year roadmap. You need a few sharp moves that change how your team thinks and spends.
1. Rewrite your KPI stack from the top down
For each major initiative (e.g., “grow self-serve revenue,” “expand in enterprise,” “launch new product”), define:
- 1-2 business KPIs: revenue, CAC, payback, LTV, pipeline.
- 2-3 causal KPIs: incremental lift from tests, MMM-estimated contribution, geo experiment results.
- 3-5 diagnostic KPIs: conversion rates, engagement on key assets, qualified lead volume.
Anything that doesn’t roll up into that structure is noise. Stop reporting it weekly.
2. Institutionalize experiments, not “optimizations”
Replace “we optimized X” with “we ran an experiment on X.” That sounds semantic, but it changes behavior:
- Every major channel should have at least one live test that can change budget.
- Every test should have a pre-defined decision rule (what will we do if this wins/loses?).
- Results should be logged in a simple, searchable experiment library.
This is how you survive algorithm shifts and AI product changes: you’re always running your own reality checks.
3. Build one shared “truth view” with finance
The most dangerous metric is the one marketing believes and finance doesn’t.
Stand up a simple, shared revenue and CAC view that:
- Starts from actuals (booked revenue, invoiced, or recognized).
- Backs into marketing’s contribution using experiments and MMM where possible.
- Is reviewed monthly with finance and sales, not just within marketing.
Once that exists, you can safely ignore a lot of platform noise.
4. Treat AI tools as interns, not oracles
AI writing, video editing, and analytics tools are great at:
- Generating options (headlines, hooks, angles).
- Summarizing data and surfacing anomalies.
- Speeding up production and iteration.
They are terrible at:
- Understanding your actual economics.
- Knowing what your CFO cares about.
- Designing experiments that protect you from false positives.
Set a simple rule: AI can propose tests, but only humans can set KPIs and decision rules. That keeps your measurement grounded in business reality, not model hallucinations.
5. Promote people who can read a P&L, not just a platform
The “T-shaped marketer” is giving way to the “M-shaped” operator: deep in a few areas, competent across many, and commercially fluent.
In practice, that means your best media buyers and growth leads should:
- Understand unit economics and contribution margin.
- Be able to explain incrementality to a CFO in one slide.
- Know when to ignore a platform metric because it conflicts with revenue reality.
AI can run bid strategies. It cannot yet explain, credibly, why your CAC is creeping up while reported ROAS is flat. That’s the skill set you should be rewarding.
The quiet competitive advantage: being less wrong, faster
In an AI-driven, zero-click, black-box world, nobody’s measurement is perfect. The winners will not be the brands with the fanciest dashboards; they’ll be the ones who are:
- Clear about which metrics actually matter.
- Disciplined about testing what the platforms tell them.
- Honest about the gap between reported performance and real business impact.
You don’t need omniscience. You just need to be less wrong, faster, than the brand competing for the same customer in the same AI-shaped feed.