THE GRAND BARGAIN
The open web ran on an implicit deal: search engines crawl your content for free, and in exchange they send you traffic you can monetize. Publishers tolerated indexing because the referral was the payment. AI Overviews break the bargain by answering the query without forwarding the click.
WHY 90% IS THE NUMBER THAT MATTERS
Digital ad revenue scales linearly with pageviews. A 90% referral collapse is not a haircut — it is a business-model extinction event for any publisher whose costs (reporters, editors, hosting) were calibrated to the pre-AI traffic baseline. Most newsrooms cannot survive a 50% cut, let alone 90%.
THE GATEKEEPER DESIGNATION
The EU's Digital Markets Act took effect in 2023 and designated six 'gatekeepers' — Alphabet, Amazon, Apple, ByteDance, Meta, Microsoft — based on user count, market cap, and entrenched market position. Gatekeepers face obligations the rest of the market does not, including bans on self-preferencing in search results.
THE ROBOTS.TXT TRAP
Publishers who block Google's AI crawler risk being deindexed from regular search too — the bots share infrastructure and the opt-outs are entangled. This is the leverage: the same company that takes your content for AI training is the one whose referral traffic you cannot afford to lose.
THE SUBSCRIPTION API PIVOT
A licensing API reframes the relationship: instead of crawling for free and sending traffic, Google would pay (or charge readers) for structured access to publisher content. This mirrors what OpenAI has done with the AP, News Corp, and Axel Springer — bilateral deals that bypass the open-web compact entirely. The losers are publishers too small to negotiate individually.
THE PRECEDENT
Australia's 2021 News Media Bargaining Code forced Google and Meta to pay Australian publishers for news links. Google briefly threatened to pull search from Australia; both companies ultimately signed deals worth a few hundred million dollars annually. Canada passed a similar law in 2023; Meta blocked news entirely on Facebook and Instagram in Canada in response.