The AI DownsideDocumenting AI's downsides

AI Search

AI Companies Keep Reinventing Search

Everyone is building an “answer engine,” everyone is rediscovering the same problems, and the citations still don't quite add up.

Abstract editorial illustration for “AI Companies Keep Reinventing Search”.

There is a peculiar consensus in the AI industry that traditional search is broken and that the answer engine — ask a question, get a synthesised reply with citations — is the obvious successor. Nearly every major player now has one, or is building one. What is striking, watching this unfold, is how thoroughly each new entrant rediscovers the problems that made search hard in the first place, as though the last thirty years of information retrieval simply had not happened.

The problems search already had

Search was never just about matching words to pages. The hard parts were always the same, and they have not gone anywhere:

  • Which sources do you trust? The web is full of confident nonsense, spam, and material written specifically to rank. Deciding what is authoritative is the entire game, and it is a game answer engines have to play too — except now the judgement is hidden inside a model rather than visible in a ranking.
  • How fresh is the answer? Information goes stale. An answer engine that confidently states last year's price, policy or fact has the same problem search always had, minus the date stamp that at least let you notice.
  • How do you handle the contested question? Plenty of real questions have no settled answer. A list of links honestly represents disagreement. A single synthesised paragraph has to either flatten the disagreement or hedge into uselessness.
The answer engine did not make search's hard problems disappear. It moved them inside a model, where you can no longer see how they were resolved.

The disappearing skill of looking things up

There is a subtler loss buried in the shift from links to answers, and it is a loss of a human skill rather than a technical one. Sifting a page of results — weighing sources, cross-checking claims, noticing when something does not add up — is a genuine competence, one that a generation quietly acquired by using search engines badly and gradually getting better at it. The answer engine removes the need to practise it. Why learn to evaluate sources when a paragraph arrives pre-evaluated? The skill atrophies through disuse, and with it goes the very ability you would need to tell when the confident paragraph is wrong.

This matters because the answer engine is least reliable exactly when independent judgement is most needed — on contested questions, fresh events, and the specific details it is prone to fabricating. A population that has outsourced the work of evaluation to a machine is a population poorly equipped to catch the machine's mistakes, which is an uncomfortable place to be as more of our information arrives pre-digested. The old blue links were tedious, and they made you do the work. It turns out the tedium was doing something. Reinventing search as a single confident answer does not just move its hard problems out of view; it slowly removes our practice at the thing we would need in order to notice when the answer is wrong.

The citation that does not support the claim

Answer engines lean heavily on citations to establish trust — little numbered links after each sentence, the visual grammar of a well-researched essay. The trouble is that the citation and the claim are generated by different logic, and they do not always agree. Users regularly find that a cited source does not actually say what the answer attributes to it, or says something subtly different, or is a thin page that happened to rank rather than an authority. The citation looks like rigour. Checking it reveals how much of the rigour is decorative.

This is the same confidence problem we keep circling. A cited, formatted, authoritative-looking answer earns a trust that a raw list of links never demanded — and when the underlying synthesis is wrong, the citations lend it a credibility it has not earned.

The business model reinvents the old sins too

It is not only the technical problems being rediscovered. The commercial ones are queuing up behind them. Search became worse over the years partly because it became an advertising surface, and the incentives of “answer the user” and “serve the advertiser” slowly diverged. Answer engines are already edging toward the same cliff: once you need to monetise, the pressure to shape the answer — to favour a partner, to insert a sponsored recommendation into what looks like neutral synthesis — is exactly the pressure that degraded the thing they set out to replace. A sponsored answer is far harder to spot than a sponsored link.

And the supply problem they would rather not mention

Then there is the contradiction we have written about before: answer engines are built on the open web while removing the traffic that funds it. Every reinvention of search that answers the question on its own page is quietly eroding the sources it depends on. This is not a problem you can engineer around, because it is not a bug in the product; it is the product working as designed.

A little humility would help

The confidence problem, inherited and amplified

Traditional search had a quiet virtue that answer engines throw away: it never pretended to know. Ten blue links made no claim to truth; they were an honest admission that here are some places that might help, you decide. That humility was the interface telling you the truth about the machine's actual epistemic state, which is “I can find relevant text, I cannot vouch for it.” The answer engine discards that humility and speaks in a single confident voice, inheriting search's underlying uncertainty about what is true while stripping away the one design choice that used to signal it.

So the contested question, the stale fact, the thin source that happened to rank — all the old failure modes are still there, but now they arrive laundered through a fluent paragraph that sounds settled. The engine has not become more certain about the world; it has merely stopped showing you its uncertainty. That is arguably a regression dressed as an advance: the same unreliable substrate, with the warning label removed. A system that knew exactly as little as before but now says it with total composure has not solved search's hard problem. It has hidden it behind better prose.

The monetisation cliff is visible from here

Everything degrades once the advertising arrives, and it will arrive, because the economics demand it. Running these systems is expensive, far more so per query than serving links, and the free products burning through investor money will eventually need to pay for themselves. The moment they do, the same pressure that hollowed out traditional search — the slow divergence between “answer the user” and “serve whoever pays” — will bear down on the answer engine, and it will be far harder to resist. A sponsored link at least announces itself as an ad. A sponsored answer, woven invisibly into what reads as neutral synthesis, is a far more powerful and far less honest instrument.

That is the destination this reinvention is quietly driving toward, and it is worth naming before it arrives, because once it does it will be defended as normal. The industry set out to replace a search experience that got worse because it became an ad surface, using a technology that is even more expensive to run and therefore under even greater pressure to become an ad surface. The wheel is not just being reinvented; it is being reinvented on a steeper hill. The compromises that ruined the incumbent are not behind us. For the answer engines, most of them are still ahead.

Retrieval does not repeal the old trade-offs

Defenders will point out that modern answer engines ground themselves in freshly retrieved sources rather than relying on stale training data, and this genuinely helps. But grounding does not repeal the hard problems of search; it relocates them. To retrieve good sources you must first rank them — which is the original problem of deciding what to trust, now performed invisibly inside the system rather than displayed for you to judge. To synthesise them you must decide what they collectively mean, which on any contested question requires exactly the editorial judgement that a list of links used to leave to the reader. Retrieval changes where the trade-offs are made. It does not make them disappear, and it hides the ones it moves.

So the answer engine ends up quietly re-implementing the entire discipline of search — ranking, freshness, source quality, handling disagreement — inside a model, and then presenting the result as if these problems had been solved rather than merely concealed. The failures are the same failures information retrieval has wrestled with for decades; they are just harder to see, because the seams where a human could have spotted a weak source or a contested claim have been smoothed over into fluent prose. That is the recurring theme of every reinvention here: not a new answer to search's hard questions, but a new place to hide them. A little humility about that — an acknowledgement that this is a hard, old problem being re-approached, not a solved one being unveiled — would go a long way, and its absence is the tell that we are watching marketing reinvent the wheel rather than engineering transcend it.

None of this means answer engines are worthless. For some questions — synthesising across a few sources, getting oriented in an unfamiliar topic — they are genuinely better than sifting links, and that value is real. The plea is for humility. Search is not an unsolved problem that AI happened to walk in and crack; it is a hard, decades-old discipline full of trade-offs that were understood long before the current wave. Each answer engine that treats those trade-offs as newly discovered is destined to rebuild the same compromises, ship the same failure modes, and eventually make the same peace with advertising that made the incumbent worth replacing in the first place. The wheel is being reinvented. It is coming out roughly round.

Related grievances

All articles →