Skip to main content

Command Palette

Search for a command to run...

The Model Is Not the Architecture

DeepMind's specialized systems show where reliable AI capability actually comes from

Updated
6 min readView as Markdown
The Model Is Not the Architecture
M
Engineer. Researcher. Builder. I build things for web, experiment with AI, and interested in research.

The most visible AI product is a chat box.

The most instructive AI systems often have no chat box at all.

Look across Google DeepMind's work on algorithms, quantum error correction, robotics, and historical research. The recurring pattern is not one model architecture. It is a carefully designed loop around the model.

A capable model can improve a system. It cannot define the problem, the feedback signal, or the boundary of acceptable failure for you.

That distinction matters because teams often start an AI project by comparing models. DeepMind's portfolio suggests a better starting point: design the environment in which capability has to become useful.


1. Search works because somebody designed the game

AlphaTensor did not receive a vague instruction to invent better matrix-multiplication algorithms. The researchers converted algorithm discovery into a single-player game. The state represented how far a candidate algorithm remained from correctness. The actions changed that state. The objective rewarded reaching a provably correct algorithm efficiently.

Even that description understates the surrounding engineering. DeepMind reports using a neural architecture with problem-specific inductive biases, synthetic data generation, and the symmetries of the mathematical problem. The learned agent mattered. So did the search space it was allowed to explore.

AlphaDev makes the same point closer to production software. It searched assembly instructions for sorting routines while learning a value function tied to expected latency. Implementations derived from its discoveries entered LLVM libc++.

The headline numbers need their conditions attached. The paper reports improvements of up to 70% for sequences of length five and roughly 1.7% for sequences above 250,000 elements, across specified data types and CPU architectures. Those are not universal speedups. They are results from a system whose objective, representation, hardware targets, and verification process were all engineered around one bounded problem.

The model did not merely find an answer. The surrounding architecture made the answer searchable, measurable, and deployable.


2. Accuracy is not enough when the system misses its deadline

AlphaQubit is a useful warning against evaluating a component in isolation.

On the largest reported Sycamore experiments, Google says its decoder made 6% fewer errors than tensor-network methods and 30% fewer than correlated matching. That sounds like a clean win until the operational constraint appears: superconducting processors perform consistency checks about a million times per second, and AlphaQubit was still too slow for real-time correction.

The decoder can be more accurate and still be incomplete as a deployable solution.

This is not a quantum-computing curiosity. It is the same failure mode behind an agent that reasons well but misses a product's latency budget, a retrieval system that finds better evidence but costs too much per request, or a classifier whose average accuracy hides an unacceptable error class.

The relevant unit of evaluation is the whole decision loop under its real constraints. Model quality is one term in that equation, not the equation itself.


3. In robotics, the environment becomes part of the capability

The DemoStart preprint describes a pipeline for difficult robotic manipulation tasks. A few demonstrations seed an automatic curriculum. Reinforcement learning expands the training distribution. Distillation and domain randomization help transfer the resulting policy from simulation to physical hardware.

There is no honest way to point at one component and call it the intelligence.

The demonstrations establish useful starting states. The curriculum chooses what becomes learnable next. The simulator supplies scale. Domain randomization prepares the policy for variation outside simulation. The robot and task definition determine whether any of it worked.

This is the architecture doing epistemic work: it decides what evidence the system sees, which failures produce a learning signal, and which simulated success has a chance of surviving contact with the physical world.


4. Expert tools need an authority boundary, not just an answer

Aeneas combines multimodal prediction with retrieval over a curated corpus of more than 176,000 Latin inscriptions. It proposes restorations, geographical and chronological attributions, and related inscriptions that historians can inspect.

In the published evaluation, historians considered its parallels and predictions useful research starting points in 90% of cases, and their reported confidence increased by 44%. Human-plus-AI performance exceeded either alone on restoration and geographical attribution.

The important design decision is easy to miss: Aeneas is positioned as an instrument inside historical inquiry, not as the final authority on an inscription. Retrieval exposes relevant parallels. Saliency maps expose influential features. Experts retain responsibility for interpretation.

That boundary is part of reliability. A system can be probabilistically useful without pretending its output is a settled historical fact.


5. The strongest counterargument is also true

Specialized systems do not prove that general foundation models are a dead end.

Broad transfer has real value. A general model can supply language understanding, planning, perception, code generation, or interface flexibility across many workflows. DeepMind's own catalog includes general models alongside specialized research systems.

But that does not rescue a model-first product strategy. General capability still has to enter a specific environment with a feedback signal, an acceptance test, resource limits, and a human authority boundary. The better the base model becomes, the more tempting it is to postpone those decisions. They do not disappear.

The likely architecture is therefore not “general models or specialized systems.” It is general capabilities inside increasingly specific systems.


6. Start with the loop, then choose the model

Before comparing model benchmarks, I would write down six things:

  1. Environment: What state can the system observe and change?
  2. Feedback: What signal distinguishes progress from plausible-looking motion?
  3. Acceptance: Which test proves the output is usable?
  4. Constraints: What latency, cost, hardware, and privacy limits apply?
  5. Authority: Which decisions can the system make, and which remain human?
  6. Recovery: What happens when the system is wrong or uncertain?

Only then does model selection become a meaningful engineering decision. A benchmark can help compare components. It cannot tell you whether the surrounding loop is well designed.

DeepMind's catalog is curated, the projects span different years, and their metrics should not be compared as if they came from one benchmark. That limits the strength of any portfolio-wide conclusion.

The pattern is still hard to ignore.

Useful AI is not a model wrapped in a product interface. It is a problem-specific system in which the model has earned a precise role.