Nebu Pookins Argues Anthropic's J-Lens Refutes the Stochastic Parrot

Nebu's Newsletter is Nebu Pookins' personal blog on AI and software, and this post makes the case that a specific interpretability paper settles the long-running "stochastic parrot" debate about large language models.

The essay walks through an Anthropic paper from July 2026 describing a technique the writer calls J-Lens, which traces how a model's internal representations shift word by word as it writes. Pookins centers his case on one experiment: a model asked to write a sentence about a painting while silently working out 3 squared minus 2 at the same time. He reads the internal trace as showing the model juggling both tasks at once, including a moment he interprets as the model registering it is halfway through the arithmetic. From that single worked example, Pookins draws his conclusion that models manipulate concepts absent from the prompt itself, rather than simply recombining correlated text from training.

The interpretability research is Anthropic's; the reading of what it proves is the author's own, built on one example rather than a full survey of the paper's results. Readers already following the stochastic-parrot debate will recognize this as a pointed, opinionated entry in it, pitched at people who already know the terms rather than newcomers to the argument.