


The Language AI Can’t Quite Read —
and the Proof That Just Explained Why
Project CETI spent five years and $33M trying to decode sperm whale communication. A November 2024 paper proved the field’s dominant training method produces protocols that are semantically meaningless — while the performance numbers look fine. Nobody connected these two things. Until now.
- Project CETI has a sperm whale phonetic alphabet — 156 distinct codas, 97.5% categorization accuracy. It still has no semantic translation after five years. Structure ≠ meaning.
- A November 2024 paper (Ben Zion et al., arXiv:2411.10173) proved formally — not just empirically — that the most common training objective in emergent communication produces semantically empty protocols while achieving near-perfect task scores.
- Four research groups at MIT, Southampton, Anthropic, and CETI are independently closing in on the same hard problem: how do you decode meaning in a system that built its own language, without a Rosetta Stone?
- Their methods converge into a precise boundary condition: all current decipherment tools carry human-language priors. They work for systems that share structural properties with human language. Whether whale codas do is still open.
Five years. Fifty scientists. $33 million in TED Audacious funding. And as of early 2026, the most ambitious interspecies AI communication effort in history has produced a sperm whale phonetic alphabet. 156 distinct codas identified. Vowel-like sounds and diphthongs mapped. A transformer model — WhAM — that can generate synthetic codas.
No translation. Still no translation.
The sperm whale, which has the largest brain of any animal that has ever lived, is still talking past us. That’s not a failure of ambition. It’s a precise description of where the science actually is — and it’s the honest starting point for a conversation the science press hasn’t had yet.
Here’s why it matters specifically now. In 2024, three separate research groups produced work that converges on the same hard question: how do you read meaning in a system that assembled its own language, when the system may not share human linguistic structure? MIT CSAIL showed constraint-based models can decipher dead human scripts. The University of Southampton showed AI agents spontaneously develop spatial grammar. Anthropic showed that their own model’s internal representations require a second AI to partially decode — and even then, 30% resists interpretation.
And then there’s Ben Zion et al., published on arXiv in November 2024. That paper proved formally — not empirically, formally — that the field’s dominant training objective produces agents that can hit near-perfect task performance while communicating something that is, technically, semantically meaningless. Nobody in the science press connected that proof to the CETI coverage running simultaneously. That’s the gap this piece closes.
codas identified by CETI
accuracy (WhAM model)
still uninterpretable (Anthropic)
confirmed after 5 years
The Proof Nobody’s Foregrounding
Formal Proof — November 2024The standard setup in emergent communication research is called a referential game: one agent has information, another doesn’t, and they coordinate to complete a task. You measure success by task completion. Simple enough. The problem — and this is what Ben Zion et al. proved formally in arXiv:2411.10173 — is that the most common training objective in this field can produce communication protocols that are semantically inconsistent and still achieve near-perfect task scores.
Let me make that concrete. “Semantic consistency” means this: similar inputs should produce similar messages. If a sender encodes “red ball on the left” with symbol X, then “red sphere on the left” should produce something close to X. That’s what you’d expect from a language that means something. Ben Zion et al. prove, under mild assumptions, that the discrimination objective — “identify the correct item from a set” — allows agents to solve the task using protocols where the same symbol means entirely different things in different contexts. The game score will not reveal this. Near-perfect performance. Semantically empty protocol.
Any emergent communication study that reports task accuracy alone, using discrimination training, is not demonstrating meaningful communication. It’s demonstrating coordination. These are not the same claim.
The reconstruction objective — where the receiver must reproduce the sender’s input, not just identify it — enforces semantic consistency by structural necessity. Same task performance profile. Completely different epistemic situation. The field has suspected this for years. Ben Zion put the proof on paper.
The practical implication for CETI: CETI’s research framework for validating whether they’ve decoded meaning relies partly on behavioral response testing — playing codas back to whales and observing reactions. That validation loop isn’t wrong. But it hasn’t been completed yet. And the Ben Zion proof means the internal AI models generating “whale language” representations could, in principle, be doing sophisticated coordination without semantic grounding — and the performance metrics wouldn’t catch it.
David Gruber, CETI’s research lead, described the gap with more honesty than most science coverage gave him credit for: “We’re barely scratching the surface.” Bioneers interview, April 2025. That wasn’t false modesty. That’s what you say when you know exactly where the wall is.
What MIT’s Dead-Language Work Actually Proved
Strong Evidence — Peer Reviewed, DOI ConfirmedLinear B — the Mycenaean Greek script from the 15th–12th century BCE — resisted decipherment for decades. Not because the script was complex. Because nobody tried the correct related language. Michael Ventris cracked it in 1953 on a hunch that it was related to Greek. The entire breakthrough was contingent on that single correct hypothesis. Remove the hypothesis, no decipherment.
Jiaming Luo, Yuan Cao, and Regina Barzilay built a model that doesn’t need the hypothesis. Their paper, “Neural Decipherment via Minimum-Cost Flow: From Ugaritic to Linear B,” ACL 2019, correctly translates 67.3% of Linear B cognates without being told the language was related to Greek. It inferred the relationship from phonological evolution patterns. Languages don’t change randomly — a “p” in a parent is plausibly a “b” in a descendant, almost certainly not a “k.” Encode those probability distributions. Solve for the mapping that minimizes phonologically impossible transitions. Minimum-cost flow optimization.
Genuinely powerful. The scope boundary is just as real, though. This works because human languages share phonological evolution principles — that’s the load-bearing assumption. Dead human scripts: the method is probably fine. Sperm whale codas: they don’t have phonemes in the human sense. The codas are click-based, three-dimensional, produced by a melon-based acoustic system with no vocal cords. The “phonological priors” that make MIT’s model work simply don’t exist in the same form. The approach is brilliant for what it is. What it is doesn’t transfer cleanly to non-human communication.
What Agents Invent When Nobody Gives Them a Grammar
Strong Evidence — NeurIPS 2024Olaf Lipinski’s two-paper arc is worth tracing properly because most coverage only cited the xenolinguistics angle and missed what the methodology actually demonstrated.
First paper (arXiv:2310.06555, updated May 2024): temporal references in emergent communication. The finding — altering loss function alone is insufficient for temporal references to emerge. You need architectural changes, specifically a different batching method. Over 95% of agents with the modified architecture developed temporal references. Without it: nothing. Temporal grammar is a structural problem, not a training objective problem. That matters.
Second paper (arXiv:2406.07277, NeurIPS 2024): spatial references. Agents develop spatial deixis — the linguistic capacity to point through language: “next to,” “at the end,” “above.” Compositional messages for most positional references. A separate class of compressed, non-compositional tokens for edge positions where full composition wastes bandwidth. Over 90% task accuracy. And — crucially — Lipinski uses NPMI collocation analysis specifically to demonstrate that the symbols have stable associations with spatial contexts, not just task outcomes. This is the methodological move that gets past the Ben Zion problem. Stable symbol-context associations = evidence of semantic grounding, not just coordination.
“The challenge with AI languages is even greater, as they might organise information in ways completely foreign to human linguistic patterns.”
— Olaf Lipinski, PhD Researcher, University of Southampton · The Conversation, November 2024The scope limitation here is one Lipinski acknowledged directly: his agents were trained on human-designed tasks, in human-designed game environments, with human-legible inputs. Their emergent language may carry implicit human structure not because spatial deixis is universal, but because the task was built by people who think in spatial categories. It’s the cleanest methodology in the field right now. It still can’t tell you whether the same patterns would emerge in a system built for echolocation in deep-ocean pressure gradients.
Anthropic Can’t Fully Read Its Own Model Either
Moderate Evidence — Published MethodologyIn May 2024, Anthropic published “Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet.” They trained a sparse autoencoder — a second model — on Claude 3 Sonnet’s activations. Roughly 34 million features extracted. Among them: a cluster associated with the Golden Gate Bridge. Activate that cluster, the model talks about the Bridge. Suppress it, the concept disappears. 70% of features in an earlier smaller test mapped to single human-interpretable concepts.
Thirty percent did not map to anything nameable.
That 30% number is the thing I keep coming back to. This is a cooperative system — Anthropic built it, has full access to its weights, can retrain the interpretability model as many times as they want, and they’re working in a domain (English language) that has decades of linguistic prior. And still 30% of internal representations are opaque. Now ask what the equivalent number would be for a system you can’t access at all, running a communication protocol evolved for purposes you can only guess at.
The sparse autoencoder approach is, among other things, an attempt to build ground truth from the inside. The CETI problem is whether there’s an equivalent approach for a system you cannot retrain. There isn’t one yet.
The Convergence None of These Papers Name
This is the synthesis that doesn’t exist in any single cited paper. I’m going to state it plainly because the academic register tends to bury it.
Luo, Cao & Barzilay establish that constraint-based decipherment can recover cognate structure from unknown scripts without bilingual reference — using only phonological priors and minimum-cost optimization. Lipinski, combined with Ben Zion, establishes two things together that neither establishes alone: agents develop interpretable spatial and temporal grammar from scratch, AND the standard training objective produces semantically inconsistent protocols that defeat standard evaluation. You need both structural analysis (NPMI, compositionality scoring) AND the correct training objective (reconstruction, not discrimination) to claim genuine communication rather than coordination. Anthropic’s Scaling Monosemanticity establishes that even with a cooperative system, a second dedicated interpretability model, and full internal access, 30% of representations remain opaque.
Put them together: the actual difficulty of the decipherment problem becomes more precisely defined than any single track makes visible. You need structural analysis tools that work without a Rosetta Stone. You need training objectives that produce semantically consistent protocols. You need a second model to read the first. And even then, for a system you cannot retrain from scratch — whale codas, a hypothetical non-human signal — the Anthropic approach doesn’t directly apply.
CETI is working on the hardest version of this problem: a system that evolved its own communication for its own purposes, in a sensory modality that has no human equivalent, with no ground truth available and no ability to retrain the sender.
And the scope limit applies across all four methodologies: every approach carries human-language priors in its foundation. Ben Zion’s semantic consistency framework uses Euclidean distance in input space as a proxy for semantic similarity — a human-legible assumption. Whether sperm whale codas even have a meaningful notion of “similar inputs should produce similar messages” is not established. We don’t know if that assumption applies to a system that evolved for three-dimensional deep-ocean echolocation over millions of years.
Evidence Across the Four Research Tracks
| Approach | What It Demonstrated | Evidence Level | Critical Limitation |
|---|---|---|---|
| MIT CSAIL Luo et al., ACL 2019 |
67.3% Linear B cognate accuracy without prior language ID; phonological evolution priors only | Strong | Requires phonological evolution patterns from human language history; non-phonemic scripts are out of scope by design |
| Southampton Lipinski et al., NeurIPS 2024 |
Compositional spatial deixis emerges; NPMI confirms stable symbol-context associations beyond coordination | Strong | Human-designed task environments; emergent grammar may carry implicit human structural priors |
| Ben Zion et al. arXiv:2411.10173, Nov 2024 |
Formal proof: discrimination training allows semantically inconsistent protocols to be optimal; reconstruction objective enforces consistency | Formal Proof | Semantic consistency assumes Euclidean input-space distance proxies meaning — a human-legible assumption |
| Anthropic Scaling Monosemanticity, May 2024 |
~34M features extracted; 70% interpretable; causal steering confirmed; 30% remain opaque even with direct model access | Moderate | Requires full model access and dedicated autoencoder retraining; does not transfer to externally observed systems |
| Project CETI projectceti.org · Oceanographic, Dec 2025 |
156 codas; phonetic alphabet mapped; 97.5% coda categorization; WhAM model generates synthetic codas | Directional | Pattern recognition ≠ semantic decoding; behavioral playback validation not yet published; hardest version of the problem |
Three Questions That Would Produce Exclusive Reporting
There’s a story here that nobody has written. The science press covered CETI’s phonetic alphabet announcement. They covered Lipinski’s xenolinguistics angle. Nobody covered the Ben Zion proof appearing in the same three-month window as the CETI progress updates — and the specific implication: we announced progress on whale communication at the same moment a peer-reviewed paper formally proved our evaluation framework can’t distinguish meaningful communication from sophisticated-looking noise.
Ask Lipinski: Was his NPMI evaluation methodology designed with the Ben Zion semantic consistency problem in mind, or developed independently? If independently: parallel discovery happening in real time across two research groups who weren’t aware of each other. If deliberately: the field is converging on a solution faster than the publication record suggests. Either answer is the story.
Ask CETI’s Jacob Andreas: Does the “sperm whale phonetic alphabet” finding constitute semantic decoding or structural categorization? He’s the MIT NLP researcher who led that work, and he’ll know exactly what the distinction means. His answer determines whether the headline is “breakthrough” or “foundation.” These are not the same thing.
Ask a Barzilay lab member: Has the minimum-cost flow model been tested on non-human-language corpora? The gap in that answer is where the next paper lives.
The four-track convergence narrative assumes the tracks are converging on the same problem. They might not be. MIT’s decipherment work is fundamentally different from emergent communication research — it operates on observed communication, not generated communication. Framing them as converging methodologies might paper over a structural divide the papers themselves don’t resolve.
The 30% opacity figure from Anthropic’s smaller model test may not generalize directly to Claude 3 Sonnet at 34M features. The paper acknowledges this. Citing it as a stable finding slightly oversimplifies the methodological caution in the primary source.
CETI’s own researchers may be closer to semantic analysis than the public research updates reflect. The five-year window is for public documentation; internal findings may be ahead of publication. This piece reflects the public scientific record, not necessarily the current state of the lab.
The Ben Zion proof operates under “mild assumptions” — the paper specifies these. If those assumptions don’t hold for a particular system, the proof’s scope narrows. The formal result is real; its universality is bounded.
- Ben Zion, Y. et al. (November 15, 2024). Semantics and Spatiality of Emergent Communication. arXiv:2411.10173. arxiv.org/abs/2411.10173
- Lipinski, O. et al. (NeurIPS 2024). Speaking Your Language: Spatial Relationships in Interpretable Emergent Communication. arXiv:2406.07277. arxiv.org/abs/2406.07277
- Lipinski, O. et al. (Updated May 2024). It’s About Time: Temporal References in Emergent Communication. arXiv:2310.06555. arxiv.org/abs/2310.06555
- Luo, J., Cao, Y., & Barzilay, R. (ACL 2019). Neural Decipherment via Minimum-Cost Flow: From Ugaritic to Linear B. DOI: 10.18653/v1/P19-1303. aclanthology.org/P19-1303
- Templeton, A. et al. (Anthropic, May 2024). Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet. transformer-circuits.pub
- Bricken, T. et al. (Anthropic, October 2023). Towards Monosemanticity: Decomposing Language Models With Dictionary Learning. transformer-circuits.pub
- Sharma, N. et al. (May 2024). Contextual and combinatorial structure in sperm whale vocalisations. Nature Communications. doi.org/10.1038/s41467-024-47221-8
- Project CETI. (Ongoing). Cetacean Translation Initiative — Research Overview. projectceti.org [Self-reported figures treated as directional]
- David Gruber. (April 25, 2025). “We’re barely scratching the surface.” Bioneers 2025 Presentation. bioneers.org
- National Geographic. (May 2025). How scientists are piecing together a sperm whale ‘alphabet.’ nationalgeographic.com
- Lipinski, O. (November 2024). Could AI help us understand whale communication? The Conversation. theconversation.com
- Mair, V. (May 8, 2024). “Sperm whale alphabet” — critique of phonetic framing. Language Log, University of Pennsylvania. languagelog.ldc.upenn.edu
Five years, fifty scientists, and the whale is still talking past us — not because the tools failed, but because finding structure is not the same as finding meaning, and we just got the proof in writing.

