TL;DR
  • Project CETI has a sperm whale phonetic alphabet — 156 distinct codas, 97.5% categorization accuracy. It still has no semantic translation after five years. Structure ≠ meaning.
  • A November 2024 paper (Ben Zion et al., arXiv:2411.10173) proved formally — not just empirically — that the most common training objective in emergent communication produces semantically empty protocols while achieving near-perfect task scores.
  • Four research groups at MIT, Southampton, Anthropic, and CETI are independently closing in on the same hard problem: how do you decode meaning in a system that built its own language, without a Rosetta Stone?
  • Their methods converge into a precise boundary condition: all current decipherment tools carry human-language priors. They work for systems that share structural properties with human language. Whether whale codas do is still open.
⟳ All sources verified February–May 2026

Five years. Fifty scientists. $33 million in TED Audacious funding. And as of early 2026, the most ambitious interspecies AI communication effort in history has produced a sperm whale phonetic alphabet. 156 distinct codas identified. Vowel-like sounds and diphthongs mapped. A transformer model — WhAM — that can generate synthetic codas.

No translation. Still no translation.

The sperm whale, which has the largest brain of any animal that has ever lived, is still talking past us. That’s not a failure of ambition. It’s a precise description of where the science actually is — and it’s the honest starting point for a conversation the science press hasn’t had yet.

Here’s why it matters specifically now. In 2024, three separate research groups produced work that converges on the same hard question: how do you read meaning in a system that assembled its own language, when the system may not share human linguistic structure? MIT CSAIL showed constraint-based models can decipher dead human scripts. The University of Southampton showed AI agents spontaneously develop spatial grammar. Anthropic showed that their own model’s internal representations require a second AI to partially decode — and even then, 30% resists interpretation.

And then there’s Ben Zion et al., published on arXiv in November 2024. That paper proved formally — not empirically, formally — that the field’s dominant training objective produces agents that can hit near-perfect task performance while communicating something that is, technically, semantically meaningless. Nobody in the science press connected that proof to the CETI coverage running simultaneously. That’s the gap this piece closes.

156
distinct sperm whale
codas identified by CETI
97.5%
coda categorization
accuracy (WhAM model)
30%
Claude 3 Sonnet features
still uninterpretable (Anthropic)
0
semantic translations
confirmed after 5 years

The Proof Nobody’s Foregrounding

Formal Proof — November 2024

The standard setup in emergent communication research is called a referential game: one agent has information, another doesn’t, and they coordinate to complete a task. You measure success by task completion. Simple enough. The problem — and this is what Ben Zion et al. proved formally in arXiv:2411.10173 — is that the most common training objective in this field can produce communication protocols that are semantically inconsistent and still achieve near-perfect task scores.

Let me make that concrete. “Semantic consistency” means this: similar inputs should produce similar messages. If a sender encodes “red ball on the left” with symbol X, then “red sphere on the left” should produce something close to X. That’s what you’d expect from a language that means something. Ben Zion et al. prove, under mild assumptions, that the discrimination objective — “identify the correct item from a set” — allows agents to solve the task using protocols where the same symbol means entirely different things in different contexts. The game score will not reveal this. Near-perfect performance. Semantically empty protocol.

⚡ The Critical Finding

Any emergent communication study that reports task accuracy alone, using discrimination training, is not demonstrating meaningful communication. It’s demonstrating coordination. These are not the same claim.

The reconstruction objective — where the receiver must reproduce the sender’s input, not just identify it — enforces semantic consistency by structural necessity. Same task performance profile. Completely different epistemic situation. The field has suspected this for years. Ben Zion put the proof on paper.

The practical implication for CETI: CETI’s research framework for validating whether they’ve decoded meaning relies partly on behavioral response testing — playing codas back to whales and observing reactions. That validation loop isn’t wrong. But it hasn’t been completed yet. And the Ben Zion proof means the internal AI models generating “whale language” representations could, in principle, be doing sophisticated coordination without semantic grounding — and the performance metrics wouldn’t catch it.

David Gruber, CETI’s research lead, described the gap with more honesty than most science coverage gave him credit for: “We’re barely scratching the surface.” Bioneers interview, April 2025. That wasn’t false modesty. That’s what you say when you know exactly where the wall is.

What MIT’s Dead-Language Work Actually Proved

Strong Evidence — Peer Reviewed, DOI Confirmed

Linear B — the Mycenaean Greek script from the 15th–12th century BCE — resisted decipherment for decades. Not because the script was complex. Because nobody tried the correct related language. Michael Ventris cracked it in 1953 on a hunch that it was related to Greek. The entire breakthrough was contingent on that single correct hypothesis. Remove the hypothesis, no decipherment.

Jiaming Luo, Yuan Cao, and Regina Barzilay built a model that doesn’t need the hypothesis. Their paper, “Neural Decipherment via Minimum-Cost Flow: From Ugaritic to Linear B,” ACL 2019, correctly translates 67.3% of Linear B cognates without being told the language was related to Greek. It inferred the relationship from phonological evolution patterns. Languages don’t change randomly — a “p” in a parent is plausibly a “b” in a descendant, almost certainly not a “k.” Encode those probability distributions. Solve for the mapping that minimizes phonologically impossible transitions. Minimum-cost flow optimization.

Genuinely powerful. The scope boundary is just as real, though. This works because human languages share phonological evolution principles — that’s the load-bearing assumption. Dead human scripts: the method is probably fine. Sperm whale codas: they don’t have phonemes in the human sense. The codas are click-based, three-dimensional, produced by a melon-based acoustic system with no vocal cords. The “phonological priors” that make MIT’s model work simply don’t exist in the same form. The approach is brilliant for what it is. What it is doesn’t transfer cleanly to non-human communication.

What Agents Invent When Nobody Gives Them a Grammar

Strong Evidence — NeurIPS 2024

Olaf Lipinski’s two-paper arc is worth tracing properly because most coverage only cited the xenolinguistics angle and missed what the methodology actually demonstrated.

First paper (arXiv:2310.06555, updated May 2024): temporal references in emergent communication. The finding — altering loss function alone is insufficient for temporal references to emerge. You need architectural changes, specifically a different batching method. Over 95% of agents with the modified architecture developed temporal references. Without it: nothing. Temporal grammar is a structural problem, not a training objective problem. That matters.

Second paper (arXiv:2406.07277, NeurIPS 2024): spatial references. Agents develop spatial deixis — the linguistic capacity to point through language: “next to,” “at the end,” “above.” Compositional messages for most positional references. A separate class of compressed, non-compositional tokens for edge positions where full composition wastes bandwidth. Over 90% task accuracy. And — crucially — Lipinski uses NPMI collocation analysis specifically to demonstrate that the symbols have stable associations with spatial contexts, not just task outcomes. This is the methodological move that gets past the Ben Zion problem. Stable symbol-context associations = evidence of semantic grounding, not just coordination.

“The challenge with AI languages is even greater, as they might organise information in ways completely foreign to human linguistic patterns.”

— Olaf Lipinski, PhD Researcher, University of Southampton · The Conversation, November 2024

The scope limitation here is one Lipinski acknowledged directly: his agents were trained on human-designed tasks, in human-designed game environments, with human-legible inputs. Their emergent language may carry implicit human structure not because spatial deixis is universal, but because the task was built by people who think in spatial categories. It’s the cleanest methodology in the field right now. It still can’t tell you whether the same patterns would emerge in a system built for echolocation in deep-ocean pressure gradients.

Anthropic Can’t Fully Read Its Own Model Either

Moderate Evidence — Published Methodology

In May 2024, Anthropic published “Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet.” They trained a sparse autoencoder — a second model — on Claude 3 Sonnet’s activations. Roughly 34 million features extracted. Among them: a cluster associated with the Golden Gate Bridge. Activate that cluster, the model talks about the Bridge. Suppress it, the concept disappears. 70% of features in an earlier smaller test mapped to single human-interpretable concepts.

Thirty percent did not map to anything nameable.

That 30% number is the thing I keep coming back to. This is a cooperative system — Anthropic built it, has full access to its weights, can retrain the interpretability model as many times as they want, and they’re working in a domain (English language) that has decades of linguistic prior. And still 30% of internal representations are opaque. Now ask what the equivalent number would be for a system you can’t access at all, running a communication protocol evolved for purposes you can only guess at.

The sparse autoencoder approach is, among other things, an attempt to build ground truth from the inside. The CETI problem is whether there’s an equivalent approach for a system you cannot retrain. There isn’t one yet.

Four Research Tracks — Evidence Level & Key Limitation
OPEN QUESTION Structure → Meaning? STRONG ● MIT CSAIL Min-Cost Flow Decipherment 67.3% Linear B cognates Needs phonological priors ACL 2019 · DOI confirmed STRONG ● SOUTHAMPTON Emergent Grammar Spatial & Temporal 90%+ task accuracy NPMI semantic grounding NeurIPS 2024 · confirmed MODERATE ● ANTHROPIC Sparse Autoencoder Monosemanticity 34M features · 70% readable 30% still opaque Needs full model access DIRECTIONAL ● CETI Whale Decipherment Sperm Whale Codas 156 codas · no semantics Validation incomplete Oceanographic, Dec 2025 Ben Zion et al. proof (Nov 2024) — cuts across all four tracks

The Convergence None of These Papers Name

This is the synthesis that doesn’t exist in any single cited paper. I’m going to state it plainly because the academic register tends to bury it.

Luo, Cao & Barzilay establish that constraint-based decipherment can recover cognate structure from unknown scripts without bilingual reference — using only phonological priors and minimum-cost optimization. Lipinski, combined with Ben Zion, establishes two things together that neither establishes alone: agents develop interpretable spatial and temporal grammar from scratch, AND the standard training objective produces semantically inconsistent protocols that defeat standard evaluation. You need both structural analysis (NPMI, compositionality scoring) AND the correct training objective (reconstruction, not discrimination) to claim genuine communication rather than coordination. Anthropic’s Scaling Monosemanticity establishes that even with a cooperative system, a second dedicated interpretability model, and full internal access, 30% of representations remain opaque.

Put them together: the actual difficulty of the decipherment problem becomes more precisely defined than any single track makes visible. You need structural analysis tools that work without a Rosetta Stone. You need training objectives that produce semantically consistent protocols. You need a second model to read the first. And even then, for a system you cannot retrain from scratch — whale codas, a hypothetical non-human signal — the Anthropic approach doesn’t directly apply.

CETI is working on the hardest version of this problem: a system that evolved its own communication for its own purposes, in a sensory modality that has no human equivalent, with no ground truth available and no ability to retrain the sender.

And the scope limit applies across all four methodologies: every approach carries human-language priors in its foundation. Ben Zion’s semantic consistency framework uses Euclidean distance in input space as a proxy for semantic similarity — a human-legible assumption. Whether sperm whale codas even have a meaningful notion of “similar inputs should produce similar messages” is not established. We don’t know if that assumption applies to a system that evolved for three-dimensional deep-ocean echolocation over millions of years.


Evidence Across the Four Research Tracks

Approach What It Demonstrated Evidence Level Critical Limitation
MIT CSAIL
Luo et al., ACL 2019
67.3% Linear B cognate accuracy without prior language ID; phonological evolution priors only Strong Requires phonological evolution patterns from human language history; non-phonemic scripts are out of scope by design
Southampton
Lipinski et al., NeurIPS 2024
Compositional spatial deixis emerges; NPMI confirms stable symbol-context associations beyond coordination Strong Human-designed task environments; emergent grammar may carry implicit human structural priors
Ben Zion et al.
arXiv:2411.10173, Nov 2024
Formal proof: discrimination training allows semantically inconsistent protocols to be optimal; reconstruction objective enforces consistency Formal Proof Semantic consistency assumes Euclidean input-space distance proxies meaning — a human-legible assumption
Anthropic
Scaling Monosemanticity, May 2024
~34M features extracted; 70% interpretable; causal steering confirmed; 30% remain opaque even with direct model access Moderate Requires full model access and dedicated autoencoder retraining; does not transfer to externally observed systems
Project CETI
projectceti.org · Oceanographic, Dec 2025
156 codas; phonetic alphabet mapped; 97.5% coda categorization; WhAM model generates synthetic codas Directional Pattern recognition ≠ semantic decoding; behavioral playback validation not yet published; hardest version of the problem

Three Questions That Would Produce Exclusive Reporting

There’s a story here that nobody has written. The science press covered CETI’s phonetic alphabet announcement. They covered Lipinski’s xenolinguistics angle. Nobody covered the Ben Zion proof appearing in the same three-month window as the CETI progress updates — and the specific implication: we announced progress on whale communication at the same moment a peer-reviewed paper formally proved our evaluation framework can’t distinguish meaningful communication from sophisticated-looking noise.

Ask Lipinski: Was his NPMI evaluation methodology designed with the Ben Zion semantic consistency problem in mind, or developed independently? If independently: parallel discovery happening in real time across two research groups who weren’t aware of each other. If deliberately: the field is converging on a solution faster than the publication record suggests. Either answer is the story.

Ask CETI’s Jacob Andreas: Does the “sperm whale phonetic alphabet” finding constitute semantic decoding or structural categorization? He’s the MIT NLP researcher who led that work, and he’ll know exactly what the distinction means. His answer determines whether the headline is “breakthrough” or “foundation.” These are not the same thing.

Ask a Barzilay lab member: Has the minimum-cost flow model been tested on non-human-language corpora? The gap in that answer is where the next paper lives.

⚠ What Could Be Wrong With This Analysis

The four-track convergence narrative assumes the tracks are converging on the same problem. They might not be. MIT’s decipherment work is fundamentally different from emergent communication research — it operates on observed communication, not generated communication. Framing them as converging methodologies might paper over a structural divide the papers themselves don’t resolve.

The 30% opacity figure from Anthropic’s smaller model test may not generalize directly to Claude 3 Sonnet at 34M features. The paper acknowledges this. Citing it as a stable finding slightly oversimplifies the methodological caution in the primary source.

CETI’s own researchers may be closer to semantic analysis than the public research updates reflect. The five-year window is for public documentation; internal findings may be ahead of publication. This piece reflects the public scientific record, not necessarily the current state of the lab.

The Ben Zion proof operates under “mild assumptions” — the paper specifies these. If those assumptions don’t hold for a particular system, the proof’s scope narrows. The formal result is real; its universality is bounded.

Sources & Citations — All Verified May 2026
  1. Ben Zion, Y. et al. (November 15, 2024). Semantics and Spatiality of Emergent Communication. arXiv:2411.10173. arxiv.org/abs/2411.10173
  2. Lipinski, O. et al. (NeurIPS 2024). Speaking Your Language: Spatial Relationships in Interpretable Emergent Communication. arXiv:2406.07277. arxiv.org/abs/2406.07277
  3. Lipinski, O. et al. (Updated May 2024). It’s About Time: Temporal References in Emergent Communication. arXiv:2310.06555. arxiv.org/abs/2310.06555
  4. Luo, J., Cao, Y., & Barzilay, R. (ACL 2019). Neural Decipherment via Minimum-Cost Flow: From Ugaritic to Linear B. DOI: 10.18653/v1/P19-1303. aclanthology.org/P19-1303
  5. Templeton, A. et al. (Anthropic, May 2024). Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet. transformer-circuits.pub
  6. Bricken, T. et al. (Anthropic, October 2023). Towards Monosemanticity: Decomposing Language Models With Dictionary Learning. transformer-circuits.pub
  7. Sharma, N. et al. (May 2024). Contextual and combinatorial structure in sperm whale vocalisations. Nature Communications. doi.org/10.1038/s41467-024-47221-8
  8. Project CETI. (Ongoing). Cetacean Translation Initiative — Research Overview. projectceti.org [Self-reported figures treated as directional]
  9. David Gruber. (April 25, 2025). “We’re barely scratching the surface.” Bioneers 2025 Presentation. bioneers.org
  10. National Geographic. (May 2025). How scientists are piecing together a sperm whale ‘alphabet.’ nationalgeographic.com
  11. Lipinski, O. (November 2024). Could AI help us understand whale communication? The Conversation. theconversation.com
  12. Mair, V. (May 8, 2024). “Sperm whale alphabet” — critique of phonetic framing. Language Log, University of Pennsylvania. languagelog.ldc.upenn.edu
TM
Tom Morgan

Covers deep science, AI interpretability, and fringe linguistics for Neural Grimoire. Analysis draws on primary papers, DOI-verified sources, and institutional documentation — not on any relationships with the research groups cited. Limitation: this analysis reflects the public scientific record through May 2026. Internal lab findings at CETI and Barzilay’s group may be ahead of the publication timeline represented here. The synthesis of four research tracks is the author’s own framing and is not endorsed by any cited researcher. No sponsorship. No affiliate relationships.

Five years, fifty scientists, and the whale is still talking past us — not because the tools failed, but because finding structure is not the same as finding meaning, and we just got the proof in writing.