Anthropic's New "Research" Report Is Dumb.  🔗 **Source:** [Anthropic's New "Research" Report Is Dumb.](https://www.youtube.com/watch?v=m6ucYXJyjAk) > [!note]+ Document Notes > tags: [ai-interpretability, ai-anthropomorphism, mechanistic-interpretability, media-literacy, ai-research-critique] > author: Cal Newport > source: Cal Newport (YouTube) > reference: https://www.youtube.com/watch?v=m6ucYXJyjAk > date created: 2026-07-16 12:30 > > # 🏷️ Title: Anthropic's New "Research" Report is Dumb. > <!-- deep-read:sections start --> ## 🧭 Table of Contents - [📝 Summary](#-summary) - [📖 Main Content](#-main-content) - [🗒️ Notes](#️-notes) - [📚 References](#-references) - [🗣️ Paraphrase](#️-paraphrase) - [📰 Newsletter](#-newsletter) - [✅ Action Items](#-action-items) - [🧪 Hypotheses](#-hypotheses) - [📊 Methodology](#-methodology) - [❓ Questions](#-questions) - [🔮 Future Research](#-future-research) - [💡 Implications](#-implications) - [🧠 Learning Styles Assessment](#-learning-styles-assessment) - [📊 Accessibility Assessment](#-accessibility-assessment) - [🌍 DEIB Assessment](#-deib-assessment) - [✅ Logical Validity](#-logical-validity) - [🛡️ DARVO Analysis](#-darvo-analysis) - [🎯 Conclusion](#-conclusion) ## 📝 Summary - **What happened**: Anthropic published a research report, "On the Biology of a Global Workspace" (referred to in the video as "A Global Workspace and Language Models"), describing a technique — the "J-lens," built on a Jacobian linear-algebra tool — that decodes human-interpretable concepts (a "J space") out of Claude's internal activation vectors. The report shipped with an animated video and language like Claude "pondering" and "puzzling" over concepts silently, "on its own," without anyone programming it. Tech press (Axios, MIT Technology Review) and X posts amplified this into claims that Anthropic had found evidence of consciousness or moral patienthood in Claude. - **Why it matters**: Newport argues the underlying finding — that intermediate layers accumulate interpretable "annotations" that narrow down semantically appropriate output tokens — is not new. It matches the standard account of how transformer-based LLMs and deep neural networks generally have been understood to work for years (he cites his own 2023/2024 New Yorker explainers), and comparable interpretability techniques predate this paper (he cites a University of Illinois professor's tweet listing related work since 2022). His core claim is that Anthropic's framing — hedged just enough to avoid an explicit false claim, while using loaded language ("thinking," "on its own," global-workspace-theory comparisons) — manufactures a sense of novelty and "digital ick" that the actual result doesn't support. - **Key stakeholders**: Anthropic's research and PR/communications functions, AI journalists and outlets that amplified the framing (Axios, MIT Technology Review), the broader public forming beliefs about AI sentience/consciousness, and Anthropic's investors/business stakeholders (Newport's closing argument ties the framing to distraction from harder questions about unit economics and competitive moat). - **Risks and tradeoffs**: Overclaiming or ambiguous framing of interpretability research risks (a) misinforming the public about AI consciousness/moral status, a genuinely consequential question that deserves rigor rather than marketing lift; (b) crowding out scrutiny of Anthropic's business fundamentals (token costs, competitive moat, path to justifying valuation); and (c) devaluing real interpretability research by association with hype cycles, making it harder for the public to distinguish legitimate advances from press-release science. - **Bottom line**: Newport's assessment is that the research itself is competent, incremental, non-novel work executed at a scale (a frontier proprietary model) that outside researchers can't replicate — but the communication of it is, in his word, "disingenuous," designed to generate attention-driving anthropomorphic reactions rather than to inform. ## 📖 Main Content Newport structures the video as a teardown in three movements: (1) read Anthropic's own framing and the media/social reaction to it, (2) teach the actual mechanics of how transformer-based LLMs process a prompt, and (3) return to the paper to show that its findings map exactly onto that mechanical account — meaning nothing "unnerving, cool, or blockbuster" was revealed. **The paper's claim, in Anthropic's words** (as read on-screen): Claude has a small collection of internal neural patterns — the "J space," named for the Jacobian technique used to find them — that "play a special role" relative to other internal processing. Each pattern links to a word, but lighting up doesn't mean the model says that word, only that "the word is on its mind." Unlike a visible scratchpad or chain-of-thought, the J space "operates silently in the model's internal neural activations, allowing the model to think about a concept without writing it down," and — Anthropic's own italics — it "wasn't designed or programmed by us, but instead emerged on its own during Claude's training process." **The tutorial (mechanics of an LLM)**: Newport walks through transformer blocks arranged in sequential layers, each of which can add "annotations" to a token's underlying vector of numbers as the prompt passes through. He offers two analogies: a relay of scholars at successive tables, each reading prior annotations and adding their own; and the layout of a page of Talmud, where a small central text (the token) is surrounded by accumulating layers of commentary. Tokens are first embedded as long vectors of numbers capturing rough meaning; self-attention and feed-forward sublayers within each transformer block then update those numbers, layer by layer, with the final layer mapping the fully annotated result to an output token. He separates two things that are actually entangled in training: **syntactic validity** (what words could grammatically follow — learnable even with a simple n-gram model, likely concentrated in later layers) and **semantic appropriateness** (which of the syntactically valid options actually fits the prompt's meaning — where he argues the accumulated annotations do their work). **Back to the paper, now legible**: Anthropic's Jacobian-based "J-lens" decodes those annotation vectors into human-interpretable labels. Their worked example: for the prompt "the color of the fourth planet from the sun is," the technique surfaces annotations corresponding to "Mars" and "color" mid-network; the final layer combines them to output "red." They validate this causally two ways — replacing the "Mars" annotation values with "Earth" values changes the output to "blue," and "ablating" (zeroing out) the Mars-related pattern produces grammatically valid but semantically arbitrary color outputs. Newport calls this legitimately interesting experimental work, while objecting to Anthropic's use of "ablated," a term borrowed from neuroscience/animal research, as anthropomorphizing a numerical zeroing operation. **Newport's two-part verdict**: First, novelty — he cites a tweet from University of Illinois professor Yu Zhaozhang noting comparable Jacobian-based interpretability work dating to 2022, framing Anthropic's contribution as the first application at the scale of a frontier proprietary model (which outside researchers structurally cannot replicate, since only the lab has model internals) rather than a new idea. Second, and central to the video's title: the *language* used to describe the results. He argues that once you understand the layer-by-layer annotation mechanism, the J-lens findings are "exactly how we've always understood large language models to work" — not just LLMs specifically, but deep networks generally, tracing back to early image-recognition work. He singles out specific phrases as misleading: "thinking about a concept without writing it down" (his rebuttal: updating the activation matrix *is* how it writes things down — that matrix is its only workspace) and "Claude did this on its own, we didn't program it" (his rebuttal: that describes literally all machine learning — nothing is programmed in a trained neural network by definition, so stating it as a distinguishing fact about this system is misleading through omission, not falsehood). **The consciousness section**: Anthropic connects J-space experiments to Global Workspace Theory (GWT), a framework for conscious access in humans and animals, while explicitly hedging that "our experiments don't show that Claude can have experiences or feel things." Newport's strongest technical objection: GWT describes an ongoing, stateful system that integrates continuously arriving inputs and selects among them over time. A transformer forward pass is the opposite — strictly feedforward, one layer to the next, no persisted state between prompts, "and then it's done, and the token is out." He treats this as a structural mismatch the GWT comparison glosses over rather than confronts. **The closing argument (motive)**: Newport's final move shifts from technical critique to an inference about incentives — that anthropomorphic, "digital ick"-inducing framing distracts audiences from harder, more consequential questions about Anthropic's business (token costs, thin competitive moat against smaller specialized models, and what justifies a trillion-dollar valuation). He closes by distinguishing the researchers ("good work") from what he calls the PR department's packaging of it, and calls on Anthropic to publish real computer science papers rather than "glorified press releases." **Terms defined**: J space / J-lens (Anthropic's Jacobian-based interpretability method and the resulting decoded activation patterns); "annotations" (Newport's own explanatory term for information layers add to a token's activation vector as it passes through a network — not Anthropic's term); ablation (in this context, zeroing out specific activation values to test their causal role); Global Workspace Theory (a cognitive-science framework for how a subset of information becomes "consciously" available across a system, here disputed as inapplicable to feedforward inference). **Uncertainty / contested claims**: This analysis is built from the video's auto-generated YouTube captions; a small number of caption artifacts (word-order glitches, filler-word transcription like "It's putting") were present in the raw transcript and are called out inline where a quote spans one. Anthropic's original paper/report was not independently reviewed for this note — all characterizations of "what Anthropic said" reflect Newport's on-screen reading and paraphrase of it, not a separate verification against Anthropic's published text. Newport's inference about Anthropic's *motive* (distraction from business fundamentals) is presented by him as opinion ("that's just my opinion") and is treated here as an argued but unverified claim, not an established fact. ### 🗒️ Notes #### ⏱️ [00:00:00](https://www.youtube.com/watch?v=m6ucYXJyjAk&t=0) The report and the online reaction - Anthropic's "A Global Workspace and Language Models" report shipped with an animated video. - An X post read aloud claims: "Claude, my friends, by all counts, is a conscious entity. Claude, my dear friends, is a moral patient." - Axios: "Anthropic says Claude has carved out its own space to ponder." MIT Technology Review: "Anthropic found a hidden space where Claude puzzles over concepts." - Newport frames the episode's question: genuine evidence of something new, or "another over-wrought cynical push to generate a fresh wave of relevance-reinforcing digital ick"? #### ⏱️ [00:02:06](https://www.youtube.com/watch?v=m6ucYXJyjAk&t=126) Anthropic's own framing, read verbatim - J space: "a small collection of internal neural patterns that... play a special role." - Explicitly contrasted with visible chain-of-thought: it "operates silently," lets the model "think about a concept without writing it down." - Anthropic's italics, per Newport: the J space "wasn't designed or programmed by us, but instead emerged on its own." #### ⏱️ [00:03:34](https://www.youtube.com/watch?v=m6ucYXJyjAk&t=214) Tutorial: transformer layers as accumulating "annotations" - A prompt passes through sequential transformer-block layers; each layer can add information ("annotations") on top of what prior layers added. - Two analogies: relay tables of scholars adding commentary in sequence; a Talmud page, with the token as the small central text and layered commentary (the Gemara) built up around it by each layer. - The final layer maps the fully annotated representation to an output token (technically a probability distribution the control program samples from). #### ⏱️ [00:06:49](https://www.youtube.com/watch?v=m6ucYXJyjAk&t=409) Tutorial: tokens, embeddings, and the annotation matrix - Prompts are broken into tokens; each token is embedded as a long vector of numbers initially capturing rough meaning. - As the matrix of token-vectors moves layer to layer, self-attention and feed-forward sublayers update those numbers — that update *is* where annotations "live." - "This big... table of numbers, we call this a matrix" — the same matrix Newport later calls the model's only workspace. #### ⏱️ [00:11:23](https://www.youtube.com/watch?v=m6ucYXJyjAk&t=683) Syntactic vs. semantic contribution to next-token choice - Two entangled but conceptually separable jobs: which next tokens are grammatically valid (easy, likely concentrated in final layers, learnable even by a simple n-gram model), and which of those is semantically appropriate given the prompt's meaning (where accumulated annotations do the work). - Example: "the quick brown fox ___" — many grammatically valid continuations (jumped, danced, died, talked), but annotation of "this is a known saying" privileges "jumped." #### ⏱️ [00:13:52](https://www.youtube.com/watch?v=m6ucYXJyjAk&t=832) Back to the paper: the Jacobian/J-lens technique - Jacobian-based linear algebra is used to find which patterns of values in the activation matrix are most causally influential on the final output. - Worked example: prompt "the color of the fourth planet from the sun is" surfaces mid-network annotations decodable as "Mars" and "color"; combined at the final layer, the model outputs "red." - Causal test: swapping the "Mars" pattern for the "Earth" pattern changes the output to "blue," holding the rest of the prompt fixed. #### ⏱️ [00:19:03](https://www.youtube.com/watch?v=m6ucYXJyjAk&t=1143) The ablation experiment - Zeroing out ("ablating") the Mars-related annotation still produces grammatically valid output, but the color is no longer semantically tied to Mars — arbitrary colors result. - Newport flags "ablated" itself as an anthropomorphizing word choice, borrowed from neuroscience, for what is a numerical zeroing operation. - His assessment: legitimately cool experimental design, showing the annotations are causally load-bearing for output. #### ⏱️ [00:20:45](https://www.youtube.com/watch?v=m6ucYXJyjAk&t=1245) Take 1 — the technique isn't novel - Cites a tweet from University of Illinois professor Yu Zhaozhang: comparable Jacobian-based interpretability work traced to 2022, with several related papers listed. - Anthropic's distinct contribution, per Newport, is applying it at the scale of a frontier proprietary model — which outside researchers can't replicate, since only the lab has access to those internals — not a new underlying idea. #### ⏱️ [00:22:05](https://www.youtube.com/watch?v=m6ucYXJyjAk&t=1325) Take 2 — "incredibly disingenuous" framing - Core thesis stated directly: "the way that Anthropic described these results and the way that they were echoed after Anthropic described them, I think is incredibly disingenuous." - Newport ties this to his own 2023 and 2024 New Yorker explainers, which used the same "annotations that build on annotations" framing years before this report — this is not new territory. - Generalizes the point to all deep learning: "This is just how we understand large language models to work. It's also how we understand essentially any deep learning neural network to work," tracing back to early image-recognition (Yann LeCun-era) work. #### ⏱️ [00:25:36](https://www.youtube.com/watch?v=m6ucYXJyjAk&t=1536) Line-by-line critique: "thinking... without writing it down" - Quotes the paper's line about the J space operating silently, letting the model "think about a concept without writing it down." - Direct rebuttal: "It's not thinking... It is writing it down... It has this matrix that it updates the numbers every time. That's its workspace. That's its work pad." - Frames this as the paper describing ordinary deep-network mechanics in language engineered to sound mysterious. #### ⏱️ [00:26:25](https://www.youtube.com/watch?v=m6ucYXJyjAk&t=1585) The consciousness / Global Workspace Theory section - Anthropic's hedge, read on screen: "our experiments don't show that Claude can have experiences or feel things" — followed, per Newport, by language he characterizes as "all very suggestive that there's something new going on here." - Newport's structural objection: GWT describes an ongoing, stateful system integrating continuously arriving inputs and selecting among them; a transformer inference pass is feedforward, layer to layer, with no persisted state — "and then it's done, and the token is out. Nothing is saved. There's no states that are changing." - Separately notes GWT itself remains a contested framework even for human consciousness — a further layer of unsettled ground under the comparison. #### ⏱️ [00:27:03](https://www.youtube.com/watch?v=m6ucYXJyjAk&t=1623) "Claude did this on its own" — true of all machine learning - Targets the paper's framing that the J space "emerged on its own" rather than being programmed. - Rebuttal: this describes every trained neural network by definition — nothing in machine learning is hand-programmed; weights start random and are learned through training until loss is minimized. Stating it as if distinctive to Claude implies something it doesn't establish. #### ⏱️ [00:29:00](https://www.youtube.com/watch?v=m6ucYXJyjAk&t=1740) The real stakes: distraction from business questions - Newport's inference about motive: anthropomorphic framing generates "a general sense of ick" that makes the technology feel powerful and alive, which crowds out harder questions. - Named examples of the questions he thinks get skipped: Anthropic's per-token costs, thin competitive moat against smaller specialized/hand-harnessed models, and what justifies a trillion-dollar valuation. - Explicitly flagged by Newport as inference/opinion rather than a proven claim about intent. #### ⏱️ [00:30:04](https://www.youtube.com/watch?v=m6ucYXJyjAk&t=1804) Conclusion and call to action - Distinguishes the researchers ("I like your work and this is good work") from the communications packaging around it. - Direct ask: "Anthropic, will you stop with the... press release research reports? Write computer science papers, sell products, convince us to buy the products." - Final verdict on the episode's framing question: no blockbuster reveal — "we confirmed that yes, language models work the way that at least I always thought they did." ## 📚 References - Anthropic — research report titled (per on-screen reading) "A Global Workspace and Language Models," accompanied by an animated explainer video; specific URL not stated in the transcript. - Axios — headline "Anthropic says Claude has carved out its own space to ponder"; specific article URL not stated in the transcript. - MIT Technology Review — headline "Anthropic found a hidden space where Claude puzzles over concepts"; specific article URL not stated in the transcript. - Yu Zhaozhang (University of Illinois professor) — X/Twitter post citing Jacobian-based interpretability work dating to 2022, listing several related papers; specific post URL not stated in the transcript. - Cal Newport, The New Yorker — prior long-form explainers on LLM architecture (cited by Newport as dating to 2023 and 2024) using the same layered-annotation framing this report is compared against; specific article titles/URLs not stated in the transcript. - Yann LeCun / early deep-learning image-recognition work — referenced generally as the origin of the "layers pick up different features" account of deep networks; no specific paper cited in the transcript. ## 🗣️ Paraphrase Anthropic published an interpretability report showing that Claude's internal activations contain decodable, human-interpretable patterns — a "J space" — that causally shape which word comes out at the end of a prompt. Their own worked example: feed in "the color of the fourth planet from the sun is," and mid-network you can find a pattern that decodes to "Mars" and another that decodes to "color"; swap the Mars pattern for an Earth pattern and the model now says "blue" instead of "red." That's genuinely neat, causally-grounded interpretability work. But Newport's issue isn't the finding — it's the packaging. Once you understand, in ordinary terms, how transformer layers work (each layer adds interpretable "annotations" to a token's representation, later layers narrow down semantically appropriate output using those annotations), Anthropic's result is exactly what that mechanical picture predicts. Nothing about it requires or supports language like "thinking silently," "on its own," or comparisons to a framework for human consciousness. His sharpest technical objection targets the consciousness comparison specifically: Global Workspace Theory describes an ongoing system that integrates a continuous stream of inputs over time, while a transformer forward pass is a single, stateless, feedforward computation that starts fresh with every prompt. Calling attention to that mismatch is a structural argument, not just a stylistic complaint. His closing argument is more speculative: that this kind of anthropomorphic framing serves Anthropic's interests by generating attention and unease that displace scrutiny of harder business questions — token costs, competitive moat, and what justifies the company's valuation. He's explicit that this last part is his opinion rather than a demonstrated fact, while the technical critique of the paper's language is argued in more detail and grounded in the mechanics he spent the first third of the video teaching. ## 📰 Newsletter **A researcher's rebuttal to "Claude is conscious" headlines — worth the 31 minutes.** Anthropic's newest interpretability report ("A Global Workspace and Language Models") set off a familiar cycle: an animated explainer video, breathless X posts about Claude being a "moral patient," and headlines like MIT Technology Review's "Anthropic found a hidden space where Claude puzzles over concepts." Cal Newport's response is a genuinely useful teardown — not a dismissal of the research (he calls it "good work"), but a line-by-line challenge to the language used to describe it. He spends the first third of the video teaching, in plain terms, how transformer layers actually work — annotations accumulating layer by layer, narrowing down a semantically appropriate next word. Then he shows that Anthropic's headline finding maps exactly onto that mechanical picture, and that comparable interpretability techniques predate this paper by several years. His sharpest point: comparing the result to Global Workspace Theory (a framework for human consciousness) glosses over the fact that transformer inference is stateless and feedforward, while GWT describes an ongoing, integrating system — a structural mismatch, not just a stretch. Useful watch for anyone who writes, reviews, or shares AI research communications — a good case study in reading past a press release's framing to what the underlying result actually shows. ## ✅ Action Items #### DevRel - Developer advocacy: build a short internal reference distinguishing "interpretability finding" from "consciousness claim" for use when developers or community members ask about AI-lab research announcements. - Education: use this video's transformer-layer explainer as a citable plain-language teaching resource when introducing how LLMs process prompts. - Developer experience: none directly applicable — this source concerns research communications, not tooling. - Developer marketing: when citing AI-lab research in marketing copy, default to the paper's own hedged language rather than the press coverage's amplified framing. - Community management: watch for community members repeating "Claude is conscious" style claims sourced from press coverage rather than the primary report, and be ready to point to a plain-language rebuttal. - Internal/external/cross-project: flag this as a recurring pattern (AI-lab research report → animated video → anthropomorphized press coverage) worth a standing media-literacy note rather than a one-off response. #### OSPO - Policy & Governance: not directly addressed in this source — no governance mechanism proposed or critiqued. - License Compliance: not addressed in this source. - Security Management: not addressed in this source. - Software Inventory: not addressed in this source. - Developer Support: not addressed in this source. - Community Engagement: not addressed in this source. - Strategic Alignment: relevant as a cautionary case study when evaluating vendor (AI-lab) claims against roadmap decisions — distinguish PR framing from the technical report before acting on a vendor's stated capability claims. #### Community - Maintainers: not addressed in this source. - Contributors: not addressed in this source. - Sponsors: not addressed in this source. - Ecosystem: worth sharing as a model for how to publicly critique a research communication on its technical merits (Newport separates "good research" from "disingenuous framing" rather than attacking the researchers) — a useful tone reference for any ecosystem disagreement about vendor claims. #### WordPress - Core AI: directly relevant — any WordPress Core AI messaging about AI-assisted features should avoid the same anthropomorphizing pattern Newport critiques (e.g., avoid "the AI thinks about" language for deterministic or well-understood mechanisms). - Training: this video is a usable teaching example for a "how to read an AI research announcement critically" module. - Marketing: same caution as Core AI — avoid mystifying language about AI features in WordPress-facing marketing copy. - All other subteams: not addressed in this source. #### The WPCC - Not addressed in this source. ### FAIR - Technical independence: relevant tangentially — Newport's point that only Anthropic could apply this technique to Claude (because only they have model internals) is itself an argument for open-weight models as a check on interpretability claims from closed labs. - Policies and covenants: not addressed in this source. - Productized governance artifacts: a short "how to evaluate an AI-lab research announcement" checklist (distinguish paper language from press coverage; check for prior art; separate causal claims from suggestive juxtaposition) would be a natural artifact derived from this video. ## 🧪 Hypotheses 1. Research communications from AI labs that use anthropomorphic language (e.g., "thinks," "on its own," "puzzles over") generate measurably higher social media engagement than functionally equivalent communications using mechanistic language, controlling for underlying finding. 2. Readers given a plain-language transformer-architecture explainer before reading an AI-lab interpretability report rate the report's findings as less novel and less "conscious-like" than readers who read the report without that context. 3. The Jacobian-based interpretability technique described in this report, when independently reproduced on open-weight models, will show comparable annotation/decoding patterns to those Anthropic reports for Claude — supporting Newport's claim that this is a general transformer property rather than something specific or newly discovered in Claude. 4. Volume of public discourse invoking "AI consciousness" correlates more strongly with the presence of hedged-but-suggestive language and accompanying illustrative media (animated videos, loaded terminology) in an AI lab's own communications than with the magnitude or novelty of the underlying technical finding. 5. Global Workspace Theory, as standardly defined in cognitive science, requires persistent cross-input state integration that a strictly feedforward transformer inference pass structurally cannot exhibit — meaning any GWT-based consciousness claim about current-generation feedforward LLM inference is, by definition, unsupported regardless of interpretability findings about single-pass activations. ### 📊 Methodology - **H1**: A/B test identical technical findings summarized in anthropomorphic vs. mechanistic language, distributed to matched audiences; measure shares, comments, and self-reported perception of "aliveness" of the described system. - **H2**: Randomized controlled reading study — one group reads a plain-language LLM architecture primer before the Anthropic report, a control group reads the report cold; both groups rate novelty and human-likeness of the findings on a standardized scale. - **H3**: Independent replication of the Jacobian/J-lens technique on an open-weight model (e.g., a Llama or Mistral variant) using the same Mars/color-style causal-intervention protocol; compare decoded annotation patterns and ablation effects to Anthropic's reported results. - **H4**: Content analysis of AI-lab research communications over a defined period, coding for anthropomorphic language density and accompanying media (video, animation), correlated against social-media engagement and volume of "consciousness"-framed coverage. - **H5**: Formal comparison of Global Workspace Theory's defining criteria (persistent state, competitive selection among concurrent inputs, broadcast/integration across subsystems over time) against the architectural properties of feedforward transformer inference (statelessness between prompts, single-pass computation) to establish whether the comparison is falsifiable in principle or a category mismatch by definition. ### ❓ Questions - Does Anthropic's original written report include more or less hedging than the accompanying animated video and social/PR amplification — i.e., where exactly does the anthropomorphizing enter the communication chain? - How would Newport's critique change, if at all, for a multi-turn or agentic system that does carry persistent state across a session (as opposed to the single feedforward pass he describes)? - What would a genuinely novel (not previously demonstrated at any scale) interpretability finding about LLM internals look like, and would Newport's own framework recognize it as such? - Is there a version of "interpretability progress at frontier model scale" that's worth reporting on its own terms (bigger model, more layers, higher-dimensional activations) without needing consciousness-adjacent framing to generate interest? - To what extent do AI labs' research communications teams operate independently of the research teams, and does that organizational split explain the gap Newport identifies between "good research" and "disingenuous framing"? ### 🔮 Future Research - A systematic comparison of interpretability terminology across AI labs (Anthropic, OpenAI, Google DeepMind, Meta) to see whether anthropomorphizing language is a house style specific to one lab or an industry-wide pattern. - A history of the specific Jacobian-based interpretability technique from its 2022-era origins (per the Yu Zhaozhang citation) through to this report, to establish precisely what, if anything, is new at the implementation or scale level. - Independent, peer-reviewed evaluation of whether Global Workspace Theory can be meaningfully operationalized for any current AI architecture, feedforward or otherwise — separate from any single lab's marketing framing. - A media-literacy study tracking how a hedged technical claim ("our experiments don't show X, but...") propagates through tech press into unhedged public claims ("Anthropic admitted X"). ### 💡 Implications **Practice**: Communicators, journalists, and developer-relations professionals writing about AI-lab research should default to checking the underlying mechanism (what architecture, what's actually being measured) before amplifying framing language from a press release or accompanying video. **Policy**: As public and regulatory interest in AI consciousness/moral-status questions grows, this video is a case study in why source discipline matters — hedged claims by an interested party (the lab itself) shouldn't set the terms of a genuinely open scientific and ethical question. **Security**: Not directly addressed in this source — no security vulnerability or concrete attack vector is described. **Education**: The video doubles as a teaching resource for transformer mechanics (layers, tokens, embeddings, attention) delivered in accessible analogy-driven language, useful independent of the critique it's embedded in. **Funding models**: Newport's closing argument implies a funding-scrutiny implication directly — that anthropomorphic hype cycles can substitute for scrutiny of unit economics (token costs, competitive moat, valuation justification) when evaluating heavily funded AI labs. ### 🧠 Learning Styles Assessment **Reading level estimate**: Approximate Flesch-Kincaid Grade ~9-10 (estimated manually from transcript sentence length and technical vocabulary density; conversational spoken register with frequent self-correction and long, clause-heavy sentences typical of unscripted podcast delivery, offset by deliberately plain-language analogies for technical concepts — no automated readability tool was run against the transcript). #### 👀 Visual learners - **Present**: Newport shares his screen to show the actual paper, the J-lens example table, and the specific quoted tweets/headlines, giving visual grounding to claims made verbally. - **Improve**: A side-by-side diagram contrasting "feedforward, stateless, layer-by-layer" (transformer inference) against "ongoing, stateful, integrating" (Global Workspace Theory) would make his strongest technical point far more scannable than prose description alone. #### 🔊 Aural learners - **Present**: Long-form, single-speaker, conversational narration is the native format of this podcast and well suited to audio-only consumption. - **Improve**: A tighter 3-5 minute audio pull-quote of just the GWT mismatch argument and the closing "write real papers" ask would work as a standalone highlight for listeners who don't have 31 minutes. #### 🗣️ Verbal learners - **Present**: Newport explicitly defines terms as he introduces them (tokens, embeddings, annotations, ablation) and offers two distinct analogies (scholars at tables; Talmud commentary) for the same underlying mechanism. - **Improve**: A short glossary card (J space, J-lens, ablation, Global Workspace Theory, feedforward) would help viewers who want to look up a specific term without re-watching the tutorial section. #### 🧩 Kinesthetic learners - **Present**: The Mars/Earth/blue causal-intervention example is concrete enough that a viewer could conceptually "try it" by imagining swapping the annotation. - **Improve**: A companion notebook or interactive demo reproducing the swap on an open-weight model would let viewers verify the mechanism hands-on rather than take the paper's word for it. #### 🧠 Logical learners - **Present**: The video is structured as an explicit two-part argument (novelty claim, then framing claim), each supported by named evidence (a prior-art tweet; a term-by-term critique of the paper's language). - **Improve**: A simple table mapping "Anthropic's phrase" → "what it technically means" → "why the phrasing is misleading" would sharpen the already-logical structure into something scannable. #### 🧑‍🤝‍🧑 Social learners - **Present**: The video opens by engaging directly with a real X post and named outlets (Axios, MIT Technology Review), situating the critique within an actual public conversation. - **Improve**: Newport's own newsletter/community (Deep Questions listeners) is the implied discussion venue, but the video itself doesn't include a structured prompt for listener response or debate. #### 🧘‍♀️ Solitary learners - **Present**: Self-contained single-episode argument that a solo viewer can follow start to finish without external context. - **Improve**: A short self-check ("can you now explain in your own words why 'thinking without writing it down' is a misleading phrase?") would suit independent, reflective viewers. #### 🌿 Naturalistic learners - **Present**: Not addressed in this source — no ecosystem or environmental framing present. - **Improve**: Not applicable; forcing an ecological analogy onto an interpretability-research critique would add noise rather than clarity. ### 📊 Accessibility Assessment #### Screen reader semantics - **Present**: Not directly assessable from a transcript-only review; hosted on standard YouTube, which provides basic player semantics. - **Improve**: If republished as an article, use real headings for each argument beat (paper's claim → tutorial → paper revisited → verdict) rather than relying on narration structure alone. #### Keyboard navigation - **Present**: Standard YouTube player keyboard controls apply. - **Improve**: Not applicable beyond standard player behavior — no custom interactive elements in this source. #### Contrast and readability - **Present**: Not assessable from transcript alone (no visual/screenshot review performed). - **Improve**: Screen-shared paper excerpts should use adequately large, high-contrast text given Newport reads from the paper on-screen at several points. #### Text resizing and reflow - **Present**: Standard YouTube player behavior. - **Improve**: Not applicable — no custom UI to evaluate. #### Media and captions - **Present**: Auto-generated English captions exist and were used as the source for this analysis. - **Improve**: Auto-captions contain occasional disfluency artifacts (e.g., a stray "It's putting" mid-sentence, "feed for Remember" instead of a clean "feed-forward. Remember...") around technically precise moments — manual caption correction would help viewers relying on captions for exact wording of the technical rebuttal. #### Forms and interactions - **Present**: Not applicable — no forms or interactive elements in this source. - **Improve**: Not applicable. #### Standards reference - No WCAG 2.2 AA gaps can be confirmed without a visual review of the actual video; the one concrete, verifiable gap from this transcript-only analysis is caption precision on technical terminology during the paper-reading segments (relates to WCAG 1.2.2 Captions). ### 🌍 DEIB Assessment #### Cultural breadth - **Present**: Single speaker, US-centric framing (Axios, MIT Technology Review, X/Twitter as the cited media ecosystem); one cross-cultural reference point (the Talmud/Gemara analogy) used respectfully and accurately to explain a technical concept. - **Improve**: Additional international AI-research or AI-policy voices on the same interpretability-vs-hype question would broaden the perspective beyond US tech media and US-based academic citation (Yu Zhaozhang, University of Illinois). #### Inclusive language - **Present**: Technical, gender-neutral language throughout; the Talmud analogy is introduced with accurate framing (correctly names the Mishnah and Gemara) rather than as a casual or reductive reference. - **Improve**: A few dense technical terms (Jacobian, ablation, feedforward) are defined in-line but assume some comfort with linear algebra vocabulary; a plain-language gloss alongside first use would widen accessibility for non-technical viewers. #### Neurodiversity support - **Present**: Clear two-part argument structure (novelty, then framing) with explicit signposting ("idea number one," "idea number two") helps viewers track the argument. - **Improve**: The video runs long (31:42) with a lengthy embedded tutorial before the critique resumes; chapter markers or a written companion summary would help viewers who benefit from non-linear or skimmable access to the argument. #### Representation - **Present**: One male presenter; quoted parties include an unnamed X poster, two publications, and one named academic (Yu Zhaozhang). - **Improve**: Not enough content in a single-speaker critique video to meaningfully assess representation; would require the wider Deep Questions catalog for a fair evaluation. #### Psychological safety - **Present**: Newport is careful to separate criticism of the *communication* from criticism of the *researchers*, explicitly praising the underlying work ("I like your work and this is good work") rather than attacking individuals — a model of substantive disagreement without personal targeting. - **Improve**: The closing section's inference about Anthropic's motive (distraction from business scrutiny) is more speculative than the technical critique and is framed with confident rhetoric ("I do not like the way Anthropic talks about the research") that could read as more certain than the evidence supports; explicitly labeling that section as opinion earlier (rather than only at the very end) would improve safety/fairness for the party being critiqued. ### ✅ Logical Validity #### Strong reasoning - **Explanatory/mechanistic grounding**: Newport builds a from-scratch technical explanation of transformer mechanics before evaluating Anthropic's claims, then shows the paper's findings map onto that independently-established baseline. This is a legitimate move — if a "finding" is fully predicted by prior, well-established understanding, it's evidence against novelty, not evidence of a breakthrough. Location: ~00:03:34-00:21:00. Strengthened by citing his own dated prior publications (2023, 2024 New Yorker pieces) using the same framing before this report existed. - **Category-mismatch argument (Global Workspace Theory)**: His strongest single point. GWT, as a theory, requires persistent, ongoing, stateful integration of continuously arriving inputs. A transformer forward pass is single-pass, feedforward, and stateless between prompts. This isn't a vibes-based objection — it identifies a specific, checkable structural property (statefulness vs. feedforward) on which the analogy fails. Location: ~00:26:25-00:28:38. This could be clarified further by explicitly naming which GWT criterion (competitive selection among concurrent inputs; broadcast across subsystems over time) is violated, rather than gesturing at "ongoing" and "stateful" together. - **Appeal to verifiable prior art**: Citing a named academic's tweet with a list of specific prior papers (2022 onward) is a legitimate, checkable way to undercut a novelty claim — it's falsifiable (the papers either exist and predate this or they don't) rather than a bare assertion of "this isn't new." - **Consistent equivocation catch ("on its own")**: Correctly identifies that "emerged on its own, not programmed" is definitionally true of all trained neural networks, not a distinguishing fact about Claude specifically — a legitimate point about a phrase that's true but selectively deployed to imply something unusual. #### Fallacies - **Motive speculation presented with more confidence than evidence supports (weak causal inference)**: The closing argument — that anthropomorphic framing serves to distract from harder business questions (token costs, competitive moat, valuation) — is plausible but unfalsified. Simpler alternative explanations exist (research communications teams favor vivid, shareable narratives for engagement, recruiting, or prestige reasons unrelated to obscuring unit economics) that Newport doesn't address or rule out. Location: ~00:29:00-00:29:56. He does flag it as "just my opinion," which mitigates but doesn't eliminate the overclaim; a fix would be presenting it explicitly as one plausible hypothesis among others rather than as the video's structural conclusion. - **Some conflation of distinct sources' rigor**: Newport moves fluidly between critiquing an X post, two press headlines, and Anthropic's own paper language as instances of the same "disingenuous" framing, without clearly distinguishing the epistemic standards each should be held to (a clickbait headline and a hedged research report are not the same category of claim, even if both are misleading). Location: throughout, most visible ~00:00:17-00:01:28 and again ~00:22:05-00:25:00. A fix would be explicitly separating "what Anthropic's paper says (hedged)" from "what the media did with it (unhedged)" as two distinct failure points with two distinct remedies. - **Minor overstatement of paper vs. press distinction he himself later draws**: Early in the video Newport treats the paper's own language ("thinking... without writing it down," "on its own") as itself the source of the disingenuousness, but later acknowledges "they're careful in the paper... they don't say that." These two framings are in some tension — the video would be strengthened by resolving up front whether the primary target is the paper's carefully-hedged language, the accompanying video/animation, or the press amplification, since the rebuttal quotes (e.g., "thinking without writing it down") are attributed to the paper itself. #### Tone of voice - Conversational, didactic, and mostly measured — long uninterrupted teaching segments delivered patiently, punctuated by dry humor ("scary X voice," "digital ick," the Hogwarts Great Hall aside). Shifts to more pointed, repeated use of "disingenuous" (used four times across the second half) and rhetorical questions aimed at Anthropic directly ("Hey Anthropic, how are you going to make a profit?"). Closes on a conciliatory note that separates praise for the researchers from criticism of the communications framing, avoiding an adversarial register toward Anthropic's staff even while using strong language about the company's messaging choices. ### 🛡️ DARVO Analysis DARVO (Deny, Attack, Reverse Victim/Offender) describes how an accused party responds to an accusation of wrongdoing. This video is not a response to an accusation — it's an original piece of criticism directed at Anthropic, and Anthropic is not shown responding to it at all within this source. Strictly, DARVO doesn't apply here in either direction: Newport isn't defending against a claim, and no Anthropic rebuttal is present to assess for denial/attack/reversal patterns. The closest adjacent pattern worth noting is in the paper's own hedging structure, as Newport describes it: Anthropic states a limiting disclaimer ("our experiments don't show that Claude can have experiences or feel things") immediately followed, in Newport's account, by suggestive language that leaves the door open ("that's all very suggestive that there's something new going on here"). This is a **hedge-then-imply** rhetorical pattern — technically accurate denial paired with suggestive framing that undercuts the denial's practical effect — but it is not DARVO: there's no accusation being deflected, no attack on an accuser's credibility, and no reversal casting Anthropic as victim. It's closer to a marketing-communications pattern (qualify the claim precisely enough to avoid falsifiability, while retaining the rhetorical benefit of the suggestive version) than to the conflict-response dynamic DARVO describes. ## 🎯 Conclusion Newport's core argument is that Anthropic's J-space interpretability report describes a real, causally-validated finding — decodable, human-interpretable annotations in Claude's internal activations that measurably influence output tokens — using language calibrated to sound novel and mind-like when the underlying mechanism is the standard, years-old account of how transformer-based deep networks work. His strongest point is technical and specific: the report's implicit comparison to Global Workspace Theory doesn't hold up structurally, because GWT requires persistent, integrating state that a stateless, feedforward transformer inference pass doesn't have. His weakest point is more speculative: an unfalsified inference that the anthropomorphic framing serves to distract from scrutiny of Anthropic's business fundamentals, which he himself labels opinion rather than demonstrated fact. Taken together, the technical critique holds up well on its own logic and evidence; the motive argument is a plausible but separate claim that shouldn't be weighted the same as the mechanistic rebuttal. **Practical next steps for readers**: when an AI lab's research communication uses mind-adjacent language ("thinks," "on its own," "puzzles over"), check whether the underlying mechanism (as described in the technical sections, not the framing) would sound as novel in plain, mechanistic terms — and treat inferences about a company's communications motives as a separate, lower-confidence claim from technical assessments of what the research actually shows. ## 🔄 Refactor Appendix — Anthropic's New "Research" Report is Dumb. ### 📚 Literature Atoms (H3) #### GWT requires stateful integration; transformer inference is feedforward > [!quote] ID:yt_m6ucYXJyjAk_t1711 > Remember, this is feed forward, one layer after another in order, and then it's done, and the token is out. Nothing is saved. **Context & use**: - [00:28:31](https://www.youtube.com/watch?v=m6ucYXJyjAk&t=1711) - Newport's most structurally specific rebuttal of Anthropic's Global Workspace Theory comparison — identifies a concrete architectural property (statelessness) that the consciousness-framework comparison doesn't address. **Tags**: #xref **Highlight**: [view highlight](readwise://) <!-- atomicity: 1 idea ✓ --> #### The paper's "thinking without writing it down" describes normal activation updates > [!quote] ID:yt_m6ucYXJyjAk_t1565 > It is writing it down. It has this matrix that it updates the numbers every time. That's its workspace. That's its work pad. **Context & use**: - [00:26:08](https://www.youtube.com/watch?v=m6ucYXJyjAk&t=1568) - Direct, quotable rebuttal of a specific paper phrase Newport treats as the clearest instance of misleading framing — useful as a template for reading other AI-lab communications critically. **Tags**: #xref **Highlight**: [view highlight](readwise://) <!-- atomicity: 1 idea ✓ --> #### Anthropic's finding matches the pre-existing account of how deep networks work > [!quote] ID:yt_m6ucYXJyjAk_t1380 > This is just how we understand large language models to work. It's also how we understand essentially any deep learning neural network to work. **Context & use**: - [00:23:00](https://www.youtube.com/watch?v=m6ucYXJyjAk&t=1380) - Newport's core novelty rebuttal, delivered right after his "incredibly disingenuous" thesis statement — the load-bearing claim the rest of the critique builds on. **Tags**: #xref **Highlight**: [view highlight](readwise://) <!-- atomicity: 1 idea ✓ --> ### 🧠 Permanent Candidates (H4) #### A confirmatory finding isn't a novel finding **Claim** (Courtney's voice): A result that exactly matches a well-established prior model of how a system works is evidence the system works as expected, not evidence of a new capability — regardless of how the result is framed. **Evidence pointer**: [[#Anthropic's finding matches the pre-existing account of how deep networks work]] **Scope & conditions**: Holds when the "prior model" being confirmed is genuinely well-established and predates the new report (as Newport substantiates via his own 2023/2024 explainers and the cited 2022-era prior art); doesn't hold if the prior model itself was contested or the new result actually extends it in a checkable way. **Links**: - [[AI research communications]] — because applies-in evaluating any lab's press-released research - [[Media literacy]] — because extends into general source-evaluation practice <!-- atomicity: 1 idea ✓ --> ### ✏️ Fleeting Queue - [F1] Read Anthropic's actual published report (not just Newport's on-screen reading of it) to independently verify how much of the anthropomorphic framing originates in the paper itself vs. the accompanying video vs. press coverage — https://www.youtube.com/watch?v=m6ucYXJyjAk #xref - [F2] Check Yu Zhaozhang's cited 2022-era prior work on Jacobian-based interpretability for a fuller picture of what's actually new (if anything) in Anthropic's implementation #xref ### → Things 3 - [ ] Skim Anthropic's original "Global Workspace" report directly to cross-check Newport's characterization before citing his critique as a standalone source — media literacy follow-up #things <!-- deep-read:sections end --> 📄 **Full text:** [[Full Document Contents/Articles/Anthropic's New Research Report Is Dumb..md|Anthropic's New "Research" Report Is Dumb. by Cal Newport]] ## Highlights - essentially any deep learning neural network to work. The original breakthrough work in uh deep learning ([View Highlight](https://read.readwise.io/read/01ky02sfngss7a7j8ascmyxs16)) - Note: Grounds the skepticism in deep-learning history (image recognition → feature layers) as the baseline understanding. - Tags: atom/literature/h3 - different features later layers to try to figure out and make a good guess of what the letter was in a very robust way. this idea of we're picking up higher level features and descriptions of what we're we're um and and of of what we're analyzing. This is just how deep networks work and it's how I always understood large language models. So I see this as like yeah good we saw with the JLens exactly what we expected to find. This is how we assumed large language models what was going you know this is what's happening in those uh embedding vectors. They're they're accumulating annotations that build on ([View Highlight](https://read.readwise.io/read/01kxnvpef22yk8nppfcxj23c6t)) - Note: Newport's core novelty rebuttal: the J-lens finding matches the pre-existing understanding of how deep networks work. - Tags: novelty-rebuttal, atom/literature/h3 - then help you like put out the right recognition or generate the right thing. It's not thinking what does it mean for it to write it down? It is writing it down. It's putting that's how it writes things down. It has this matrix that it updates the numbers every time. That's its workspace. That's its workpad. That's how these type of neural networks work. Um, I'm going to jump forward here to the conclusion du. All right, so here we go. It's like, what about consciousness? And it's like, well, you we we borrowed a lot of ideas ([View Highlight](https://read.readwise.io/read/01kxnvpkttt31yc15x4s0c1hr1)) - Note: Direct rebuttal of "thinking without writing it down" — the activation matrix update IS the writing-down. - Tags: anthropomorphism-rebuttal, atom/literature/h3 - down. It's putting that's how it writes things down. It has this matrix that it updates the numbers every time. That's ([View Highlight](https://read.readwise.io/read/01ky02s9swrg34xezv2gdn5v2t)) - Note: Critique of anthropomorphizing "introspection": it's matrix updates, not thinking — the video's counter-argument. - Tags: atom/literature/h2 - feed forward. Remember this is feed forward. One layer after another in order and then it's done and the token is out. Nothing is saved. there's no add no states that are changing that network that neural network nothing has changed out at all and then you can feed it another prompt you'll get out another token and so they're just looking at the annotations that build up and they're like at some point towards the end we see some of these annotations describe highle properties of the type of thing that it's trying to output a token for that's how LLMs at least my understanding are supposed to work so um ([View Highlight](https://read.readwise.io/read/01kxnvprq74hntgga6nyxhhz93)) - Note: Newport's strongest technical point: GWT requires stateful integration; transformer inference is feedforward and stateless. - Tags: global-workspace-mismatch, atom/literature/h3 - like at some point towards the end we see some of these annotations describe highle properties of the type of thing ([View Highlight](https://read.readwise.io/read/01ky02s3vnrmymgcan6pt4eqf3)) - Note: The speaker's mechanistic read of LLMs — feed-forward annotations building up high-level properties. - Tags: atom/literature/h1