Matthew Berman's video on Anthropic's AI research asks whether recursive self-improvement has already begun. The underlying independent METR assessment does find a consequential change: Anthropic's progress on well-specified capability tasks appears to be accelerating, and METR judges AI assistance to be a major cause. But the report does not show an AI system autonomously designing and training its successor. The difference matters if you are trying to understand the evidence rather than predict a date for superintelligence.
AI-assisted AI R&D is already speeding up at Anthropic; full recursive self-improvement is not established. METR estimates that internal benchmark scores have grown at about 1.9 times their earlier rate since October 2025, with a 95% confidence interval of 1.5 to 2.8 times. Its judgment that AI caused most of the present acceleration is explicitly uncertain. Anthropic itself says the fully autonomous successor-building loop has not arrived and is not inevitable.
Watch Matthew Berman's Analysis
Berman walks through the METR report and argues that it signals the start of an intelligence feedback loop. A JetBrains sponsor segment begins at about 05:34. His forecast and concern about a near-term "singularity" are commentary, not a finding demonstrated by METR.
Source Note: The Video, the Assessor and Anthropic
Checked 9 November 2026. We used the supplied transcript, Berman's video, METR's 5 November assessment and separate Risk Report review, plus Anthropic's own RSI explanation and evaluator-access update. We did not inspect Anthropic's private data, rerun AECI, interview staff or independently reproduce METR's attribution estimate. METR is an external assessor, but its report was produced under negotiated access and publication redactions.
What METR Found, Without the Leap to "Singularity"
| Question | What the primary source says | How to read it |
|---|---|---|
| Did capability progress speed up? | METR estimates a 1.9x change in AECI growth rate after October 2025; the reported 95% interval is 1.5-2.8x. | This is a change in the slope of an internal capability index, mainly on well-specified tasks. It is not a universal model-IQ multiplier. |
| Was AI the cause? | METR's subjective estimate is that a majority, perhaps around 80%, of the current acceleration is due to AI; non-AI factors likely mattered in late 2025. | This is an uncertain attribution judgment, not an isolated causal experiment or a claim that AI produced 80% of all research. |
| Was it simply more training compute? | METR says it received convincing evidence that the acceleration was not caused by faster growth in training-compute scale; details were redacted. | That rules out one explanation for the observed change. It does not mean compute is unimportant or cannot become a future constraint. |
| Is a fully autonomous research loop running? | METR says AI assistance is the main mechanism today, while highly significant fully autonomous contributions to the most important model-training steps are not yet present. | Important acceleration is real evidence of change, but it is not proof that Claude can independently choose, build and validate its successor. |
| Are there no remaining bottlenecks? | METR did not identify a convincing constraint in several inputs for the next 12 months, but states low confidence in that assessment. | "Not identified" is not "none exist." Direction-setting, review, compute, data and other limits could change the trajectory. |
METR defines a two-times acceleration as two years of progress at the earlier pace compressed into one year. The measured 1.9x is about the growth rate of AECI scores, not the speed of a single inference call or a promise that every future model will arrive twice as fast. The report's robustness checks also yielded a wider range depending on analysis choices. Read the measure and its limits together.
Three Different Meanings of "AI Improving AI"
- AI-assisted research: people choose the goals and review results while models write code, run experiments and help analyze failures. This is the dominant mechanism METR describes at Anthropic today.
- Compounding acceleration: a better model helps researchers develop the next one faster, which may improve the following model. METR sees a significant risk of this speeding up further, not a measured law of indefinite exponential growth.
- Full recursive self-improvement: an AI system selects research directions, designs, trains and validates its own successor without relying on human judgment. Anthropic says it is not there yet; METR's report does not claim otherwise.
Berman's phrase "RSI already started" compresses the first two meanings into the third. It is fair to say that AI is participating in a feedback loop around AI development. It is not fair to treat that as proof of a self-running laboratory or a timed path to superintelligence. METR's separate review even treats a possible two-times R&D threshold as an early warning, not direct evidence that catastrophic risk has materialized.
How Independent Was This Assessment?
METR describes an eleven-week engagement, from 12 August to 29 October 2026, staffed by about 2.5 full-time equivalents. It could request a wide range of internal information, and says Anthropic shared more than originally scoped. But Anthropic could approve or deny requests, and METR did not receive unmediated staff-level access or sample non-public models. This is a different engagement from the employee-like evaluator arrangement Anthropic announced on 15 October.
Anthropic had the right to redact non-public information from the public report. METR says a majority of the evidence it found most informative was redacted, so outside readers cannot independently inspect much of the reasoning behind its strongest conclusions. The original scope also included verifying compute allocation between capabilities and safety, but Anthropic removed that component before METR reached a conclusion about allocation. These limits do not erase the assessment; they define how much confidence a reader can place in its public evidence.
What Anthropic's Own RSI Essay Adds
Anthropic's "When AI builds itself" describes Claude helping with code and well-specified research experiments while humans remain stronger at choosing which problems matter. It reports large increases in code authored and merged with Claude's help, but cautions that lines of code overstate true productivity because quantity is not quality. Its scenario for a model fully building its successor is a possible future, alongside slower or stalled paths and organizational bottlenecks.
That makes the practical question sharper than "is the singularity here?": how much valuable research can a human team verify when AI makes experiments cheap? Faster generation can move the bottleneck to experiment selection, independent validation, code review and safety oversight. Those constraints deserve measurement alongside capability charts.
A Better Way to Read the Next RSI Headline
Ask five questions before passing along a claim: What is the unit measured? Is the number a benchmark slope, individual productivity estimate or actual research output? Who set the goal? Did an AI choose the research direction or execute a human-defined task? What was controlled? Were compute, hiring and data changes separated from AI's contribution? What can outsiders inspect? Is the evidence public, redacted or based on interviews? What would falsify the forecast? Name the bottleneck or plateau that would change the story.
For this report, the strongest supported takeaway is already important: METR sees faster capability progress at Anthropic and judges AI use a major driver. The exact causal share, duration of the trend and timing of fully autonomous R&D remain open.
Primary Sources by Role
| Role | Source | Why it matters |
|---|---|---|
| Creator interpretation | Matthew Berman's video | The report walkthrough, reactions and longer-range forecast; not independent access to Anthropic's private evidence. |
| Independent assessment | METR: AI R&D acceleration at Anthropic | The estimate, attribution judgment, uncertainty, access terms and redaction record. |
| Threshold context | METR: review of the August Risk Report | Separates an early-warning acceleration threshold from present catastrophic risk. |
| Lab perspective | Anthropic Institute: When AI builds itself | Anthropic's own account of AI assistance, human judgment and possible future RSI. |
| Access-policy contrast | Anthropic: independent evaluators update | Describes the separate employee-like access program, not the terms of this METR assessment. |
Video Waypoints
These are editorial waypoints drawn from the supplied transcript, not an official chapter list.
The result and what it measures
| Time | Segment |
|---|---|
| 00:00 | Berman opens with the RSI claim |
| 01:20 | Introducing METR's assessment |
| 02:47 | The roughly two-times estimate |
| 04:08 | Attributing acceleration to AI |
Implications and a sponsor break
| Time | Segment |
|---|---|
| 05:34 | JetBrains sponsor segment |
| 06:28 | Could the gains compound? |
| 08:29 | What METR says about bottlenecks |
| 09:41 | The AECI trend |
Evidence and caveats
| Time | Segment |
|---|---|
| 10:38 | Training-compute finding |
| 11:29 | Staff interviews and other evidence |
| 13:49 | Where autonomy still falls short |
| 15:01 | How the assessment worked |
| 16:36 | Canceled compute-allocation check |