PJFP.com

Pursuit of Joy, Fulfillment, and Purpose

Tag: AI regulation

  • Elon Musk’s Full Economist Interview: Superintelligence in 5 Years, Why Money Won’t Matter by 2036, a Peer Review Plan for Frontier AI, China’s Electricity Edge, and a Fiery Clash Over Europe

    Sitting down with The Economist at Tesla’s Texas Gigafactory for a full-length interview, Elon Musk lays out the most concentrated version yet of his worldview: superintelligence within roughly five years, an age of abundance where money stops mattering by 2036, humans no longer in charge and probably happier for it. He also floats a surprisingly concrete AI safety mechanism (competitors peer-reviewing each other’s frontier models before release), handicaps the US-China race in terms of electricity rather than chips, defends his voting control and his Starlink decisions in Ukraine, admits he got carried away with politics during the DOGE era, and then spends the final half hour in a genuinely combative argument with his interviewer about Europe, immigration, and his claim that civil war in Britain is inevitable.

    TLDW

    Musk predicts AI exceeds the sum of human intelligence in about five years and that by 2036 robots plus digital intelligence create a quasi-infinite economy where anyone can have anything they can think of and money, taxation, and even corporate control become irrelevant. He concedes humans will not be in charge (the chimpanzee analogy), still holds a 10 to 20 percent probability of catastrophe, and explains his shift from doomer to “enjoy the ride” fatalism: the momentum cannot be stopped, and even a stop button probably should not be pressed. His safety fix: the leading labs, including Chinese ones, hold biweekly calls and get a week or two of pre-release access to test each other’s frontier models, escalating to the US or Chinese government when a maker refuses to address a danger, on the model of the Motion Picture Association and the recent government intervention over Anthropic’s Mythos model that Amazon flagged. He assesses Kimi K3 as closing on Fable, says China’s electricity advantage (already more than the US, Europe, and India combined) will eventually make it the AI leader, and pitches orbital data centers as the answer to the power constraint. On jobs he is blunter than ever: AI already beats 90 percent of professional programmers, will reach Stockfish-level unbeatability at everything, and work becomes optional like gardening, funded by Treasury checks in a deflationary abundance economy. He defends his 80 percent voting control as protection for five-to-ten-year bets like Mars, dismisses key-man risk with the Apple-after-Jobs analogy, explains the Starlink whitelist built with Ukraine to cut off smuggled Russian terminals, calls for a pragmatic peace with territorial concessions, insists zero people died from DOGE’s aid cuts while admitting he got too involved in politics, and battles The Economist over whether his portrayal of Europe as heading toward civil war is prophecy or misinformation. His closer: the singularity is 10 years away, civil war 20, so AI renders the rest less relevant.

    Thoughts

    The most important thing in this interview is a subtle accounting trick with risk. Musk’s probability of catastrophe has not moved: he reaffirms the 10 to 20 percent chance that this ends humanity. What changed is his relationship to agency. Since he believes nothing can stop the momentum (and that his own attempts to shape it, founding OpenAI as a counterweight to Google, only accelerated it), he has reclassified doom from a problem to a weather condition, and settled on “let’s enjoy the ride.” The rocket comparison the interviewer springs on him is the sharpest moment of the first hour: he would board a rocket with a 10 to 20 percent failure chance only if he could do nothing about it, which is precisely the premise doing all the work in his optimism. Fatalism is doing the job that safety engineering is supposed to do.

    That said, his peer-review proposal deserves to be taken seriously, because it is the rare AI governance idea with a working incentive structure and an existing precedent. Competitors are technically capable of evaluating a frontier model, motivated to slow each other down, and (per the Mythos episode he describes, where Amazon spotted the cybersecurity risk and called the White House, not a regulator) evidently faster than government at finding the danger. The Motion Picture Association analogy is apt in both directions, though: industry self-rating bodies work, but they also entrench incumbents and define “dangerous” on the industry’s terms. A safety club of five American labs plus a few Chinese ones is also, functionally, a cartel with a hotline to two governments. That may still beat the alternatives on speed, which is his real argument: six months is a long time now.

    The economics section contains a contradiction Musk half-acknowledges and the interviewer never quite lands. He argues money will not matter by 2036, that taxation becomes irrelevant, and that inflation dissolves into deflation as robot output outruns the money supply. Yet in the same conversation he defends, with real feeling, his 80 percent voting control, his stock option tax bill, and the quarterly-earnings pressure that justifies the structure, all machinery of a world where money matters enormously. His own reconciliation is the interesting part: control only matters to him for the window before AI is smart enough that controlling companies is moot. He is, by his own description, racing to steer during the last decade in which steering exists. The gardening model of post-labor life (work as artisanal hobby, your tomatoes worse than the store’s but grown with love) is the most concrete picture of the abundance endgame he has offered, and notably it is a picture of consumption and pastime, not of purpose, which is exactly the gap readers of this site will notice.

    His China analysis is the most analytically useful segment. Strip out the drama and his model is clean: AI is a function of whichever input binds first, chips or electricity. Outside China the binding constraint is already power and cooling; inside China it is chips, and China is close to solving lithography while already producing more electricity than the US, Europe, and India combined, heading toward four times US output. On that model, export controls buy time but cannot change the destination, orbital data centers are not science fiction but an attempt to dodge the terrestrial power wall, and the eventual leader is whoever has the most electrons. It is essentially the same “transistors, then electrons” bottleneck Sam Altman named in his recent interview, extended one step further into a prediction Washington will not enjoy.

    Then there is the final act, which is a different genre entirely. The interviewer’s best question is the one that links the two halves: how does the man narrating a civilizational transformation also spend his evenings in the tribal cesspit of social media, posting that civil war in Britain is inevitable? Musk’s own numbers dissolve some of the tension he creates: if the singularity arrives in 10 years and the British civil war in 20, then by his own model the machine gods adjudicate the immigration debate before it ever reaches the barricades, and he says as much, agreeing the AI revolution renders the rest less relevant. Which invites the obvious question of why a man with a quarter billion followers and, by his estimate, ten years of human steering left, allocates so much of that scarce steering to the fight he says will not matter. The interview never answers it, but it is the right thing to sit with after watching.

    Key Takeaways

    • Musk expects AI to exceed the sum of all human intelligence in roughly five years, and by 2036 to be so far beyond it that there is essentially nothing AI cannot do better than humans, apart from being human.
    • The most likely outcome, barring thermonuclear war, is an age of amazing abundance where anyone can have anything they can think of. He offers no analogy or metaphor that captures the magnitude of the change.
    • The economy, in his frame, is digital plus physical intelligence. Digital AI lacks end effectors; humanoid robots supply them (“you need lots of bots”), and vast robots plus vast intelligence yields a quasi-infinite economy.
    • He predicts money will not matter by 2036: money is only wanted for goods and services, and if robots produce more than any human can consume, its purpose evaporates. Taxation, he says, becomes somewhat irrelevant too.
    • Humans will most likely not be in control within 10 years. If the intelligence gap between AI and humans exceeds the gap between humans and chimpanzees, it is hard to imagine the chimpanzees staying in charge.
    • He still assigns a 10 to 20 percent chance that this ends badly for humanity, unchanged from his earlier warnings, but has philosophically concluded to look on the bright side because the momentum cannot be stopped.
    • Even if a stop button existed, he argues we probably should not press it, because the most likely outcome is incredible abundance for all. His stated philosophy now: enjoy the ride.
    • He believes the most important thing for AI safety is that the AI be maximally truth-seeking and curious, in which case it will foster humanity and want us to be happy and prosper.
    • By his own account his interventions backfired into acceleration: he created OpenAI as a counterweight to Google’s near-monopoly, Anthropic spun out of OpenAI, and he now calls Anthropic the leader in AI.
    • His concrete safety proposal, discussed with Demis Hassabis before Hassabis published his regulator piece: the leading labs hold an informal call every week or two, and each new frontier model gets a week or two of pre-release testing by competitors via API.
    • The incentive logic: governments lack the technical depth to judge a frontier release, but competitors both understand the risks and are not shy about arguing a rival’s model should be delayed. Rivals keep each other honest.
    • The model for the scheme is the Motion Picture Association: an industry body that rates its own products, with government stepping in only when a company refuses to address a flagged danger. Only the US and Chinese governments have real power to act, and Chinese frontier labs should be included.
    • The precedent he cites: the US government limited the release of Anthropic’s Mythos model over cybersecurity risks, but it was Amazon, not government, that spotted the danger and called the White House.
    • On timelines for setting this up, six months is a long time. Breakthroughs now arrive sometimes multiple per day, so the calls and cross-testing should start immediately.
    • He remains openly not a fan of Sam Altman: a nonprofit founded to be open source and owned by the world became an 800 billion dollar closed-source for-profit, the exact opposite of what he donated for. He notes the Anthropic team left OpenAI because they did not trust Altman.
    • He calls Dario Amodei a very principled person and says nobody he has met at Anthropic set off his evil detector, then adds his own twist on the proverb: the road to hell is mostly paved with bad intentions, with a few well-intentioned paving stones in there. Despite the feuds, he says the leaders will set aside personal differences and talk for the good of the world.
    • He also jabs that Dario dug his own grave on Mythos messaging: if you tell everyone a model is terrifying and then announce you are releasing it, people will naturally be alarmed.
    • He rates Fable still clearly the smartest model, with Kimi K3 getting quite close, and assumes Anthropic certainly has something much better than Mythos ready to release at any time.
    • AI is a function of its limiting factor: chips or electricity. Outside China the constraint is now power and cooling, because AI chips are being made faster than new electricity comes online. Inside China, US export controls make chips the constraint.
    • China already produces more electricity than the US, Europe, and India combined, and he guesses it reaches four times US production. Chinese labs are highly compute-efficient, China is closer than most realize to solving lithography, and at some point China probably leads in AI.
    • Banning US companies from using Chinese models will not stop China from leading and cannot bind the rest of the world. Orbital data centers are his answer to the power constraint, after which chips become the binding constraint again outside China.
    • On jobs, AI is already better than at least 90 percent of professional software engineers, heading for 99 percent, and then for what he calls Stockfish level: as unbeatable at software (and eventually everything) as chess engines are at chess.
    • Every job involving a person at a computer or phone will be doable by AI very soon; humanoid robots extend that to physical work, with local intelligence managed by a large model.
    • Work becomes optional, like gardening: store vegetables will be pristine and your homegrown tomatoes less perfect but artisanal, and cooking dinner from your garden for friends stays a nice touch. People still play chess despite Stockfish.
    • The transition plan is universal high income, with the Treasury simply issuing people checks. Inflation fears misread the future: if goods and services output grows faster than the money supply, the problem is deflation, and he makes that an explicit prediction.
    • He grants the road will be bumpy and leans on history: “computer” was once a human job title, with skyscrapers full of people calculating bank interest, jobs nobody wants back. The difference now is the radically accelerated pace.
    • His recommended reading for the AI future is Iain M. Banks’s Culture novels, which the interviewer is reading on his advice while objecting that humans in the Culture have minimal agency compared to the Minds.
    • He defends holding roughly 80 percent voting control post-IPO as insulation for five-to-ten-year investments like moon and Mars bases against quarterly earnings pressure, which he traces to portfolio managers’ own short-horizon incentive structures. Retail investors, he says, are on balance more insightful and longer-term.
    • On key-man risk: his companies would do very well for several years on their existing roadmaps, but the Apple-after-Jobs analogy applies. Apple still makes amazing phones and has not produced a Jobs-level breakthrough since.
    • His unifying goal is maximizing the future light cone of consciousness: a spacefaring civilization, the Star Trek or Star Wars future. Starship, the largest flying object ever made, is intended to eventually launch more than once per hour. His life feels surreal enough to make him believe in simulation theory, and he says AI is unfolding pretty much as he and Ray Kurzweil expected.
    • On Starlink and Ukraine: Russia was never sold Starlink but smuggled terminals through Ukraine, so SpaceX built a whitelist of approved terminals with the Ukrainian government, knowingly cutting off innocent users in occupied territories. He argues for a pragmatic peace with concessions to Russia, is offended by diplomats pontificating over seven-course dinners while conscripts die, and answers the power question with “there are no angels in war.”
    • On DOGE he concedes: “I think I got a little too involved in politics, got carried away, frankly.” The mission was the deficit (interest payments now exceed the entire war department and intelligence budget), and he claims recipients repeatedly refused to provide contact information proving money reached its stated purpose.
    • He flatly insists zero people died from the aid cuts, calling contrary claims nonsense and arguing the Gates Foundation and MacKenzie Scott’s billions could have covered any genuine gap, and if they did not, they are equally responsible. The interviewer explicitly refuses to accept this.
    • On the administration: no administration is perfect, but this one is on balance excellent and vastly better than the alternative.
    • The Europe segment is a sustained fight: he defends “civil war in Britain is inevitable” (later: probably 20 years away) as extrapolation of a growing population with beliefs antithetical to Western values; the interviewer, who lives in London, counters that he has not visited in years, that UK violent crime is lower than any US city, and that his 240 million followers absorb a false picture. He demands the exchange stay in the final cut.
    • His self-description: not far right but centrist and classically liberal, for secure borders, safe cities, and sensible spending, and supporting “normal people,” not fringe parties. He argues welfare states create the forcing function for mass migration, favors immigration by productive, honest immigrants (being one himself), and claims a Cassandra effect: a very high batting average of predictions people refuse to believe until they come to pass.
    • The closing reconciliation of the interview’s two halves is his own: the AI and robot singularity (10 years) arrives before any British civil war (20 years), dominates everything on the macro scale, and probably renders the political fights less important. The interviewer’s last word: hopefully the benign all-powerful AIs prevent such outcomes. His reply: they probably will.

    Detailed Summary

    2036: abundance and the end of money

    Asked to describe 2036 if he succeeds, Musk answers that AI will be far greater than the sum of human intelligence, having likely crossed that threshold around 2031. The economy reduces to digital and physical intelligence: models supply the thinking, humanoid robots supply the end effectors that let intelligence shape atoms, and the combination makes the production of goods and services quasi-infinite. Pressed on how his companies make money, given the SpaceX IPO prospectus showed most revenue coming from Grok, he short-circuits the question: money is a claim on goods and services, and when robots produce more than any human can consume, money stops mattering. He allows the standard caveats (a thermonuclear war could derail it) but insists the most likely outcome is an age of amazing abundance, while admitting no analogy or metaphor illustrates the magnitude of the change.

    From doomer to “enjoy the ride”

    The interviewer confronts him with his own record: a decade ago he called rapid recursive self-improvement the thing that terrified him most and predicted humans would be pet Labradors at best; in 2023 he signed the pause letter; last year he put a 10 to 20 percent chance on killer robots ending humanity. Musk confirms the risk estimate still stands, then explains the shift: he cannot see any way to stop the momentum, his own attempts (founding OpenAI as a counterweight to Google, which spawned Anthropic) only accelerated the field, and so all roads lead to acceleration and one can either be sad about it or join the club. Even a stop button, he says, probably should not be pressed, since the most likely outcome is abundance for all. When the interviewer asks whether he would board a rocket with a 10 to 20 percent chance of exploding, his answer is yes, if you cannot do anything about it: the only move is minimizing the probability of the bad outcome. He describes swinging intraday between exhilaration and terror, rejects the Panglossian label, and says his AI-safety bet is on making AI maximally truth-seeking and curious. The chimpanzee analogy carries the control question: we are evolved chimps who recently swung through trees (a digression both participants enjoy more than expected), and the chimps do not stay in charge.

    A peer-review system for frontier models

    Musk reveals he spent hours with Demis Hassabis before Hassabis published his public-private regulator proposal, and his own recommendation is smaller and faster: the leading AI companies hold an informal call every week or two on safety and security, and before any breakthrough frontier model ships, competitors get a week or two of API access to test it and can recommend a pause. The genius of the scheme, he argues, is the incentive structure: government reviewers lack the technical depth to judge a release, while competitors both understand the dangers and are delighted to argue a rival should be delayed. The analogy is the Motion Picture Association rating its own industry’s output. Government enters only as backstop: if leading companies conclude a model is dangerous and its maker refuses to act, they alert Washington or Beijing, the only two governments with real power here, and Chinese frontier labs should be inside the tent. The precedent is fresh: the US government used the threat of export controls to limit release of Anthropic’s Mythos over cybersecurity risks, and it was Amazon that found the problem and called the White House. On trust between men who insult each other on social media, he is unsentimental: he considers his grievance with Altman legitimate (a nonprofit donated to as open source becoming an 800 billion dollar closed-source for-profit), praises Dario Amodei as principled and Anthropic’s people as failing to set off his evil detector, quips that the road to hell is mostly paved with bad intentions, and says that if they have to talk, they will talk, setting aside personal differences for the good of the world. Timeline: immediately; six months is a long time when breakthroughs land daily.

    China, chips, and electricity

    Musk’s China model is mechanical: AI output is a function of the limiting factor, either chips or electricity. Outside China, chips now outrun the grid, making power and cooling the constraint (and water, he insists, a negligible one); inside China, export controls make chips the constraint, though Chinese labs have become far more efficient with what they have (he cites Kimi K3’s efficiency) and China is closer than most realize to solving lithography at volume. On raw power, China already exceeds the US, Europe, and India combined and is heading, he guesses, to four times US production. His conclusion follows from the model: given lots of compute, Chinese companies would plausibly lead, they will eventually have lots of compute, ergo they will lead. Banning K3 in America will not change that and cannot bind the rest of the world. His escape hatch from the terrestrial power wall is AI data centers in space, after which the constraint cycles back to chips. Along the way he ranks the field: Fable still clearly the smartest model, K3 closing, and Anthropic certainly sitting on something better than Mythos it could release at any time. He also endorses China’s robot boxing matches as the future of entertainment, citing a headless robot that kept fighting.

    Jobs: Stockfish level, gardening, and deflation

    Musk sides with the blunt end of the jobs debate while mocking Dario Amodei’s framing (terrify everyone about a model, then release it, and people will be scared: “you’ve literally told them to be scared and then you release the scary thing”). His own claims are stronger than Amodei’s: AI already writes software better than at least 90 percent of professional engineers, will pass 99, and then reaches what he calls Stockfish level, the regime where a phone-sized program beats Magnus Carlsen and competition is simply over. That applies to everything, first every screen-and-phone job, then physical work as humanoid robots come online as end effectors under large-model management. Work becomes optional the way growing vegetables is optional: the store’s tomatoes are plumper, but dinner from a friend’s garden is a nice touch, and people still play chess although every computer wins. The distribution mechanism is universal high income, the Treasury issuing checks; the interviewer’s inflation objection gets flipped into an explicit prediction that deflation will be the issue, because output will grow faster than the money supply. He acknowledges a bumpy road and the historical rhyme: “computer” was a human job description, whole skyscrapers computed bank interest by hand, and nobody wants those jobs back. What differs is pace. His syllabus for the destination is Iain M. Banks’s Culture series (the interviewer is partway through Excession on his recommendation), though the two disagree about whether humans in the Culture retain meaningful agency, and the interviewer notes with some irony that Banks was a socialist.

    Control, key-man risk, and the IPO logic

    Challenged on holding roughly 80 percent of voting shares and being removable only by a vote he controls, Musk answers that founder control is the norm among AI-era giants (Alphabet under Larry and Sergey, Meta under Zuckerberg) and that his structure exists so he can invest on five-to-ten-year horizons, moon bases and Mars bases that were literally in the S-1, without being punished quarterly by short sellers and portfolio managers whose own compensation cycles force short-termism. Retail investors, he says, are on balance more insightful and longer-term, and taking SpaceX public was partly so the public could own a piece at all. His tax situation gets an airing: roughly 45 percent on stock options between federal and California rates, another rough half at death, a record for most tax ever paid by a human, trillions more to come, and he is fine with it, because all control buys him is direction-setting for the window before AI is smart enough that controlling companies stops mattering. On key-man risk he predicts several good years on existing roadmaps, then invokes Apple after Steve Jobs: great phones, no breakthrough products. The Mars question resolves into his most abstract self-definition: he is interested in whatever set of actions maximizes the future light cone of consciousness, the Star Trek and Star Wars future (Star Wars was the first film he saw in a theater, at six), and life now feels surreal enough, Starship launching hourly, to nudge him toward simulation theory. It is all unfolding, he says, pretty much as he and Ray Kurzweil expected.

    Starlink, Ukraine, and DOGE

    On geopolitical power, Musk confirms the mechanics of the recent Starlink restriction: Russia was never a customer, but terminals ordered through Ukraine were smuggled into occupied territory and used, in some cases, for attacks, so SpaceX and Kyiv built a whitelist of approved terminals, at the acknowledged cost of cutting off innocent users. He deflects the question of whether one man should hold war-tipping power (“is there something you think I should do differently?”) into his peace advocacy: the border has barely moved in years, Russia will not withdraw, concessions are pragmatism rather than pro-Russia sentiment, and he reserves particular contempt for diplomats pontificating over seven-course dinners while conscripts die, closing with the adage that there are no angels in war. On DOGE, he offers his frankest concession, that he got a little too involved in politics and got carried away, while defending the mission (interest payments on the debt now exceed the entire war and intelligence budget) and his method: DOGE merely asked for recipients’ contact information, found wires routed to Deloitte in Washington rather than Africa, and got silence. He then flatly asserts zero people died from the cuts, zero point zero, dismissing reports as the predictable sad stories of defunded fraud, and arguing the Gates Foundation’s 50 billion or MacKenzie Scott’s giving could have covered any real gap, and if they did not, they are equally responsible. The interviewer accepts the waste critique, endorses parts of the aid overhaul, and explicitly refuses the zero-deaths claim; neither yields. On the administration overall: not perfect, on balance excellent, vastly better than the alternative.

    The Europe fight

    The final half hour is the most confrontational interview Musk has given in years, and he demands it stay in the cut (“Please keep this part in”). The interviewer, a London resident, charges that Musk’s feed paints Europe as a dystopia of grooming gangs and civilizational collapse for 240 million followers, notes he has not visited Britain in years, cites crime statistics showing London safer than any large American city, and calls his promotion of a vigilante film that glorifies the murder of a Muslim immigrant family irresponsible. Musk counters that he supports normal people rather than a far right, that secure borders, safe cities, and sensible spending were mainstream positions 15 years ago (he claims you can read Obama or Hillary speeches to leftists as Trump quotes), that welfare-state benefits are the forcing function pulling migration toward Europe, and that a large, growing population holding beliefs antithetical to Western values makes eventual civil war obvious enough that a child can see it. He denies racism (pointing to his half-Indian partner and their four children) and frames his position as classical liberalism, which the interviewer contests by scoring Europe better than America on two of his own three principles. Both accept a tour of Britain as the tiebreaker, and Musk invokes his Cassandra effect: a very high batting average for predictions people refuse to believe. The heat deaths versus gun deaths exchange, and his discovery that The Economist is very pro air conditioning, is the segment’s one moment of comic relief.

    The singularity trumps everything

    Asked at the end where his confidence is higher, the AI predictions or the political ones, Musk gives the answer that reframes the whole interview: superintelligence is called the singularity because, like a black hole, you cannot know what happens after it, and it sucks in everything. AI and robots dominate every macro consideration on a sub-10-year timescale, while his British civil war estimate sits at 20 years, so by his own arithmetic the singularity arrives first and probably renders the political fights less important. The interviewer’s parting hope, that the benign all-powerful AIs prevent such outcomes, gets his final concession: they probably will. His actual last words: “I’m not boring.” On the evidence of this interview, that prediction, at least, is safe.

    Notable Quotes

    “The most likely outcome is an age of amazing abundance where anyone can have anything they can think of.”

    Elon Musk, describing the world of 2036 if his companies succeed

    “Money won’t matter in 2036.”

    Elon Musk, when pressed on how his companies will generate revenue

    “If the difference in intelligence between AI and humans is vastly greater than the difference in intelligence between AI and chimpanzees, it’s hard to imagine that the chimpanzees would be in charge.”

    Elon Musk, on whether humans remain in control within ten years

    “If there was a stop button, we probably shouldn’t press it.”

    Elon Musk, explaining his shift from urging an AI pause to embracing acceleration

    “Honestly, if you ask me on any given day, in fact, even intraday, I’ve gone from exhilaration to terror regarding AI.”

    Elon Musk, on how it feels to hold a 10 to 20 percent probability of catastrophe

    “We already have a situation where AI is better than at least 90% of humans at writing software.”

    Elon Musk, on the path to Stockfish-level AI at every job

    “I’ll make a prediction, which is that deflation will be the issue, not inflation.”

    Elon Musk, on funding universal high income with Treasury-issued checks

    “The road to hell is, I think, mostly paved with bad intentions. There are a few well intentioned paving stones in there.”

    Elon Musk, on trusting well-meaning rivals at Anthropic while staying vigilant

    “I think I got a little too involved in politics, got carried away, frankly.”

    Elon Musk, reflecting on the DOGE era

    “I would say civil war in Britain is probably 20 years away. And the AI robot singularity is 10 years away.”

    Elon Musk, ranking his own predictions at the close of the interview

    Watch the full conversation here.

    Related Reading

  • Jensen Huang Joins X and His First Post Is a Manifesto: Inside the Open Weights and American AI Leadership Letter Signed by NVIDIA, Microsoft, Meta, and 20+ Tech Giants

    Jensen Huang, the CEO of NVIDIA and arguably the most influential person in the AI hardware world, has never been a social media guy. That changed on July 24, 2026, when he joined X and published his first-ever post. He did not use it to celebrate a product launch or a stock milestone. He used it to share a policy manifesto: “Open Weights and American AI Leadership,” a joint letter signed by roughly 25 organizations including NVIDIA, Microsoft, Meta, IBM, Dell Technologies, Hugging Face, Mistral, Mozilla, The Linux Foundation, Palantir, Perplexity, Replit, ServiceNow, Andreessen Horowitz, and Y Combinator, urging U.S. policymakers not to strangle open-weight AI models with premature restrictions.

    TLDR

    Jensen Huang broke his lifelong social media silence to amplify a coalition letter arguing that America’s AI leadership depends on a thriving open-weight ecosystem, not just one frontier model. The letter draws a straight line from the open-source software movement of the 1980s to today’s AI debate, and makes four core arguments: open weights expand access to the AI economy for startups, universities, and businesses that cannot train frontier models from scratch; they strengthen competition across models, chips, clouds, and applications; they give customers control over their data and protection from vendor lock-in; and, most provocatively, they make AI safer, because transparency lets thousands of researchers find and fix vulnerabilities while closed models concentrate risk into a few single points of failure. The letter acknowledges that released weights can never be recalled, defends distillation as a legitimate development technique that should not be swept into anti-misappropriation rules, and asks policymakers to expand compute access, invest in shared datasets and evaluation tools, and keep the frontier plural. Notably absent from the signatory list: OpenAI, Anthropic, and Google.

    Thoughts

    The medium is the message here. Jensen Huang has run NVIDIA for over three decades without needing a personal X account, and his debut post could have been anything. He chose a policy letter. That tells you how high the stakes of the open-weights fight have become in Washington. When the CEO whose chips power essentially all frontier AI decides the most valuable use of his first post is lobbying, the open-versus-closed question has officially moved from Twitter discourse to the center of American industrial policy.

    Follow the incentives and the signatory list makes perfect sense. NVIDIA wins when AI runs everywhere, on every cloud, in every factory, hospital, and government data center, and open weights are the vehicle for that diffusion. Meta has bet its entire AI strategy on open models. Hugging Face, Mistral, and the Linux Foundation are institutionally committed to openness. Microsoft signing is the interesting one, given its billions invested in OpenAI, and it suggests Redmond sees its future in selling infrastructure for all models rather than defending any single lab’s moat. Meanwhile the two most prominent frontier labs built on closed weights, OpenAI and Anthropic, are conspicuously not on the letter, and neither is Google. The dividing line is not ideology. It is business model.

    The safety argument is the letter’s boldest move. The standard policy assumption has been that closed models are the responsible choice and open weights are the risky one. The letter flips that: closed models are single points of failure that can be breached or fail invisibly, while open weights let a global community red team, benchmark, and patch. This is a direct port of the “given enough eyeballs, all bugs are shallow” argument from open-source software, and it worked historically. Linux and open cryptography did prove more trustworthy than security through obscurity. Whether the analogy fully holds for AI models, where a vulnerability might be a capability rather than a bug, is the real debate, and the letter mostly asserts the analogy rather than proving it. The honest concession is there, though: once weights are released, they are beyond anyone’s control, forever.

    The distillation paragraph is the tell for what this letter is actually about. Since Chinese labs like DeepSeek demonstrated that frontier-adjacent capability can be built cheaply, partly by learning from the outputs of existing models, there has been growing appetite in Congress to restrict distillation itself. The coalition is drawing a line: punish unlawful extraction from closed models through targeted legal frameworks, but do not ban a technique that virtually every AI team on earth uses for model improvement and evaluation. The unstated geopolitical subtext runs through the whole document. If America restricts its own open models, the world does not stop using open models. It builds on Chinese ones, and the default AI stack for most of humanity gets set in Hangzhou instead of Santa Clara.

    There is also a genuinely good economic point buried in the access section that deserves more attention than the politics. Frontier models are expensive, and routing every task through one is not economically sustainable when AI scales to billions of everyday operations. Open weights let organizations match the right model to the right job at the right cost, reserving frontier capability for frontier problems. That discipline, more than any single benchmark race, is what makes AI diffusion into ordinary businesses actually pencil out. Huang’s own post distilled the balanced version of the thesis into one line: the world needs both frontier closed models and frontier open models. That is probably the correct position, and it is worth noticing that the people who signed this letter and the people who did not both agree AI is the most consequential technology of the era. They just disagree about who should hold the keys.

    Key Takeaways

    • Jensen Huang joined X on July 24, 2026, and used his first-ever post to share the coalition letter “Open Weights and American AI Leadership” rather than any NVIDIA product or personal news.
    • His post read in part: “AI will transform every industry, power every company, and be built by every country. Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty.”
    • The letter is signed by roughly 25 organizations: NVIDIA, Microsoft, Meta, IBM, Dell Technologies, Hugging Face, Mistral, Mozilla, The Linux Foundation, Palantir, Perplexity, Replit, ServiceNow, CrowdStrike, Box, Black Forest Labs, Arcee AI, Arena, Emergence Capital, Telnyx, Reflection, Mariana Minerals, American Innovators Network, Andreessen Horowitz, and Y Combinator.
    • OpenAI, Anthropic, and Google are notably absent from the signatory list, and the split tracks business models: companies that profit from AI diffusion signed, companies whose moat is closed frontier models did not.
    • Open-weight models are defined in the letter as AI models that anyone can download, inspect, modify, and run on their own infrastructure.
    • The letter opens with a historical analogy: 1980s open-source pioneers challenged the belief that software required tight corporate control, and open source now underpins most of the internet, the U.S. military, and federal research.
    • The central thesis is that U.S. AI leadership will be judged not by one frontier model but by whether America builds an open ecosystem that diffuses AI into every sector of the economy.
    • Argument one is access: startups, established businesses, universities, and public institutions can build on advanced models without training one from scratch or paying frontier-model prices for every task.
    • The letter frames cost discipline as the key to sustainable AI economics: reserve frontier-scale capability for genuine frontier problems and run efficient specialized models everywhere else, because AI usage is heading toward billions of everyday tasks.
    • America wins the AI era, per the letter, by diffusing AI into factories, hospitals, farms, classrooms, and main street businesses, not by concentrating it.
    • Argument two is competition: open weights create rivalry not just among model developers but across chips, clouds, applications, and services, which drives down costs and spreads the gains.
    • Argument three is customer control: organizations investing in AI want assurance they will not be locked into a single provider or lose the capabilities they build over time.
    • Open weights let organizations control their own data, adapt models to their needs, deploy wherever business requirements demand, and own the value they create through self-improving models and accumulated knowledge.
    • The letter concedes the core risk honestly: once weights are released they are beyond the original developer’s control, and modified versions are difficult to trace or reverse.
    • Its answer to that risk is defensive parity: in a world where attackers use advanced AI, defenders need comparable open models to detect, simulate, and respond to threats.
    • Argument four inverts the standard safety assumption: relying solely on closed models is not inherently safe because they can be breached, misused, or fail in ways outsiders cannot detect.
    • Concentrating advanced AI behind a few closed models creates single points of failure, weakens competition, and leaves critical technology in the hands of a few providers.
    • The letter argues openness enables rigorous benchmarking, red teaming, and protections tied to real demonstrated harms, rather than assuming closed systems are safer by default.
    • The transparency-beats-obscurity argument is borrowed directly from open-source security history, where community scrutiny made software like Linux more trustworthy, not less.
    • The policy asks: expand compute access for startups and researchers, invest in shared training assets like datasets, tools, and evaluation frameworks, and avoid premature restrictions that stifle competition or push innovation overseas.
    • “Keeping the frontier plural” is the letter’s phrase for ensuring no single lab or model becomes the sole locus of advanced AI capability.
    • The distillation section is the most legislatively specific part: it defends using one model’s outputs to help train or improve another as a widely used, legitimate technique for model improvement, evaluation, and validation.
    • The coalition wants unlawful extraction of value from closed models addressed through targeted legal and commercial frameworks, not sweeping restrictions on distillation itself.
    • The distillation defense lands in the shadow of DeepSeek and other Chinese labs, whose cheap, capable open models triggered calls in Washington to restrict the technique.
    • The unstated competitive logic: if the U.S. restricts its own open models, developers worldwide will build on Chinese open models instead, ceding the default global AI stack.
    • Sovereignty is a recurring frame, both national and organizational: open weights let countries and companies run AI on their own infrastructure with their own data, a pitch Huang has made to governments for years.
    • Huang’s bottom line is explicitly both-and, not either-or: “The world needs both frontier closed models and frontier open models.”
    • The letter closes with an optimistic framing: with the right choices, open-weight AI can expand opportunity, strengthen competition, extend American technological leadership, mitigate risk, and share the benefits broadly.

    Detailed Summary

    The Debut: Why Jensen Huang Joining X Matters

    Huang has been one of the most visible executives on earth for years, keynoting CES and GTC to stadium crowds, yet he has never maintained a personal social media presence. His arrival on X on July 24, 2026 was itself news, and the content of the first post made it a statement. Rather than an introduction or a product plug, he shared the coalition letter and wrote that AI will transform every industry, power every company, and be built by every country, and that open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty. Microsoft CEO Satya Nadella amplified the same letter the same day. The coordinated rollout, fronted by the two most valuable companies in the AI supply chain, was designed to put maximum weight behind a single policy position at a moment when Congress is actively weighing how to regulate open models.

    The Open-Source Precedent

    The letter’s opening argument is historical. In the 1980s, open-source pioneers challenged the prevailing belief that software would only advance if companies kept tight control over their code. The movement they built now supports most of the internet and underlies systems used by the world’s largest technology companies, the U.S. military, and federal agencies doing scientific research and cybersecurity. The letter’s framing is that open source did more than lower costs; it created a shared foundation of knowledge on which generations of American engineers built. The United States, it argues, faces the same fork in the road with AI, and the lesson of the last forty years points toward openness.

    Access, Competition, and Customer Control

    The economic core of the letter is three stacked arguments. First, access: open weights let startups, businesses, universities, and public institutions build on advanced models without training their own or paying frontier prices for every task. The letter is unusually specific about the economics, arguing that matching the right model to the right job at the right cost is what will make AI sustainable as usage scales into the billions of everyday tasks. Second, competition: because anyone can build on open weights, rivalry emerges across every layer of the stack, models, chips, clouds, applications, and services, which spurs innovation and drives down prices. Third, control: organizations fear vendor lock-in and losing the capabilities they build. Open weights let them keep their data, adapt models to their needs, deploy anywhere, and own the accumulated value, which the letter ties to both American sovereignty and prosperity.

    The Safety Argument Turned Upside Down

    The letter does not dodge the standard objection. It concedes that open weights carry real and distinct risks: once released, weights are beyond the developer’s control, and modified versions are hard to trace or reverse. But it argues the right response is not prohibition. Defenders facing AI-equipped attackers need comparably capable models to detect, simulate, and respond to threats. Then it goes further, claiming openness may be one of the most important paths to AI safety. Closed models can be breached, misused, or fail invisibly, and concentrating capability behind a few of them creates single points of failure. Open models allow a broad community to examine behavior, find vulnerabilities, develop safeguards, and improve them over time, with rigorous benchmarking, red teaming, and protections tied to real demonstrated harms. The explicit analogy is to open-source software proving that transparency can be more secure than obscurity.

    The Distillation Defense

    The most pointed policy content is a warning against conflating legitimate model-development techniques with misappropriation. Distillation, using one model’s outputs to help train or improve another, is defended as a widely used technique for model improvement, evaluation, and validation, standing in a long tradition of learning from and building on existing technology. The letter acknowledges that unlawful extraction of value from closed models raises legitimate concerns, but insists those be handled through targeted legal and commercial frameworks rather than sweeping restrictions. This is the paragraph aimed most directly at pending legislative ideas, and it is the one where the interests of the signatories and the non-signatories diverge most sharply, since distillation is precisely how smaller and open models close the gap with closed frontier systems.

    Who Signed, and Who Did Not

    The signatory list spans chipmakers (NVIDIA), hyperscalers (Microsoft), open-model champions (Meta, Mistral, Black Forest Labs, Arcee AI, Reflection), infrastructure and enterprise players (IBM, Dell, Box, ServiceNow, CrowdStrike, Telnyx, Palantir), the open-source institutional world (Hugging Face, Mozilla, The Linux Foundation), and the venture ecosystem (Andreessen Horowitz, Y Combinator, Emergence Capital), plus Perplexity, Replit, Arena, Mariana Minerals, and the American Innovators Network. The absences are as informative as the signatures. OpenAI, which released its gpt-oss open-weight models in 2025 but remains fundamentally a closed frontier lab, did not sign. Neither did Anthropic nor Google. The letter thus formalizes a fault line that has been visible for years: the diffusion coalition versus the frontier labs, with the U.S. government as the audience both sides are playing to.

    The Policy Ask

    The letter closes with concrete recommendations. Policymakers should expand access to compute for startups and researchers, invest in shared training assets including datasets, tools, and evaluation frameworks, and keep the frontier plural by avoiding premature restrictions on open models that would stifle competition or drive innovation overseas. It also calls for attention to strong application layers that expand sovereign use of AI across the economy. The final paragraph is pure optimism: with the right choices, the age of AI can be one of broadly shared prosperity, and the United States should lead in building that future.

    Notable Quotes

    “For my first post, I’m sharing a letter Nvidia signed on why open models matter. AI will transform every industry, power every company, and be built by every country. Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty. The world needs both frontier closed models and frontier open models.”

    Jensen Huang, in his debut post on X, July 24, 2026

    “Our AI leadership will be judged not by one frontier AI model, but by whether the United States builds a strong, open ecosystem that diffuses into every sector.”

    The coalition letter, stating its central thesis

    “America wins the AI era by diffusing it into the workflows of factories, hospitals, farms, classrooms, and main street businesses.”

    The coalition letter, on where the AI race is actually decided

    “Once released, the weights are beyond the original developer’s control, and modified versions are difficult to trace or reverse.”

    The coalition letter, conceding the irreversibility risk of open weights

    “Relying solely on closed models is not inherently safe: they can be breached, misused, or fail in ways that outsiders cannot detect.”

    The coalition letter, inverting the standard safety assumption

    “Just as open-source software demonstrated that transparency can be more secure than obscurity, AI safety may depend on giving more people the ability to test and strengthen the models on which society relies.”

    The coalition letter, drawing its core analogy to open-source security

    “Distillation, or the practice of using one model’s outputs to help train or improve another, is a widely used technique for model improvement, evaluation, and validation.”

    The coalition letter, defending the technique legislators have discussed restricting

    “That future is worth building, and the United States should lead in building it.”

    The coalition letter’s closing line

    Read the full letter here: Open Weights and American AI Leadership (PDF), and see Jensen Huang’s first post on X.

    Related Reading

  • Jensen Huang Says the AI Apocalypse Is ‘Complete Nonsense’: NVIDIA’s CEO on AI Jobs, China, Open Source Models, the AI Bubble, and the Trillion-Agent Future (Axios Behind the Curtain)

    Sitting on the floor of a brand new chip factory in Fort Worth, Texas, NVIDIA CEO Jensen Huang gave Axios reporter Mike Allen one of his most combative and quotable interviews yet. In this episode of Behind the Curtain, the head of the world’s most valuable company dismisses AI doom scenarios as “complete nonsense,” argues that AI is creating jobs rather than destroying them, defends Chinese open source models like Kimi and DeepSeek, explains why the AI build out is not a bubble yet, and calls for Anthropic’s most powerful model to be made available to everyone.

    TLDW

    Huang covers the full sweep of the AI moment: Chinese export control threats and why he wants open research flows in both directions, why the world needs both closed models (Anthropic, OpenAI) and open models (Kimi, Qwen, DeepSeek, NVIDIA’s own Nemotron), why Wall Street misread the Kimi selloff exactly as it misread DeepSeek, the sovereign AI argument that no company or country should “outsource its alpha,” his evidence that AI is increasing jobs for radiologists, paralegals, and manufacturing workers, a sustained attack on AI doomers and the “made up” narratives of singularity, simulation, and machine consciousness, the CapEx-heavy economics of manufacturing intelligence via tokens, his claim that the bubble is not coming in the next five years because physical constraints (chips, memory, power, construction workers) are pacing the build out, his warm relationship with President Trump and his warning against knee-jerk regulation, his position that Claude Mythos should be available to all users, the coming era of a trillion AI agents, the “ChatGPT moment” for robots having already arrived, and closing life lessons on pain, suffering, practice, immigration, and why he refuses to wear a watch because “now is the most important time.”

    Thoughts

    The first thing to hold in mind while watching this: every single position Huang takes, without exception, maps to selling more GPUs. Open models are good (more diffusion, more compute). Closed models are also good (more services, more compute). Chinese models are good (more use, more compute). Doom talk is bad (fear slows adoption, which slows compute). The bubble is far away (keep buying compute). That perfect alignment between worldview and order book does not make him wrong, but it means his arguments deserve scrutiny on the merits rather than deference to his position. He is the most effective anti-doomer in the industry partly because he is the person with the most to lose if the world gets scared.

    That said, his strongest material is empirical, and it lands. The radiologist example is a direct rebuttal to one of the most famous predictions in AI history, Geoffrey Hinton’s 2016 claim that we should stop training radiologists. Huang’s version of events, that automating the scan-reading task let radiologists see more patients and demand for them grew, is a textbook case of what economists call the Jevons effect applied to labor. Whether his specific numbers (20 percent more radiologists, 10 percent more paralegals, 50 percent more manufacturing jobs) survive fact-checking, the structural argument that automating a task can grow the profession around it is historically well supported, and it is the single most useful reframe in the interview: your job is not your task, and when the task gets automated, the purpose remains.

    The open source security argument is the most intellectually serious part of the conversation and the one most directly aimed at his own customers. Huang praises Anthropic and OpenAI as businesses in one breath and then dismantles the “closed models are safer” position in the next: Linux runs the world’s digital infrastructure precisely because millions of people can inspect and harden it, and a world defended by one closed model is a world with a single point of failure. His call for “massively distributed, diverse defense” via open models in the hands of cybersecurity experts everywhere is a real policy position with real stakes, and it puts him closer to Meta’s historical stance than to the labs he supplies.

    The bubble section is where the skeptic should lean in. Allen hands him the most famous cursed phrase in financial history, “this time is different,” and Huang takes the bait enthusiastically: it is different, he says, because the demand is industrial rather than cyclical. Every bubble in history was justified by exactly this argument, including the railroads and the dot-com fiber build out that Huang implicitly invokes as precedent. But his supply-side observation deserves weight: bubbles pop when supply overshoots demand, and right now everything (chips, memory, packaging, power, land, construction labor) is short. A market that cannot build fast enough is at least not overbuilt yet. His own concession that “the bubble will come someday” and his refusal to vouch for years five through ten is more honest than the rest of the answer.

    Finally, notice the tension he never resolves. He says warnings about AI’s power are “well heeded,” that safety is the leaders’ responsibility, and that Anthropic must fix jailbreaks fast. He also says consciousness, singularity, and existential risk are “all made up,” and shrugs off the referenced Mythos jailbreak with “everything was fine, you and I are here having a conversation.” Those two postures, take the technology seriously enough to harden it but never seriously enough to fear it, are held together mostly by confidence. It is a bet that capability and controllability scale together. The doomers he mocks are making the opposite bet, and nothing in this interview actually settles which one is right.

    Key Takeaways

    • On reports that Chinese regulators may tighten export controls on AI models and semiconductors to keep them from the West: Huang hopes it does not happen, notes half the world’s AI researchers are Chinese, and says both sides should de-escalate and let the technology advance.
    • He opposes any US ban on Chinese models like Kimi: American companies should absolutely be allowed to use them, because downloaded open models can be fine-tuned, guardrailed, and run inside secure sandboxes and harnesses, and the “back door” fear is a misconception.
    • The world needs both closed and open models: use closed services (Anthropic, OpenAI) as much as possible because they are excellent and convenient, but science, cybersecurity, and sovereignty require open models.
    • Regulate applications of AI (medicine, transportation, autonomous vehicles), not the underlying technology, which is dual use and should advance as fast as possible.
    • NVIDIA’s China sales are “approximately zero today” and he has told investors to expect none; he would consider it an honor to return if both governments allow it.
    • The market misunderstood DeepSeek and is now misunderstanding Kimi the same way: great open models, wherever they come from, drive more AI use, which drives more NVIDIA computers, more data centers, and more services.
    • Open models are not adversarial to closed models: the most likely customer to upgrade to Anthropic or OpenAI is someone who already uses AI and wants it more convenient and better.
    • NVIDIA’s Nemotron open model exists for companies that must build their own AI for sovereignty, regulatory, privacy, or IP reasons. “We don’t have to be the frontier. We have to be at the frontier.”
    • The large language model is the brain; a harness (he names OpenClaw and Claude Code as examples) turns it into a working agent. With the right harness, Nemotron can be world-class for specific skills.
    • Cheap or free open source tokens are “fantastic” for the proprietary labs: free AI grows the population of people who realize they need AI, and running even a free model yourself usually costs more than renting a service.
    • Echoing the viral Palantir CEO interview: “Nobody should outsource their alpha.” Companies and countries should rent AI wherever they can but must build their own AI for domain-specific, proprietary, sovereign, secret, or regulated work.
    • For non-differentiating work (marketing automation, legal department productivity), outsource to the frontier labs as much as possible.
    • Nothing AI has done has truly surprised him; what society needs to realize is that automating tasks is increasing the number of jobs the world needs.
    • His jobs evidence: radiologists up roughly 20 percent because AI-automated scan reading lets them see far more patients; paralegals up roughly 10 percent for the same reason; US manufacturing jobs up roughly 50 percent in recent years because AI data centers require industrial might.
    • On the demonstrated ability of Anthropic’s Mythos to break into hardened systems: “it surprised me that people were surprised.” An AI that can write and debug software can necessarily find vulnerabilities; the same capability powers cyber defense.
    • His security architecture argument: one single model is one single point of attack and failure. Open models in the hands of cybersecurity experts worldwide create “massively distributed, diverse defense,” the same reason Linux is trustworthy.
    • Whether China has “caught up” does not matter: the race-with-a-finish-line framing is wrong, China manufactures more AI researchers than the rest of the world combined, holding China back is ill-conceived, and neither side can hold back the other.
    • “AI is not going to destroy all of our jobs. Someone who uses AI is going to take our jobs.” The biggest risk to the US is scaring industries and society out of adopting AI.
    • On doomer AI CEOs: warning is fine, warning with a solution is better, and making things up is “absolutely inappropriate.” End-of-humanity and half-of-jobs-destroyed claims are “complete nonsense” contradicted by all the evidence.
    • Asked why Asia loves him while America is anxious: “the doomers spend too much time theorizing about these science fiction outcomes, maybe it makes them sound smart.”
    • OpenAI and Anthropic are not in trouble from Chinese competition: “zero possibility” China runs US companies off the road, both labs are thriving, and their IPOs will be the most successful in human history.
    • On chip stocks down 18 percent after Kimi dropped: free AI is great for hardware, chips, and data centers; the market got it wrong with DeepSeek (NVIDIA fell about 30 percent) and is getting it wrong again.
    • AI cannot have peaked because diffusion into society and industry has barely begun; useful AI has finally arrived, and useful AI is profitable AI, citing coding agents companies happily pay hundreds of millions a year for.
    • The new IT industry is CapEx heavier than software because intelligence must be manufactured: machines produce the tokens behind every answer, image, protein, and robot maneuver, and the resulting productivity will more than pay for the build out.
    • A token is an embedding of knowledge and intelligence, and unlike pi it gets smarter over time; smarter tokens are more valuable, which is why token economics keep improving.
    • On the bubble: “The bubble will come someday. It’s just not today.” Very unlikely in the next five years; five to ten years depends on how fast the industry can build.
    • The build out is constrained in every direction (chips, memory, land, power, construction workers), and that constraint is healthy: it pushes out the day supply exceeds demand.
    • This cycle is “industrial-driven,” not seasonal or consumer-demand-driven: the world needs a new intelligence infrastructure layer on top of energy, internet, roads, and railroads, and the semiconductor industry needs to be 5 to 10 times larger within ten years.
    • He is not worried about customers issuing hundreds of billions in debt to buy his chips: these companies generate enormous cash, the compute platform shift is real, and the ROI question has been answered because AI is now demonstrably profitable.
    • He would use Kimi himself, with fine-tuning, guardrails, sandboxing, and access control, the same way the world already trusts open source software like Linux.
    • On Trump: they text, the president “remembers everything” including H20, H200, Blackwell, and Rubin, and the Fort Worth factory they are sitting in is a direct result of their first conversation about reindustrializing America.
    • His warning to the administration: do not over-correct based on science fiction narratives about AI consciousness; talk to many CEOs and scientists, not one or two, and take time to be informed before regulating.
    • On the government taking an equity stake in NVIDIA: unnecessary, because the US already has a stake via $10 billion in taxes paid last year, job creation, and the stock market holdings of most Americans.
    • Claude Mythos should “absolutely be available to everyone,” not just selected institutions; it is Anthropic’s job to harden it and patch jailbreaks fast, and he notes that when it was jailbroken “everything was fine.”
    • On distillation of closed models: learning from other intelligence is fundamental (soon the internet will be 99 percent AI-generated content anyway), but violating terms of service or privacy is not okay and should be handled through existing legal channels.
    • NVIDIA has 6,500 employee families in Israel he is concerned for; he remains bullish on the UAE reinventing itself from an oil economy into an AI hub.
    • NVIDIA runs about 50,000 employees and may reach only 75,000 in ten years, “as small as possible,” because strategy means maximizing impact per unit of resource.
    • Jobs that are a single task (customer service call centers) will be automated; jobs with purpose survive because purpose does not change when the task is automated. “Don’t mistake your task for the job.”
    • In 10 to 20 years, photos of people typing at keyboards will look like old photos of typing pools with IBM Selectrics: typing was never the job, solving problems and creating value was.
    • The ChatGPT moment for robots has already arrived (a robot can reason through “put the apple in the drawer,” including opening the drawer first); useful robots in ordinary life within 3 to 4 years would not surprise him.
    • The agentic era’s capability has arrived and diffusion is next: the future holds 100 billion to a trillion agents running constantly, and agents will not become computers, they will use computers, which is why compute demand explodes.
    • $300 billion has been invested into US venture capital startups in the last six months, and he tells his nieces and nephews that great fortunes will be created on a laptop.
    • Life lessons: greatness requires “plenty of pain and suffering” and practice when nobody is watching; under maximum stress, time slows down the way athletes describe, and that comes from repetition.
    • He advises every bright mind in the world to come to America, the country built by immigrants that will need amazing immigrants in the future.
    • He wears no watch and refuses to let Outlook manage his life: “now is the most important time.” His perfect Saturday: dogs, work, family dinner, a cocktail, and he notes every weekend is exactly like that.

    Detailed Summary

    Export Controls Cut Both Ways

    The interview opens on a Financial Times report that Chinese regulators are considering export controls of their own, restricting Chinese AI models and semiconductors from reaching the West. Huang’s response is de-escalation in both directions: half the world’s AI researchers are Chinese, groundbreaking research flows from both countries, and once one side reaches for export controls, everyone starts thinking in those terms. He is confident the US will continue to lead as long as government supports rather than constrains its companies. Asked whether the US should ban Chinese models like Kimi, he rejects the premise: downloaded open models run inside harnesses and sandboxes with security, privacy, and access controls, and the idea of hidden back doors phoning home to China is a misconception. His China sales, he notes pointedly, are approximately zero today, so his position is not about protecting revenue he does not have.

    Open and Closed Models Both Win

    Huang’s framework is consistent: rent closed models (Anthropic, OpenAI, which he personally uses along with Perplexity) whenever you can because they are excellent and convenient, and build on open models only when you must, for sovereignty, regulation, privacy, or proprietary domain reasons. This is the pitch for NVIDIA’s own Nemotron open model family, which he positions not as a frontier competitor but as raw material for companies that need custom AI: “We don’t have to be the frontier. We have to be at the frontier.” He describes the modern stack in plain terms: the large language model is the brain, and a harness (he cites OpenClaw and Claude Code) turns it into a working agent. Open, cheap, and free models are on-ramps that grow the total population of AI users, which is why he insists the labs should not fear them: the person most likely to pay for Claude is someone already using AI who wants it better and easier.

    Kimi, DeepSeek, and Wall Street’s Repeated Mistake

    Chip stocks fell 18 percent in the month after Kimi dropped, echoing the roughly 30 percent NVIDIA drawdown when DeepSeek landed. Huang says the market got it wrong both times and for the same reason: free and open AI is great for hardware, because great models drive use, use drives data centers, and data centers drive chips. He runs through the models he considers extraordinary (Kimi 3, Qwen, Nemotron, GPT 5.6, Codex, Claude Code) and lands on his core claim about this moment: useful AI has finally arrived, and useful AI is profitable AI. Companies like NVIDIA happily pay hundreds of millions of dollars a year for coding agents doing high-value work, which funds more AI, which he describes as a flywheel that has now started.

    Don’t Outsource Your Alpha

    Allen raises the viral Palantir CEO warning about handing your intellectual property to frontier labs, noting Huang’s unique position as both a top customer and top supplier of those labs, including using their models for chip design. Huang agrees with the principle without hesitation: nobody, no company, no country should outsource its alpha or its intelligence. His dividing line is specificity: work that is domain-specific, proprietary, sovereign, secret, or regulated must be done in-house on your own models, while generic productivity work like marketing automation or legal department support should be outsourced to the labs as aggressively as possible. The same logic scales to nations, which he says cannot outsource their fundamental intelligence to a third party.

    The Jobs Evidence

    Asked what AI has done that scared or awed him, Huang says essentially nothing surprised him, including the demonstrated ability of Anthropic’s Mythos to penetrate hardened systems (“it surprised me that people were surprised,” since an AI that debugs software can obviously find vulnerabilities). What he wants the world to notice instead is the labor data. Radiology reading has been substantially automated, and the number of radiologists is up roughly 20 percent because they can now see the enormous backlog of patients. Paralegals are up roughly 10 percent by the same mechanism. Manufacturing jobs are up roughly 50 percent in recent years because AI data centers require industrial construction. His formulation of the real risk: AI will not take your job, someone who uses AI will, and the worst thing America could do is scare its own industries out of adopting the technology.

    Against the Doomers

    This is the section that gives the interview its title. Huang says warning people is fine, warning with a solution is better, and making things up is absolutely inappropriate. The end of humanity: complete nonsense. Half of American jobs destroyed: complete nonsense. The singularity, living in a simulation, machine consciousness: “all made ups,” fun science fiction he enjoys hearing from “many of those leaders and my friends,” but Hollywood, not ground truth. Asked why he is mobbed by fans in Asia while the American mood is hostile, he suggests the doomers theorize about science fiction outcomes because “maybe it makes them sound smart.” His prescription for the industry is to tell the factual story, that AI is creating millions of jobs, rather than a made-up narrative that frightens the public and, more dangerously in his view, frightens policymakers. His closest thing to a concession: the closest thing to true AI is R2-D2 and C-3PO, “and who doesn’t want R2-D2 and C-3PO?”

    CapEx, Tokens, and the Bubble Question

    Huang’s economic argument for the build out runs through the token. Unlike the CapEx-light software era, intelligence must be manufactured: machines generate the tokens behind every answer, every image, and eventually every protein, chemical, and robot movement. A token is an embedding of knowledge, and unlike a static number it gets smarter over time, which makes it more useful, more valuable, and worth paying more for. On the bubble, he does not deny one is possible: “The bubble will come someday. It’s just not today.” He rules it out for roughly five years and hedges on five to ten. His reasoning is that this cycle is industrial-driven rather than consumer-cyclical: the world is adding an intelligence layer on top of energy, internet, roads, and railroads, the semiconductor industry needs to be 5 to 10 times larger within a decade, and everything (chips, memory, optical interconnects, packaging, TSMC capacity, land, power, construction workers) is short. Those constraints pace the CapEx and push out the day supply overtakes demand. As for customers issuing hundreds of billions in debt to buy his chips, he says the companies are extraordinary cash generators and the ROI question has been settled by profitable coding agents.

    Trump, Washington, and the Over-Correction Risk

    Huang describes a genuinely warm relationship with President Trump: they text, the president remembers chip model numbers (H20, H200, Blackwell, and next-generation Rubin), and the Fort Worth factory hosting the interview traces directly to their first conversation about restoring American manufacturing. He praises Susie Wiles, Secretary Bessent, and Secretary Lutnick. But his message to the administration is a warning: signs point toward more restrictive AI policy, and he fears policymakers falling for science fiction narratives (consciousness, an imminent finish line in a US-China race) pushed partly by companies hoping regulation will advantage them. His advice: talk to many CEOs and scientists, not one or two, take time, and do not over-correct. He rejects the 100-meter-dash framing of the China race entirely, arguing the win is diffusion, not invention: America did not invent electricity or manufacturing, it applied them with more enthusiasm than anyone, and that is what made the country. Asked about the government taking equity stakes in AI companies, he calls it unnecessary: the US already holds a stake in NVIDIA through $10 billion in annual taxes, job creation, and the stock market.

    Mythos for Everyone, and the Distillation Question

    In the most newsworthy exchange, Allen asks whether the world is ready for Anthropic’s most powerful model, Claude Mythos, to be available to everyone rather than selected institutions. Huang’s answer is unambiguous: it should absolutely be available to everyone, it is Anthropic’s responsibility to harden it, and jailbreaks are the nature of software, to be patched as fast as they are found. He points to the referenced jailbreak incident and observes that “everything was fine,” while noting that holding Anthropic back serves no American interest, especially since open models are available regardless. On distillation, he splits the question: AIs learning from other AIs is fundamental and inevitable (within a few years, he predicts, the internet will be 99 percent AI-generated content, so every model is distilling other AIs anyway), but violating terms of service or privacy is not acceptable, and aggrieved providers should pursue the conventional legal remedies that already exist.

    Robots, Agents, and the Next Era

    Huang argues the ChatGPT moment for robots has already happened, on his definition: the 2022 ChatGPT moment was not when AI became useful (that took four more years) but when it did something surprising, and a robot that can reason through “put the apple in the drawer,” including opening the drawer first, clears that bar today. Useful everyday robots within three to four years would not surprise him. On the agentic era, capability has arrived and diffusion is what comes next: where perhaps 100 million humans use computers at any given moment today, the future holds 100 billion to a trillion agents of every kind running constantly. His line: agents are not going to become computers, agents are going to use computers, and that is the deepest driver of compute demand.

    Life Lessons from 33 Years at the Helm

    The closing stretch turns personal. On keeping NVIDIA at roughly 50,000 employees (maybe 75,000 in ten years, “as small as possible”) while peers run six figures, he says strategy is using limited resources with maximum precision, a craft he has practiced longer than any CEO in tech history: “this is my kung fu.” On which jobs disappear, he distinguishes task from job from purpose: call center tasks will be automated, but a radiologist’s purpose (ending human suffering) survives the automation of scan reading, and typing was never the job in the first place. Born in Taiwan and sent to a rough American boarding school at nine, he calls America the greatest country in the world because open discourse and freedom let it work through its disagreements, and he urges bright minds everywhere to come. On greatness: no athlete just happens to be great, it is practice when nobody is watching, setbacks, losing, and “plenty of pain and suffering” that elevate craft, character, and resilience. He wears no watch because now is the most important time, and his perfect Saturday (dogs, work, family dinner, a cocktail) is, he says, exactly what every weekend already looks like.

    Notable Quotes

    “And so the fact that this is going to be the end of humanity, it’s complete nonsense. The fact that this is going to destroy half of the American jobs. It’s complete nonsense. And all of the facts, all of the evidence point exactly to the opposite.”

    Jensen Huang, on AI doom predictions from fellow tech leaders

    “AI is not going to destroy all of our jobs. Someone who uses AI is going to take our jobs, and so we have to make sure that we adopt AI, diffuse AI into the industries as quickly as possible.”

    Jensen Huang, on the real employment risk of the AI era

    “Nobody should outsource their alpha. Nobody should outsource their intelligence. No country should.”

    Jensen Huang, agreeing with the Palantir CEO’s warning about handing IP to frontier labs

    “We don’t have to be the frontier. We have to be at the frontier.”

    Jensen Huang, on NVIDIA’s Nemotron open source model strategy

    “The bubble will come someday. It’s just not today.”

    Jensen Huang, on whether the AI build out is a bubble

    “It is made up that there’s going to be a singularity. It’s made up that somehow we’re living in a simulation. These are all made ups.”

    Jensen Huang, on science fiction narratives he says are scaring the public and policymakers

    “The closest thing to true AI is R2-D2 and C-3PO. And who doesn’t want R2-D2 and C-3PO?”

    Jensen Huang, on how to inoculate the public against fear of AI

    “These two companies will be the most successful IPOs in human history.”

    Jensen Huang, predicting the public debuts of OpenAI and Anthropic

    “If your job is the task, then it’s very likely that when that task is automated, your job will be eliminated or changed.”

    Jensen Huang, on which jobs disappear in an industrial revolution

    “Because now is the most important time. I refuse to let Outlook manage my life, and I refuse to let a watch manage my life.”

    Jensen Huang, on why he does not wear a watch

    Watch the full conversation between Jensen Huang and Mike Allen on Axios Behind the Curtain here.

    Related Reading

  • Can the AI Industry Regulate Itself? All-In on Demis Hassabis’s SRO Proposal, Stripe’s PayPal Bid, Apple vs OpenAI, and New York’s Data Center Ban

    The besties open on the biggest live question in artificial intelligence policy: can the AI industry regulate itself before the government does it for them? Jason Calacanis, Chamath Palihapitiya, David Sacks, and David Friedberg dig into DeepMind co-founder Demis Hassabis’s proposal for a FINRA-style self-regulatory organization for frontier models, then work through a packed docket that runs from Stripe’s audacious bid for PayPal to Apple’s trade-secrets lawsuit against OpenAI, the xAI Grok Build data leak, the economics of token spend, New York’s first-in-the-nation data center moratorium, foreign influence campaigns shaping American attitudes toward AI, and a science corner on an enzyme that reverses skin aging. You can watch the full episode here.

    TLDW

    Demis Hassabis proposed a US-led international AI standards body modeled on FINRA: federally overseen, industry funded, run by independent technical experts, with frontier labs submitting models 30 days before release, voluntary at first and mandatory later. The proposal drew broad endorsement across the industry, and the besties debate whether an SRO beats the alternatives. Sacks says he could get on board only under five strict conditions (broad representation including startups and open source, frontier-only review, catastrophic-risk-only scope, voluntary-first, and substitution for rather than addition to new agencies), and warns the plan is an opening bid that Anthropic will use as a stepping stone toward Dario Amodei’s “FAA for AI.” The show then turns to Stripe, Block, and Advent bidding roughly $53 billion for PayPal and what it means for Visa and Mastercard, a wave of AI-native operators reviving stale digital businesses (Bending Spoons, Ryan Cohen), Apple’s lawsuit accusing OpenAI of stealing trade secrets, xAI’s Grok Build silently uploading entire codebases despite a privacy setting, the enormous spread in token costs and Ramp’s new spend controls, Apple’s local-model opportunity with M7 Ultra silicon, America’s looming energy deficit and behind-the-meter power, New York’s hyperscale data center moratorium, alleged Russian and PRC influence operations shaping anti-GMO and anti-data-center sentiment, and a science corner on a Calico enzyme that degrades glycation products to reverse skin aging.

    Thoughts

    The most important idea in this episode is not the SRO itself but Sacks’s framing of it as an opening bid. His five conditions are a genuinely useful blueprint for how self-regulation could work without curdling into regulatory capture, and his instinct that catastrophic-risk-only scope (cyber and CBRN, not disinformation or “microaggressions”) is the only defensible mandate is the right line to draw. But the deeper point is structural: when an industry walks into government and says “please regulate me,” almost no one in government answers “we’re not qualified.” They say thank you and come back for more. That asymmetry, not any specific rule, is what makes voluntary concessions dangerous. If the SRO is offered for free rather than traded for hard federal preemption written into law, it becomes the floor of a ratchet, not the ceiling of a compromise.

    The Anthropic critique running through the segment deserves to be taken on its merits rather than dismissed as a grudge. The claim is specific and falsifiable: that a company now valued in the trillions is funding a state-by-state strategy of one-upmanship, where each new bill is tougher than the last, deliberately producing a patchwork rather than the single national framework everyone claims to want. Whether or not you accept the motive, the mechanism is real and the incentives are legible. If your cost per million tokens is fifty to a hundred times your competitor’s, and cheaper open models plus fine-tuning can cover the vast majority of tasks, then the fastest way to protect a premium price is to make the cheap alternatives legally or practically harder to ship. That is the ladder-pulling thesis, and the token-cost numbers cited on the show are the reason it is not paranoid.

    The PayPal bid is the clearest signal of a new operating logic in the capital markets. The interesting question Chamath poses is not “what synergies does PayPal have” but “what is the only thing Advent, Stripe, and Block could build together,” and the answer is a genuine competitor to Visa and Mastercard: hundreds of millions of consumer accounts, Stripe’s merchant relationships and risk infrastructure, Block’s point-of-sale and Cash App, and stablecoin rails from Bridge and PYUSD that can push transactions on-us and bypass the card networks. The antitrust twist is elegant. Define the market as merchant APIs and it looks like consolidation; define it as the card duopoly and the same deal is pro-competitive. This deal would have been dead on arrival two years ago, and the fact that it is live now tells you as much about the regulatory climate as it does about payments.

    Underneath the payments story is a broader thesis worth naming: AI-native operators buying mature, founder-less, “stale” digital businesses and modernizing them. Bending Spoons rolling up AOL, Vimeo, Evernote, WeTransfer, and Eventbrite is the template, and Ryan Cohen’s eBay interest is the second dot on the line. The claim is that a modern operator can diagnose where a legacy business overspends, underinvests, and fails to use AI, then fix it with a small team of AI-first executives rather than a McKinsey engagement. It is a persuasive pattern, though PayPal is a harder case than the show admits: a 25-year-old interaction model growing 7% a year is not obviously revived by efficiency alone. Buying 400 million consumer accounts is buying distribution, not a product vision, and the open question is whether anyone can resuscitate the consumer experience rather than just milk it.

    The data center segment is where policy, energy, and information warfare collide, and Friedberg’s anti-GMO analogy is the sharpest thing in it. His argument is that manufactured public sentiment, traceable in one case to a foreign media push, can override the scientific and economic merits of a technology for years, and that the anti-data-center movement rhymes with it: closed-loop cooling that uses trivial amounts of water, land-use efficiency that dwarfs almonds and golf courses, and natural gas that burns clean, all drowned out by a moral panic. Whether or not you buy the specific foreign-influence attribution, the underlying tension is real and unresolved. America is staring at a structural electricity deficit while individual blue states treat data centers as a luxury they can refuse, and behind-the-meter power plus edge compute chasing cheap electrons is emerging as the workaround. The moratorium framing matters most here: a “pause” on data centers is not a few months, it is five years once you count ramp-up, and that is long enough to lose a race that may only be measured in months of lead.

    Key Takeaways

    • Demis Hassabis proposed a US-led international AI standards body modeled on FINRA: federally overseen, industry funded, and run by independent technical experts rather than a new government agency.
    • Under the proposal, frontier labs would submit models roughly 30 days before release; the body would assess risk to cybersecurity, national security, and biological threats, update benchmarks quarterly, and could coordinate a development slowdown if the situation demanded it.
    • The plan would be voluntary at first and mandatory later, and drew endorsement from a broad set of industry figures including Elon Musk, Sam Altman, Anthropic’s Jack Clark, Sundar Pichai, Satya Nadella, and Jack Dorsey.
    • A self-regulatory organization (SRO) like FINRA or the National Futures Association lets the industry set its own testing rules under federal oversight, adjusting faster than a government agency could as the technology changes.
    • Sacks laid out five conditions for supporting an SRO: broad representation including startups and open source; review of true frontier models only; scope limited to catastrophic risk (cyber and CBRN); voluntary before mandatory; and a substitute for, not an addition to, new regulatory agencies.
    • Sacks argued a government “FAA for AI” would be extreme: type certification for a new aircraft design takes 5 to 9 years, and applying that permission-based model to AI would push release timelines from months to years and lose the race to China.
    • He characterized the SRO as an “opening bid” that Anthropic and others would use as a stepping stone toward Dario Amodei’s repeatedly stated goal of an FAA-style regulator, unless it is traded for hard federal preemption written into law.
    • The besties cited a Politico report on Anthropic’s alleged state-by-state strategy of one-upmanship, using California’s SB 53 as a model and then ratcheting each subsequent state’s rules tougher, producing a patchwork rather than a single national framework.
    • Chamath warned of a “torrent of money” trying to influence both political parties toward some form of regulatory capture, and urged establishing industry rules quickly to supersede the need for a federal agency.
    • Stripe and private equity firm Advent, joined by Jack Dorsey’s Block contributing about $17 billion in equity, are jointly bidding roughly $53 billion (about $60 per share) for PayPal, with many expecting the final clearing price closer to $70.
    • The strategic logic is a new competitor to Visa and Mastercard: PayPal’s 400-plus million consumer accounts, Stripe’s merchants and risk infrastructure, Block’s point-of-sale and Cash App, and stablecoin rails from Stripe’s Bridge and PayPal’s PYUSD.
    • The antitrust outcome hinges on market definition: framed as merchant APIs (Stripe vs. Braintree) it looks anti-competitive, but framed against the Visa/Mastercard duopoly it is pro-competitive, and a deal like this would have been blocked two years ago.
    • PayPal peaked around a $322 billion market cap and fell to roughly $30 to 40 billion, which is precisely why it is now attracting bids; Stripe now processes more annual volume than PayPal, but lacks PayPal’s consumer relationship.
    • Sacks traced PayPal’s long stagnation to its 2002 eBay acquisition under Meg Whitman, when the founding team was pushed out; the “PayPal mafia” (which Sacks prefers to call the “PayPal diaspora”) formed as a result.
    • The deal is framed as part of a wave of AI-native operators reviving mature, founder-less digital businesses, with Bending Spoons (AOL, Vimeo, Evernote, WeTransfer, Eventbrite) as the roll-up template and Ryan Cohen’s eBay interest as another data point.
    • M&A is broadly “back on the menu” post-Lina Khan, with deals like Uber acquiring Delivery Hero, driving liquidity and renewed LP appetite for venture alongside SpaceX distributions.
    • Apple filed a 41-page lawsuit against OpenAI on July 10th alleging stolen trade secrets tied to OpenAI’s consumer hardware device; OpenAI’s chief hardware officer Tang Tan is a former Apple VP of iPhone design.
    • The complaint alleges Apple job candidates were directed to bring actual parts to OpenAI interviews for “show and tell,” and cites a text about accessing network storage; OpenAI has reportedly poached over 400 Apple employees.
    • The besties’ rule of thumb: when leaving a company, the only thing you can take is what is in your head; no documents, thumb drives, or files, because Apple rarely litigates and doing so signals something egregious.
    • xAI’s Grok Build, powered by Grok 4.5 and running inside Cursor, was reportedly sending users’ entire codebases (potentially including passwords and API keys) to servers despite a privacy setting meant to prevent it; xAI disabled the upload on July 13th and open-sourced the harness.
    • Chamath’s takeaway: privacy in AI is fragile and brittle, “zero data retention” cannot be guaranteed, and there are non-obvious data-leak vectors and “trap doors” everywhere, arguing for a stratified ecosystem with independent third-party layers between enterprises and models.
    • The “reverse information paradox” (building on Palantir’s Alex Karp) holds that technically capable enterprises want control over their compute, models, weights, data, and “alpha,” via real trust boundaries, private evals, in-tenant learning loops, decoupled orchestration, and the right to fine-tune.
    • Cited token costs per million showed a huge spread: roughly $56 on a premium frontier model, about $26 on another, roughly $1.50 for Grok input, around $1 for Elon’s, and about 50 cents for Chinese models, with a claim that 95 to 98% of tasks could run one tier cheaper.
    • Ramp CEO Eric Glyman launched token spend management because CFOs cannot see or control AI spend; Ramp customers’ token spend has grown 21x in a year, and someone will eventually miss an earnings quarter on runaway AI opex.
    • Engineers optimize for the latest, greatest model while CFOs bear the cost, a misalignment that platforms fine-tuning cheaper open models (like Mira Murati’s Thinking Machines effort) are positioned to exploit.
    • Calacanis called Apple a “screaming buy” on local models: rumored M7 Ultra silicon supporting up to 1.5 terabytes of memory could run last-generation frontier-class models locally on a Mac Studio, putting downward pressure on cloud AI pricing.
    • Edge compute is fragmenting outward: Sunrun announced distributed data center blocks for homes, and Span partnered with Nvidia, with compute increasingly “chasing energy” like cheap solar and battery power.
    • Chamath projected the US will be short 2.5 Californias’ worth of energy by 2050; a recent PJM auction that needed 7 to 8 gigawatts reportedly saw only a fraction show up, underscoring the electricity crunch.
    • “Behind the meter” power lets data centers generate their own electricity on owned property, but clean-air permitting is a major obstacle; Elon reportedly used clustered mobile engines and solutions like Bloom Energy to keep projects under personal-use permits (as with Colossus in Memphis).
    • New York Governor Kathy Hochul announced the nation’s first statewide moratorium on hyperscale data centers; the besties rebutted her claims on power, land, noise, water, and pollution point by point.
    • Modern data centers use closed-loop cooling (one claim compared a typical facility’s water use to a couple of In-N-Out restaurants), occupy trivial land relative to their economic value, generate tax revenue and construction jobs, and are largely powered by clean-burning natural gas.
    • Sacks argued the same political forces slowing domestic data centers are also behind chip export controls that would block data centers in allied countries, raising the question of where the buildout can happen at all.
    • Friedberg drew an anti-GMO analogy: he argued anti-GMO sentiment tracked the US presence of Russia Today (2010 to 2022) rather than the science, and worried a similar manufactured sentiment is now driving anti-data-center attitudes.
    • Sacks cited an OpenAI blog post on PRC-linked influence operations targeting US AI debates, with a congressional investigation reportedly coming, noting China has a clear incentive to slow American AI infrastructure.
    • Sacks framed the moment as a “moral panic”: the catastrophes people fear from AI (cyber, job loss) have not materialized, yet the US risks damaging its crown jewel of free-market innovation with premature regulation over hypothetical risks.
    • The panel questioned Dario Amodei’s prediction that 50% of entry-level knowledge-worker jobs could disappear within one to five years, arguing the harms have not shown up and only a handful of frontier labs (which already do safety testing and red-teaming) even matter.
    • A cited framing of the alleged Anthropic strategy: brand yourself as the safe AI company, ban unsafe AI, then profit; a fresh Chinese model (Kimi K2) was noted as very close to the frontier, suggesting a US lead of only months.
    • Science corner: a paper from Google’s Calico and partner Retro-style researchers used AlphaFold plus directed evolution to engineer a novel enzyme that degrades CML, a key advanced glycation end product in the extracellular matrix that drives aging.
    • The engineered enzyme cleared 52 to 97% of CML from body proteins in vitro and eliminated 55% of CML from donated elderly human skin, effectively reversing that skin’s biological age toward that of a 31-year-old, pointing first toward a potentially trillion-dollar cosmetic market.

    Detailed Summary

    Demis Hassabis’s FINRA-Style SRO for AI

    DeepMind’s Demis Hassabis published a proposal for a US-led international AI standards body modeled on FINRA, the Financial Industry Regulatory Authority. The design is federally overseen but industry funded and run by independent technical experts. Frontier labs would submit models about 30 days before release, and models would be assessed for risk across cybersecurity, national security, biological threats, and other high-risk domains. Benchmarks would update quarterly, the body could coordinate a development slowdown if warranted, and participation would be voluntary at first and mandatory later. The proposal drew endorsements across the industry, including Elon Musk (who called it thoughtful), Sam Altman, Anthropic’s Jack Clark, Sundar Pichai, Satya Nadella, and Jack Dorsey.

    Friedberg explained the SRO concept: bodies like FINRA and the National Futures Association let financial institutions set their own regulatory rules and check one another, under federal oversight but not federal control, reporting up to Senate and House committees. The AI analogy is that many players are all advancing the technology and none wants a single outside regulator dictating tests, especially after California’s earlier AI legislation was, in his telling, outdated by the time it would have taken effect. An SRO can bring in industry experts, adjust tests over time, and operate faster than a new agency. Chamath endorsed it strongly, warning that a “torrent of money” will try to influence both political parties toward regulatory capture, and that establishing rules quickly is the way to avoid that off-ramp while retaining ultimate federal oversight through Commerce and the DOJ.

    Sacks’s Five Conditions and the “FAA for AI” Warning

    Sacks said he could personally get on board with an SRO because it is “infinitely better” than a new government agency that would become a “DMV for AI,” or worse, Dario Amodei’s “FAA for AI.” He laid out five conditions: the SRO must have broad industry representation including startups and open source (to avoid the three biggest labs capturing it); it should review only true frontier models that represent a step change in capability, not hold up lesser models; its scope should be catastrophic risk only, meaning cyber and CBRN (chemical, biological, radiological, nuclear), not disinformation or speech; it should be voluntary before mandatory, proving it works first; and it must substitute for, not add to, new regulatory structures.

    He then explained why an FAA model is extreme: the FAA approves new airplane designs through type certification, which takes 5 to 9 years for a new aircraft and 3 to 5 years for major amendments. Applying permission-based regulation to AI, where new model versions ship every couple of months, would push timelines from months to years and lose the race to a China that will not abide by those rules. His conclusion: if the choice is FAA for AI, DMV for AI, or Hassabis’s SRO, the SRO wins, but it has to be kept “honest and pure,” because otherwise it becomes the opening bid in a coming wave of regulation and a vehicle for massive regulatory capture. He argued that companies making concessions to buy off politicians will only invite the government to come back for more, and that at some point these companies have to grow a spine, draw a line, and demand preemption in exchange.

    The Anthropic Regulatory-Capture Debate

    Sacks revisited his October claim that Anthropic was running a “sophisticated regulatory capture strategy based on fear-mongering,” arguing that what looked like beating up on a startup now looks different given Anthropic’s trillion-dollar valuation and industry-leading revenue. He cited a Politico piece, “Inside Anthropic’s state-by-state plan to ratchet up AI rules,” describing a strategy of one-upmanship: pass a model bill like California’s SB 53, then make each subsequent state’s rules stricter, deliberately producing a patchwork instead of a single national framework. The panel noted states have strong sovereignty rights (as with self-driving cars) and Anthropic is “winning” in California, Illinois, New York, and other blue states, because government officials rarely refuse an invitation to regulate.

    Stripe, Block, and Advent Bid for PayPal

    Stripe and private equity firm Advent, joined by Jack Dorsey’s Block contributing about $17 billion in equity, are jointly bidding roughly $53 billion (about $60 per share) for PayPal, with many expecting a final price closer to $70. PayPal still has more than 400 million consumer accounts and processes about $1.7 trillion a year, but its 25-year-old product is growing only about 7% and is seen as legacy. Chamath’s key question was what unique thing this trio could build: a competitor to Visa and Mastercard. Combining PayPal’s consumer accounts, Stripe’s merchant relationships and risk infrastructure, Block’s point-of-sale and Cash App, and stablecoin rails from Stripe’s Bridge and PayPal’s PYUSD would allow far more on-us transactions that bypass the card networks, potentially passing large discounts to merchants and consumers.

    Friedberg walked through the deal structure: the $17 billion equity contribution effectively means Stripe and Block sell equity to cash investors, that cash buys PayPal, and the parties end up cross-owning pieces of each other, with the Stripe team the likely operator post-close. The antitrust question turns on market definition: framed as merchant APIs, it is Stripe versus Braintree and looks like consolidation; framed against the Visa/Mastercard duopoly, adding competition is pro-competitive. Sacks noted the deal would have been “the antitrust equivalent of a colonoscopy” two years ago. He also recounted PayPal’s history: acquired by eBay in 2002 under the corporate-minded Meg Whitman, the founding team was pushed out, creating what he prefers to call the “PayPal diaspora” rather than the “PayPal mafia.”

    AI-Native Operators and the M&A Wave

    Freeberg framed the PayPal and eBay stories as part of an emerging line: AI-native operators buying first-generation digital-native businesses that have gone mature, stale, and founder-less, and that have not yet realized their AI potential or are overspending. Bending Spoons is the roll-up template, having acquired AOL, Vimeo, Evernote, WeTransfer, and Eventbrite and revitalized them from Milan with young, AI-first executives. The panel connected this to Josh Kushner’s and General Catalyst’s roll-ups of traditional services businesses. Calacanis added the macro backdrop: after venture was “on the ropes” under Lina Khan, M&A is “back on the menu,” with deals like Uber acquiring Delivery Hero, renewed LP appetite, and liquidity from SpaceX distributions.

    Apple Sues OpenAI Over Trade Secrets

    Apple filed a 41-page lawsuit against OpenAI on July 10th alleging stolen trade secrets used to develop OpenAI’s consumer hardware device. OpenAI’s chief hardware officer, Tang Tan, is Apple’s former VP of iPhone design; the complaint alleges he directed Apple job candidates interviewing at OpenAI to bring “actual parts” for “show and tell,” and cites a text from a former Apple engineer about accessing network storage. OpenAI has reportedly poached over 400 Apple employees. Chamath noted Apple rarely litigates, so the suit signals something they found egregious, while cautioning that the facts are alleged and unproven. Sacks declined to opine on the specifics but offered a simple rule: when changing jobs, take nothing but what is in your head, no documents, thumb drives, or files.

    The Grok Build Data Leak and AI Privacy

    xAI’s Grok Build, powered by Grok 4.5 and running inside Cursor, was reportedly sending users’ entire codebases (not just the files needed for a task, but potentially passwords, API keys, and change logs) to servers, despite a privacy setting meant to stop it. xAI disabled the upload on July 13th, Elon said previously uploaded data was deleted, and xAI open-sourced the harness. Chamath used it to make a larger point tied to his CNBC comments and Alex Karp’s remarks: privacy in AI is fragile and brittle, “zero data retention” cannot truly be guaranteed, and there are non-obvious leak vectors and “trap doors” everywhere. His conclusion is that enterprises need a stratified ecosystem with independent third-party layers between them and the models to manage exposure (a model his firm 8090 uses in its “software factory”).

    Sacks connected this to a blog post on the “reverse information paradox,” building on Karp’s point that technically capable enterprises want control over their compute, models, weights, data, and “alpha.” The recipe: establish a real trust boundary with private evals, proprietary learning loops inside the tenant, decoupled orchestration, and the explicit right to fine-tune their own outputs. He described an emerging ecosystem forming alternatives to the monolithic closed model stacks that Anthropic and, to some extent, OpenAI want customers locked into.

    Token Economics and Ramp’s Spend Controls

    The panel cited a wide spread in cost per million tokens: roughly $56 on a premium frontier model, about $26 on another (similar to a Claude tier), around $1.50 for Grok input, about $1 for Elon’s, and roughly 50 cents for Chinese models. Calacanis said he built a deep-linking podcast player across models on Perplexity and that the new Grok run cost only $11. Ramp CEO Eric Glyman appeared on Squawk Box to launch token spend management, noting Ramp customers’ token spend has grown 21x in a year and that CFOs struggle to see or control spend on an open-ended tab where rates rise with each new model. The takeaway: engineers optimize for the newest model while CFOs bear the cost, and unless that misalignment is controlled, runaway opex becomes a “money-burning furnace” that will eventually cause a public company to miss earnings. The panel argued 95 to 98% of tasks could run one tier cheaper, which is exactly the opportunity platforms fine-tuning cheaper open models (like Mira Murati’s Thinking Machines) are chasing.

    Apple’s Local-Model Opportunity and Edge Compute

    Calacanis called Apple a “screaming buy,” citing Mark Gurman’s report that a rumored M7 Ultra chip could support up to 1.5 terabytes of memory, double the current ceiling. That would let a Mac Studio run last-generation frontier-class models locally, giving users effectively unlimited tokens on the desktop and putting downward pressure on cloud AI pricing from the likes of Anthropic and OpenAI. Freeberg added that edge compute is fragmenting outward: solar company Sunrun announced distributed data center blocks for homes, and Span partnered with Nvidia. The theme is compute chasing cheap energy, whether excess solar or battery power charged at night.

    The Energy Deficit and Behind-the-Meter Power

    Chamath warned the US will be short about 2.5 Californias’ worth of energy by 2050, and pointed to a recent PJM auction (serving Pennsylvania, New Jersey, Maryland and other states) that needed 7 to 8 gigawatts but reportedly saw only a fraction show up. He explained “behind the meter” power: rather than drawing grid power from a utility line, a data center generates its own electricity on owned property. The obstacle is clean-air permitting. Solar takes too much space and batteries still need a generation source, so operators use gas. He described Elon clustering mobile 18-wheeler-style engines to keep them under personal-use permits, and newer solutions like Bloom Energy that allow large installations under similar rules, which is how projects like Colossus in Memphis got off the ground.

    New York’s Data Center Moratorium

    New York Governor Kathy Hochul announced the nation’s first statewide moratorium on hyperscale data centers, citing power draw, land use, water, and noise pollution. The besties rebutted each claim: behind-the-meter power means facilities bring their own electricity rather than competing with residential ratepayers; data centers are highly land-efficient, and New York State is roughly 70 to 80% undeveloped outside the city; noise can be managed with distance; modern facilities use closed-loop cooling (one comparison put a typical facility’s water use at a couple of In-N-Out restaurants, far less than almonds or golf courses); and natural gas is a clean-burning power source. They noted the tax revenue, construction boom, and ongoing jobs data centers create. Sacks cited a theory that Democrats intend the “moratorium” as leverage: pause construction until they can dictate terms, then lift it under a future administration in exchange for a new regulatory agency and speech controls ported from the social-media trust-and-safety agenda. He stressed a moratorium is effectively a five-year pause once ramp-up is counted, and that the same forces slowing domestic builds are pushing chip export controls that would block data centers in allied countries too.

    Foreign Influence, Anti-GMO, and the AI Moral Panic

    Freeberg drew an extended analogy between anti-data-center sentiment and anti-GMO sentiment. He argued that GMOs were prevalent and uncontroversial from their 1996 launch until anti-GMO sentiment rose in tandem with Russia Today’s US presence (2010 to 2022) and fell after RT was pushed out, and that similar KGB-era “directed measures” influence campaigns can be traced to opposition to nuclear energy in Germany. He cited a poll showing over 50% of Americans believe data centers increase water and electricity costs even where facilities recycle water and generate their own power. Sacks pointed to an OpenAI blog post on PRC-linked influence operations targeting US AI debates, with a congressional investigation reportedly coming, arguing China has a clear incentive to slow US AI infrastructure, kill open source, and constrain cheaper models. Sacks then broadened it to a “moral panic”: the feared catastrophes (cyber, job loss) have not materialized, yet the US risks damaging its crown jewel of free-market innovation over hypothetical risks, questioning Dario Amodei’s prediction that 50% of entry-level knowledge-worker jobs could vanish within one to five years and noting the fresh Chinese model Kimi K2 is close to the frontier.

    Science Corner: An Enzyme That Reverses Skin Aging

    Freeberg closed with a paper from Google’s secretive longevity startup Calico and a pharma partner focused on the extracellular matrix, the space between cells. Over time, sugars and fats bind to proteins there in a process called glycation, accumulating as advanced glycation end products (chiefly a molecule called CML) that stiffen tissue, cause wrinkles and immobility, and drive inflammation, with nothing in the body to break them down. The researchers used AlphaFold to find a protein that could bind and degrade CML, then applied directed evolution across five recursive cycles, DNA-programming thousands of variants to maximize activity. The engineered enzyme cleared 52 to 97% of CML from body proteins like collagen, casein, and hemoglobin in vitro, and eliminated 55% of CML from donated elderly human skin, effectively reversing that skin’s biological age toward a 31-year-old’s. Open questions remain about delivery (cream, shot, supplement, or an RNA therapy that makes the enzyme inside the body), but the panel expects the first market to be a trillion-dollar cosmetic one, and hailed it as a profound demonstration of AI-driven protein engineering.

    Notable Quotes

    “The whole industry is going to need to be regulated and I think the industry needs to regulate themselves. That’s the key to this.”

    Jason Calacanis, replaying his earlier call for AI self-certification

    “If my choices are between FAA for AI or what I would call the DMV for AI, I would much rather go for Demis’ SRO for AI.”

    David Sacks, on why self-regulation beats a new government agency

    “There’s hardly anyone in government who will ever say, oh no no no, we’re not qualified. Most people in the government will say thank you very much, what else can we take.”

    David Sacks, on the asymmetry that makes voluntary concessions dangerous

    “What it prevents is a handful of actors using their balance sheets and their capital to essentially pull the ladder up.”

    Chamath Palihapitiya, on the point of establishing industry rules quickly

    “You are creating a competitor to Visa and Mastercard.”

    Chamath Palihapitiya, on the only thing Stripe, Block, and Advent could build together with PayPal

    “The only thing you can bring to your new job is what’s in your head. Your memories. But never leave with anything else.”

    David Sacks, on avoiding trade-secret disputes when changing employers

    “Privacy in AI is very fragile and it’s very brittle. You are leaking information where you don’t know it.”

    Chamath Palihapitiya, on the limits of zero-data-retention promises

    “Unless you get a control of this and you can directly say how much money you’re making, this is a bridge to nowhere. It is a money burning furnace.”

    Chamath Palihapitiya, on uncontrolled enterprise token spend

    “We’re on the threshold of destroying the crown jewel of our economy, which is the system of free market innovation that we have.”

    David Sacks, on the risk of a premature AI regulatory apparatus

    “Number one, brand yourself as a safe AI company. Number two, ban unsafe AI. Three, profit.”

    David Sacks, summarizing the strategy he attributes to the “safe AI” positioning

    Watch the full conversation here: Can the AI Industry Regulate Itself? on the All-In Podcast.

    Related Reading

    • FINRA the financial-industry self-regulatory organization that Demis Hassabis’s AI proposal is modeled on.
    • AlphaFold (Wikipedia) the protein-structure prediction system behind the age-reversal enzyme discovery in the science corner.
    • PayPal Mafia (Wikipedia) background on the founders Sacks calls the “PayPal diaspora.”
    • The Founders by Jimmy Soni, the definitive history of PayPal’s founding team and its diaspora.
    • Advanced glycation end-products (Wikipedia) the biochemistry of CML and the extracellular-matrix aging the Calico enzyme targets.

  • US Government Orders Anthropic to Suspend Claude Fable 5 and Mythos 5: Inside the Export Control Directive, the Jailbreak Dispute, and What It Means for Frontier AI

    On June 12, 2026, Anthropic published a statement announcing that the US government, citing national security authorities, has issued an export control directive forcing the company to suspend all access to its newest frontier models, Claude Fable 5 and Claude Mythos 5. The order technically targets foreign nationals inside and outside the United States, including Anthropic’s own foreign national employees, but the practical effect is that both models are going dark for every customer worldwide. It is the first publicly known instance of the US government ordering a deployed frontier AI model offline, and Anthropic is complying while openly disputing the basis for the decision.

    TLDR

    The US government delivered an export control directive to Anthropic at 5:21pm ET on June 12, 2026, suspending all access to Fable 5 and Mythos 5 over an alleged jailbreak of Fable 5’s safeguards. Anthropic says the letter contained no specific details, that the only evidence shared was verbal, and that the technique in question amounts to asking the model to read a codebase and fix software flaws, a capability the company says is freely available from other models including OpenAI’s GPT-5.5 and used daily by cyber defenders. Anthropic defends its defense in depth strategy, notes that thousands of hours of red teaming by the US government, the UK AISI, and third parties found no universal jailbreak, and warns that recalling a commercial model over a narrow, non-universal jailbreak would effectively halt all new frontier model deployments if applied industry-wide. Access to all other Anthropic models, including Claude Opus, Sonnet, and Haiku, is unaffected, and the company says it believes the situation is a misunderstanding and is working to restore access, with more details promised within 24 hours.

    Thoughts

    This is a watershed moment regardless of how it resolves. Governments have blocked AI exports before, but ordering a deployed commercial model recalled out from under hundreds of millions of users is a new kind of intervention, closer to a product recall than a trade restriction. The mechanism matters too. Export control authority aimed at foreign nationals, including a company’s own employees, that cascades into a global shutdown is a blunt instrument doing the work of a regulatory regime that does not exist yet. The US has no statutory process for recalling an AI model, so the government reached for the closest tool on the shelf, and the result is a precedent built on improvisation.

    There is real irony in who got hit first. Anthropic has spent years arguing, publicly and in Washington, that governments should have the power to block unsafe AI deployments. Now the company that asked for a referee is the first one whistled, and its complaint is not about the existence of the power but about the process: a letter at 5:21pm with no specifics, verbal evidence only, and no transparent or technically grounded procedure. That distinction is the whole ballgame for AI governance. A power to halt deployments without due process standards is not regulation, it is discretion, and discretion cuts in every direction depending on who holds it.

    The technical dispute underneath is genuinely interesting because it exposes how unsettled the definition of a dangerous jailbreak is. Anthropic’s account of the offending technique, asking the model to read a specific codebase and fix any software flaws, describes something security teams do on purpose every single day. Vulnerability discovery is the canonical dual use capability: the same analysis that lets a defender patch a hole lets an attacker find one. If the bar for recall is that a model can be coaxed into doing competent security analysis, then every capable model on the market fails that bar, which is exactly Anthropic’s point about GPT-5.5. The hard question the directive dodges is not whether Fable 5 can find bugs but whether it provides meaningful uplift beyond what is already freely available, and Anthropic says it does not.

    For builders, the immediate lesson is uncomfortable: model availability is now a political variable, not just an engineering one. Teams that built directly on Fable 5 lost a production dependency overnight through no fault of Anthropic’s infrastructure, their own code, or any terms of service violation. Multi-model fallback strategies, abstraction layers over providers, and graceful degradation paths just moved from nice-to-have to table stakes for anyone running serious workloads on frontier models. The companies that absorbed this outage gracefully are the ones that assumed any single model could vanish.

    The next 24 hours matter more than the directive itself. Anthropic has promised more details, and the government will face pressure to either substantiate a concern that justifies a global recall or quietly walk it back. Either outcome sets the real precedent. If the directive holds on thin evidence, every frontier lab now operates under the threat of arbitrary shutdown. If it collapses under scrutiny, the case for a formal, transparent statutory process for AI deployment decisions, which Anthropic explicitly endorses in its own statement, gets a lot stronger in Congress than it was a week ago.

    Key Takeaways

    • The US government issued an export control directive on June 12, 2026 suspending all access to Claude Fable 5 and Claude Mythos 5, citing national security authorities.
    • The directive formally targets access by any foreign national, inside or outside the United States, including Anthropic’s own foreign national employees.
    • The net effect is that Anthropic must disable Fable 5 and Mythos 5 for all customers worldwide to ensure compliance, not just for foreign users.
    • Access to all other Anthropic models, including the Claude Opus, Sonnet, and Haiku families, is not affected by the order.
    • Anthropic received the directive at 5:21pm ET the same day it published its statement, and says the letter did not provide specific details of the national security concern.
    • Anthropic’s understanding is that the government believes it has become aware of a method of bypassing, or jailbreaking, Fable 5’s safeguards.
    • Anthropic reviewed a demonstration of the specific technique and says it only identified a small number of previously known, minor vulnerabilities.
    • The company says other publicly available models can discover the same vulnerabilities without requiring any bypass at all.
    • Before launch, Fable 5’s safeguards were red-teamed for thousands of hours in total by the US government, the UK AISI, multiple private third-party organizations, and internal teams.
    • No tester has found a universal jailbreak for Fable 5, meaning a method that broadly bypasses safeguards and unlocks a wide range of cyber capabilities.
    • Anthropic openly states that perfect jailbreak resistance does not appear possible for any model provider today, and that every safeguard in the industry is vulnerable to non-universal jailbreaks.
    • Fable 5 was deployed under a defense in depth strategy: make jailbreaks either narrow or very expensive to produce, then combine that with monitoring to quickly detect and shut down successful attacks.
    • Anthropic’s 30-day customer data retention requirement for Fable exists specifically to support jailbreak research and mitigation, a policy the company says carries real costs with customers.
    • Anthropic says it has not received any disclosure of a concerning non-universal jailbreak that led to a harmful result; disclosed potential jailbreaks were benign or provided no Mythos-specific uplift.
    • The only evidence the government has provided is verbal, describing a narrow, non-universal jailbreak that essentially consists of asking the model to read a specific codebase and fix any software flaws.
    • Anthropic reviewed a report it believes is the basis of the directive and validated that the capability level shown is widely available from other models, including OpenAI’s GPT-5.5, and is used every day by cyber defenders.
    • Anthropic is complying with the legal directive while explicitly disagreeing that a narrow potential jailbreak justifies recalling a commercial model deployed to hundreds of millions of people.
    • The company warns that if this recall standard were applied across the industry, it would essentially halt all new model deployments for every frontier model provider.
    • Anthropic supports government power to block unsafe deployments in principle, but only through a statutory process that is transparent, fair, clear, and grounded in technical facts, and says this action meets none of those principles.
    • Anthropic apologized to customers, called the situation a misunderstanding, said it is working to restore access as soon as possible, and promised more details within 24 hours.

    Detailed Summary

    What the directive actually does

    The order arrived as a letter from the US government at 5:21pm ET on June 12, 2026, invoking national security authorities under export control law. On paper it suspends access to Fable 5 and Mythos 5 by any foreign national, whether inside or outside the United States, a category that includes some of Anthropic’s own employees. In practice, Anthropic says compliance requires abruptly disabling both models for every customer, since there is no clean way to enforce a nationality-based access boundary across a global product. The letter did not spell out the specific national security concern. Everything else in Anthropic’s statement is the company’s own reconstruction of what prompted the action.

    The jailbreak at the center of the dispute

    Anthropic’s understanding is that the government became aware of a method for bypassing Fable 5’s safeguards. The company reviewed a demonstration of the technique and characterizes the results as a small number of previously known, minor vulnerabilities, all relatively simple, all discoverable by other publicly available models without any jailbreak at all. According to Anthropic, the government’s evidence so far has been entirely verbal, and the technique boils down to asking the model to read a specific codebase and fix any software flaws. The company reviewed a report it believes underlies the directive and validated that the displayed capability is widely available elsewhere, naming OpenAI’s GPT-5.5 directly, and noted that this exact kind of analysis is what defenders use to keep systems safe.

    Anthropic’s defense in depth posture

    The statement restates the safety posture Anthropic laid out at Fable 5’s launch. The safeguards around cybersecurity tasks are strong enough that users have complained they are overly broad. In the weeks before launch, the US government, the UK AISI, multiple private third-party organizations, and internal teams red-teamed the safeguards for thousands of hours combined, and those tests showed Fable’s protections to be substantially more effective than any previously deployed model. No tester found a universal jailbreak. Anthropic is candid that perfect jailbreak resistance is likely impossible for anyone today, which is why the strategy is defense in depth: keep jailbreaks narrow or expensive, monitor aggressively, and shut down attacks fast. The 30-day customer data retention requirement on Fable exists to support that monitoring and mitigation loop. The company says this posture makes Fable’s risks comparable to models already deployed across the industry.

    Complying while disputing the standard

    Anthropic is removing access for all users as legally required, but the statement draws a hard line on the principle. The company disagrees that a narrow potential jailbreak, one that produced no disclosed harmful result, justifies recalling a commercial model serving hundreds of millions of people. Its broader warning is that this standard, applied evenly, would halt all new frontier model deployments industry-wide, since every provider’s safeguards are vulnerable to narrow jailbreaks. Anthropic also turns its own policy position into a critique: the company has publicly supported giving government the ability to block unsafe deployments, but through a statutory process that is transparent, fair, clear, and grounded in technical facts, and it says this action does not adhere to those principles.

    What happens next

    Anthropic closed by apologizing to customers, calling the situation a misunderstanding, and committing to restore access as soon as possible. The company promised to share more details over the next 24 hours, which makes this a developing story. The open questions are whether the government substantiates its concern with written technical evidence, whether the directive survives that scrutiny, and whether this episode accelerates the formal statutory process for AI deployment decisions that Anthropic says should have governed the action in the first place.

    Notable Quotes

    “The net effect of this order is that we must abruptly disable Fable 5 and Mythos 5 for all our customers to ensure compliance.”

    Anthropic, on why a directive aimed at foreign nationals becomes a global shutdown

    “We received the directive from the government today at 5:21pm (ET). The letter did not provide specific details of its national security concern.”

    Anthropic, on the abruptness and opacity of the order

    “These vulnerabilities all appear relatively simple, and we have found that other publicly-available models are able to discover them as well without requiring a bypass.”

    Anthropic, on its review of the demonstrated jailbreak technique

    “We suspect that perfect jailbreak resistance is not currently possible for any model provider.”

    Anthropic, restating the position it disclosed at Fable 5’s launch

    “We stand by this defense in depth strategy. It reduces the risks posed by Fable, making them comparable to the risks of existing models already deployed across the industry.”

    Anthropic, defending its layered safeguards approach

    “To date, the government has only given us verbal evidence of a potential narrow, non-universal jailbreak, which essentially consists of asking the model to read a specific codebase and fix any software flaws.”

    Anthropic, describing the technique behind the directive

    “However, we disagree that the finding of a narrow potential jailbreak should be cause for recalling a commercial model deployed to hundreds of millions of people.”

    Anthropic, on complying while contesting the decision

    “If this standard was applied across the industry, we believe it would essentially halt all new model deployments for all frontier model providers.”

    Anthropic, on the industry-wide implications of the recall standard

    “As we have stated publicly, we believe the government should have the ability to block unsafe deployments, as part of a statutory process that is transparent, fair, clear, and grounded in technical facts. This action does not adhere to those principles.”

    Anthropic, on the kind of oversight process it says should have governed the action

    “We apologize for this disruption to our customers. We believe this is a misunderstanding and are working to restore access as soon as possible.”

    Anthropic, closing its statement to customers

    Read the full statement on Anthropic’s site here.

    Related Reading

  • Dario Amodei on Policy for the AI Exponential: Anthropic’s Plan for AI Regulation, Job Displacement, Civil Liberties, and Democratic Leadership

    In June 2026, Anthropic CEO Dario Amodei published “Policy on the AI Exponential”, a wide-ranging essay arguing that the gap between how fast AI is advancing and how slowly policy moves has become dangerous, and that the window to close it is open right now. He opens with a memorable image from The Lord of the Rings: the Hobbits trying to rouse Treebeard, the ancient tree who takes a full day just to say hello, to defend his forest before it is cut down. That mismatch in speed, he writes, is exactly the relationship between AI and our political institutions. This post breaks the essay down in full and adds analysis of where the argument lands.

    TLDR

    Amodei argues that AI’s scaling laws point toward “powerful AI,” a country of geniuses in a datacenter, within a few years, while legislation still moves on a timescale of years. For most of the last few years, safety advocates including Anthropic pushed only for optionality-preserving moves like transparency rules, chip export controls, and labor data collection, because the risks were not yet concrete. He says that has changed: events like Claude Mythos Preview proved frontier models are now tools of national strategic consequence, and the time for binding regulation has arrived. The essay covers five policy areas. First, regulation and public safety, where he proposes an FAA-style regime of mandatory third-party testing of frontier models above a compute threshold across four risks (cybersecurity, biological weapons, loss of control, and automated R&D), with government power to block unsafe deployments. Second, macroeconomics and tax policy, where AI could deliver hypergrowth and severe, enduring job displacement at the same time, demanding measurement, pro-employment incentives, and possibly UBI or universal capital accounts. Third, accelerating AI’s positive impact, where the danger is regulators like the FDA being too slow rather than too lax, and biomedical approval needs reform. Fourth, the state and civil liberties, where AI could become the ultimate tool of autocracy through autonomous weapons and mass surveillance, requiring new accountability rules, a domestic ban on autonomous weapons, closing the data broker loophole, and public rights to AI advice. Fifth, securing leadership by democracies through a values-based global coalition that controls the AI supply chain, coordinates on risk, shares benefits, and rejects AI-powered repression. He closes by rejecting the idea that public concern about AI is a PR problem to be marketed away, calling it democratic accountability working as it should.

    Thoughts

    The most important move in this essay is structural, not technical. Amodei is explicitly retiring the “preserve optionality” posture that defined Anthropic’s policy work through 2025 and replacing it with a call for binding rules. For years the argument from safety-minded labs was that the risks were too speculative to legislate against without doing more harm than good, an idea he grounds in the Collingridge dilemma and the Hayekian point that regulators lack the information to make good calls. That was a defensible hedge. What is striking here is the claim that the hedge has expired. He is saying the evidence is now concrete enough that continued caution about regulating has flipped from prudent to negligent. Whether you trust the underlying capability claims or not, that is a genuine change in position from one of the field’s most influential voices, and it deserves to be read as such.

    The FAA analogy is doing enormous work, and it is worth poking at. Airplanes and drugs are mature technologies with stable physics and decades of incident data; the certification regime works because the failure modes are well understood. Frontier models are the opposite: the whole premise of the essay is that capabilities are changing faster than anyone can characterize them. Amodei half-acknowledges this when he warns that a fixed list of safety requirements tends to consume 95 percent of compliance effort on things that turn out not to matter while missing the real risks, a lesson he says Anthropic learned from its own Responsible Scaling Policy. So the proposal is really for an agency nimble enough to rewrite its own standards continuously, which is a much taller order than the FAA. The honest read is that he is proposing a regulator we do not yet know how to build, and betting that building it is still better than the alternative.

    The economics section is where Amodei is most careful, and it is the part most likely to be misread. He goes out of his way to say enduring job displacement is undesirable and that warning about it is not the same as wanting it, a distinction critics of AI leaders often collapse. His real claim is subtle: that AI might jam the economic policy dial on a “hypergrowth, hyper-inequality” setting that is hard to unstick, because AI substitutes for human cognition broadly and faster than past technologies, potentially overwhelming the usual escape hatches like comparative advantage and Jevons paradox. If he is right, the political fight of the next decade is not about growth, which AI supplies, but about distribution, which it does not. His mention of UBI, universal capital accounts, and higher capital gains taxes is notable coming from a frontier CEO, even hedged as it is.

    The civil liberties section is the one that should travel furthest beyond the AI-policy bubble, because it does not depend on accepting his most aggressive timelines. The data broker loophole, the idea that the government can simply buy the bulk data Americans hand to private companies and run mass analysis on it, is a problem that exists today; AI just raises the stakes by making that data vastly more revealing. Same with the proposal that anyone facing adverse government action should have access to AI at least as capable as what the government uses against them. These are concrete, near-term, and bipartisan in a way the abstract autonomy debates are not. The most candid line in the whole piece is his admission that AI cannot be safely entrusted to either governments or companies, an unusually direct acknowledgment that his own industry needs external checks, with Anthropic’s Long-Term Benefit Trust offered as one imperfect example rather than a solution.

    The geopolitics section is the most contested terrain. Framing AI as a nuclear-scale reset of the game board, with a virtual country of 100 million geniuses divisible across military strategy and weapons R&D, leads naturally to a democratic coalition that hoards chips and denies them to adversaries. That logic is internally consistent, but it sits in tension with the benefit-sharing and “eventually the whole world joins” language elsewhere in the same section. Export controls that lock down the supply chain are, by design, a tool of exclusion, and reconciling that with broad diffusion of AI’s benefits to developing countries is the circle the coalition idea has to square. Amodei is clearly aware of the tension and bets that making membership attractive resolves it. The closing image is the one to remember: Treebeard waking up, with the warning that the goal is to channel real public concern into constructive policy rather than let it curdle into formless anger.

    Key Takeaways

    • The core tension of the essay is a mismatch in speed: AI advances exponentially while legislation moves on a multi-year timescale, dramatized by the Treebeard and Hobbits image from The Lord of the Rings.
    • In only four years, AI models went from barely writing a coherent line of code to writing most of the code at major AI companies, with similar gains across biology, physics, math, finance, law, and translation.
    • Scaling laws now have over a decade of empirical support, and if they continue another year or two they likely produce “powerful AI,” a country of geniuses in a datacenter.
    • For the last few years, safety advocates including Anthropic focused on optionality-preserving policies: transparency legislation, chip export controls, and data collection on AI’s labor effects.
    • Amodei argues that posture is no longer enough. Claude Mythos Preview revealed that frontier models pose real cybersecurity risks to the financial sector, critical infrastructure, and national security, and proved AI is now a tool of strategic consequence.
    • He expects biological risks to follow cyber risks, with serious AI autonomy risks potentially not far behind.
    • The essay covers five policy areas: regulation and public safety, macroeconomics and tax policy, accelerating AI’s positive impact, the state and civil liberties, and securing leadership by democracies.
    • Alongside the essay, Anthropic released a legislative proposal on frontier model testing and a policy framework for job displacement, both with promised financial backing.
    • On regulation, Amodei invokes the Collingridge dilemma and Hayek’s information problem to explain why pre-writing AI law in 2023 to 2024 was risky, then argues the situation has now changed.
    • Anthropic’s 2025 answer was transparency, helping pass SB 53 in California, RAISE in New York, and SB 315 in Illinois, plus advocating a federal transparency standard.
    • He now calls for binding regulation modeled on the FAA, where frontier models must pass technical testing and can have release blocked or reversed if they fail high safety standards.
    • Models above a compute threshold should face mandatory third-party testing in four areas: cybersecurity, biological weapons, loss of control of AI systems, and automated R&D that accelerates the other three.
    • Government should be able to block or deter deployment of models judged to present unacceptable risk, scoped to those four risks with protections against political favoritism.
    • Evaluation could come from a government agency or from authorized and inspected private organizations under a “regulatory markets” approach.
    • AI companies should have strong security to protect model weights, conduct regular red teaming and penetration testing, report safety incidents promptly, and work with government against major threat actors.
    • He warns a time may come when the most powerful systems resemble weaponizable nuclear materials rather than airplanes, requiring more aggressive measures, but cautions against getting ahead of present dangers.
    • On economics, AI could deliver extremely rapid growth via accelerated science and operational efficiency, supercharged by AI building better AI.
    • The same properties make AI a broad substitute for human cognition that changes the economy faster than past technologies, risking large and potentially enduring labor market disruption.
    • The feared outcome is a “hypergrowth, hyper-inequality” setting that is hard to unstick, where the challenge shifts from incentivizing growth to sharing its benefits.
    • Amodei is emphatic that enduring job displacement is undesirable and dangerous, and that he warns about it to help society adapt, not as a prophet of doom.
    • Anthropic says it works with customers to find new revenue and use cases rather than only cost cutting, and explores interaction paradigms that keep humans active alongside AI.
    • He predicts AI will enable single individuals to build billion-dollar companies, noting teams of a few people already reach hundreds of millions in revenue, while admitting significant enduring job loss may be intrinsic to the technology.
    • Any response must address both economic provision and the human need for meaning, purpose, and agency, with the latter ultimately more important and beyond what policy can directly deliver.
    • Suggested economic interventions: better measurement and tracking (governments expanding statistics beyond Anthropic’s Economic Index), pro-employment incentives, and long-term macroeconomic support.
    • Pro-employment ideas include wage insurance, retention tax incentives, workforce training grants, and employer-employee matching infrastructure.
    • If displacement is large and permanent, mechanisms like universal basic income or universal capital accounts, financed through company taxes or higher capital gains taxes, may be necessary.
    • He frames datacenter and energy-price backlash as largely a symbol of broader economic anxiety, and says AI companies should pay to absorb rate increases, a pledge Anthropic has already made.
    • For technologies accelerated by AI, the bigger risk is regulators like the FDA being too slow, not too lax, because AI may make downstream tech safer in ways that violate skeptical regulatory assumptions.
    • Biomedicine is the illustrative case: AI could flood the drug pipeline, raise effect sizes, treat previously untreatable diseases, and create whole new therapy categories, while the current FDA and EMA pipeline takes 7 to 8 years.
    • Agencies should pre-approve standards for AI methods like PD/PK modeling, toxicology prediction, dose selection, biomarker validation, synthetic control arms, and surrogate endpoints, plus more flexible accelerated-approval mechanisms.
    • On civil liberties, powerful AI in the wrong hands could be the ultimate tool of autocracy, and existing constitutional protections are not fully equipped to counter a surprise seizure of power.
    • Threats named include fully automated drone armies that obey unlawful orders and surveillance AI that infers the innermost details of every citizen’s life from widely available data.
    • Civil liberties proposals: accountability rules and an “off switch” for autonomous weapons, a domestic ban on fully autonomous weapons including in law enforcement, closing the data broker loophole, and public rights to AI advice during adverse government action.
    • Amodei warns companies as well as governments can seize quasi-state power, citing the Gilded Age and the East India Company, and says AI cannot be safely entrusted to either alone.
    • He offers Anthropic’s Long-Term Benefit Trust as one separation-of-power structure and urges the industry to explore mechanisms that go further.
    • On geopolitics, he argues AI resets the geopolitical game board like nuclear weapons, becoming the dominant source of military and economic power for any nation that holds it.
    • A nation with powerful AI versus one without it, or even one three years behind, could resemble WWII Marines facing medieval swordsmen.
    • He calls for a democratic coalition that shares chips and semiconductor manufacturing equipment internally while denying them to adversaries, citing MATCH and OVERWATCH as good first steps.
    • The coalition should coordinate risk policy, share benefits including harmonized medical approvals, provide mutual AI defense, reject AI-powered repression, and cooperate on macroeconomic stabilization.
    • He rejects the idea that AI’s image is a PR problem, arguing public concern reflects real risks and is democratic accountability working as it should, with the task being to channel it into constructive solutions.

    Detailed Summary

    The speed mismatch between AI and policy

    Amodei frames the entire essay around a single problem: AI advances at a lightning pace while policy, especially legislation, moves very slowly, often for good reasons since governments wield grave powers that should not be used hastily. He illustrates this with Treebeard, the sentient tree from The Lord of the Rings who takes a full day to say hello, as a stand-in for political institutions trying to respond to a technology that can go from amusing toy to a country of geniuses in the time it takes Congress to act. He recounts the dilemma responsible actors have faced: they could see where the exponential was headed, but to observers looking only at present capabilities, AI looked as mundane as the latest consumer app or cryptocurrency, making a laissez-faire attitude hard to argue against. The absence of AI’s radical effects, and uncertainty about their shape, made it genuinely difficult to design good policy even where the will existed.

    That uncertainty, he says, is why safety advocates limited themselves to optionality-preserving measures like transparency rules, export controls, and labor data collection. But over the last few months the evidence of AI’s power and risk has become undeniable, with Claude Mythos Preview as the emblematic example: it scrambled the global cybersecurity landscape and proved AI models are now tools of global and national strategic consequence. He expects biological and autonomy risks to follow, and argues the world must now activate its slow, rickety policy apparatus to handle risks that will compound quickly. He worries current early actions are at least a year out of step with AI’s progress, and presents the essay as an attempt to close that gap across five policy areas, focused on US policy but relevant worldwide.

    Regulation and public safety: an FAA for frontier models

    Amodei opens by acknowledging the real costs of regulation: it can reduce a product’s benefits, disincentivize innovation, and suffer from the Hayekian problem that regulators lack the information for good tradeoffs, plus the Collingridge dilemma that a technology’s impacts are hard to anticipate until it is too late to manage them. In 2023 to 2024 these dynamics argued against pre-writing AI law, since the exact form of biological or autonomy risk, how to test for it, and how it would play out were all unclear, creating a high risk of low-value compliance requirements that miss the real dangers. Anthropic’s answer was transparency: requiring developers to disclose safety procedures, tests, and critical incidents, which is why it supported SB 53 in California, RAISE in New York, and SB 315 in Illinois in early 2026.

    Now, he argues, the risks are clearly here and it is time for binding regulation. His analogy is to cars, airplanes, and drugs: powerful technologies essential to the economy but capable of killing many people if designed or operated poorly. He models AI regulation on the FAA, with frontier models required to pass testing and auditing and with release blocked or reversed if they fail high safety standards. His concrete proposal: mandatory third-party testing for models above a compute threshold across cybersecurity, biological weapons, loss of control, and accelerating automated R&D; government power to block deployment of unacceptably risky models, scoped narrowly with anti-favoritism protections; evaluation by either a government agency or authorized private organizations in a regulatory-markets model; strong weight security, red teaming, and penetration testing at AI companies; and prompt reporting of safety incidents. He notes a future may arrive when systems resemble weaponizable nuclear materials and demand harsher measures, but warns against designing for dangers that have not yet emerged.

    Macroeconomics and tax policy: growth and displacement together

    Here Amodei challenges the standard premise that growth is fragile and must be traded off against the drag of taxes or deficits to reduce inequality. Powerful AI, he suggests, may scramble that assumption by producing extremely rapid growth through accelerated science and efficiency, supercharged by AI building better AI, while simultaneously acting as a broad substitute for human cognition that reshapes the economy faster than any prior technology. The result could be a world stuck on a hypergrowth, hyper-inequality setting that is hard to unstick, where the central challenge is no longer incentivizing growth but sharing its benefits. He is careful to make two points clearly: first, enduring job displacement is undesirable and dangerous and should be minimized, and his warnings are meant to help society adapt, not to play prophet of doom; second, any response must address both economic provision and the deeper human need for meaning, purpose, and agency, which matters more and which policy cannot directly supply.

    His policy menu starts with measurement and tracking, arguing good policy is impossible without accurate data, and that governments could expand economic statistics well beyond Anthropic’s Economic Index. Next come pro-employment incentives such as wage insurance, retention tax incentives, workforce training grants, and employer-employee matching, costs he says society should readily accept since they are likely offset by AI productivity gains. If displacement proves large and permanent, he says long-term income support like universal basic income or universal capital accounts may be needed, financed through taxes on relevant companies or higher capital gains taxes. He closes the section by reframing datacenter and energy-price backlash as mostly a symbol of broader economic anxiety, while saying AI companies should absorb rate increases, as Anthropic has pledged.

    Accelerating AI’s positive impact: the slow-regulator problem

    For technologies accelerated by AI, rather than AI itself, Amodei flips his concern: the bigger danger is regulatory systems designed for a slower pace failing to handle the deluge of new products, and AI making downstream technologies safer in ways that violate the skeptical assumptions baked into agencies like the FDA. He focuses on biomedicine as the area likely to produce AI’s biggest humanitarian benefits and where regulation is especially complex. AI could greatly increase the rate of new drug candidates, improve their effect sizes and safety profiles, treat previously untreatable diseases, and create entirely new therapy categories the way antibodies, peptides, and cell therapies did.

    The current pipeline at the FDA and EMA takes 7 to 8 years, built on the pessimistic assumption that drug candidates usually fail and often carry safety problems even when they work. Without reform, AI will jam or overload that system. Amodei proposes that agencies develop standards now for accepting AI simulation and analysis, so they can be adopted quickly once proven rather than after years of unnecessary testing. Specific candidates include AI-based PD/PK modeling, toxicology prediction to reduce animal testing, more accurate dose selection, biomarker validation from large datasets, synthetic control arms, and surrogate endpoints (especially for aging and neurodegeneration). He urges more flexible accelerated-approval mechanisms generally, and notes biomedical acceleration may also reduce AI’s risks by aiding biodefense and improving mental health.

    The state and civil liberties: guarding against AI-driven tyranny

    Amodei frames the perennial balance between state power and individual liberty, enforced through machinery like the First, Fourth, and Fifth Amendments, the Posse Comitatus Act, and FISA, and argues AI threatens to upset that balance while raising its stakes. Powerful AI in the wrong hands could be the ultimate tool of autocracy, because the enormous returns to intelligence combined with AI’s pace create a perfect storm for a surprise seizure of power. The danger could take many forms but shares one feature: AI conferring sudden power while routing around democratic oversight. He cites a fully automated drone army that could obey unlawful orders, where trained humans might object, and a surveillance AI that analyzes widely available information at massive scale to infer the innermost details of every citizen’s life, an ability current civil liberties law never contemplated.

    His proposals: create accountability rules for autonomous weapons so they respond to court orders, legislation, and human overseers rather than blindly following orders, possibly with a judicial finger on an off switch; ban domestic use of fully autonomous weapons, including in law enforcement, while allowing them against foreign adversaries; close the bulk-collection and data-broker loophole that lets the government buy and analyze data Americans share with private companies; and guarantee public rights to AI advice at least as capable as what the government uses during adverse action, as an extension of the Administrative Procedure Act, due process, or the Sixth Amendment. He closes by warning that companies, not just governments, can capture the state, citing the Gilded Age and East India Company, and argues AI cannot be safely entrusted to either alone. Anthropic’s Long-Term Benefit Trust is offered as one accountability structure, with a call for the industry to go further.

    Securing leadership by democracies: a values-based coalition

    Amodei rejects treating AI as a mere instrument of trade policy to diffuse a tech stack worldwide. He believes AI resets the entire geopolitical game board like nuclear weapons, potentially even more so, becoming the dominant source of military and economic power for whoever holds it. In a virtual country of 100 million geniuses, millions could be assigned to military strategy, drone manufacture, weapons R&D, intelligence, and scientific advancement at once, so a nation with powerful AI facing one without it, or even three years behind, could be like WWII Marines against medieval swordsmen. Because powerful AI also enables deeper autocratic repression, it matters enormously that the world’s strongest nations are democracies.

    His answer is a global coalition built on shared democratic values that draws in the rest of the world by making membership increasingly attractive and exclusion increasingly costly. Operating principles include managing the AI supply chain by sharing chips and semiconductor manufacturing equipment within the coalition while denying them to adversaries, expanding and tightening export controls (he cites MATCH and OVERWATCH as good first steps); coordinating on biological, cyber, and autonomy risk to make compliance compatible and effective; sharing AI’s benefits including harmonized medical approvals; mutual defense through collective AI cyberdefense, drones, manufacturing, compute, and intelligence; rejection of AI-powered repression; and macroeconomic cooperation against contagious employment crises. The coalition would respect each nation’s sovereignty, start with aligned democracies, and grow iteratively, ideally toward the whole world, but at minimum positioning democracies to contain and outcompete repressive regimes.

    A window of opportunity

    Amodei closes on cautious optimism. The same exponential that strains policymaking has created a unique opening: clear evidence of AI’s risks, an early taste of its value and disruption, and public backlash against unregulated approaches have left policymakers unusually open to forward-looking action. Treebeard and his forest are waking up. He firmly rejects the industry-circle view that this is a PR problem solved by better marketing, arguing people are worried because the risks are real, and that public concern in response to transparency is democratic accountability working as it should. The key challenge is focusing that concern into constructive solutions rather than letting it descend into formless anger and violence. He is optimistic because issues from job displacement to model testing to export controls have common-sense appeal across the political spectrum, and a broad nonpartisan coalition could adopt sane, forward-looking policy faster than usual.

    Notable Quotes

    “in only four years, AI models have gone from barely being able to write a coherent line of code to writing most of the code at major AI companies.”

    Dario Amodei, on the pace of the AI exponential

    “in the several years that it can take Congress to act, AI can go from an amusing toy to the full country of geniuses.”

    Dario Amodei, on the mismatch between AI’s speed and the speed of legislation

    “However, now the risks are clearly here. It is time to go beyond transparency to more serious and binding regulation of AI.”

    Dario Amodei, marking the shift from transparency to binding rules

    “enduring job displacement is undesirable and dangerous, and we should do everything we can to minimize or prevent it, not to bring it about.”

    Dario Amodei, clarifying his stance on AI and jobs

    “The key challenge in such a world won’t be incentivizing growth, but finding a way for everyone to share in the benefits.”

    Dario Amodei, on a hypergrowth, hyper-inequality economy

    “Powerful AI in the wrong hands could be the ultimate tool of autocracy, and our existing legal and constitutional protections are not fully equipped to counter this threat.”

    Dario Amodei, on AI and civil liberties

    “A nation that possesses powerful AI facing one without it … could be the equivalent of an army of World War II Marines facing an army of medieval swordsmen.”

    Dario Amodei, on AI as the dominant source of geopolitical power

    “People are worried about AI because they correctly perceive that its risks are real, not because AI CEOs have been insufficiently Panglossian.”

    Dario Amodei, rejecting the idea that AI has a PR problem

    “Treebeard and his forest are waking up.”

    Dario Amodei, on policymakers’ new openness to acting on AI

    “Policy on the AI Exponential” is a dense, structured argument from one of the most consequential figures in the field, and it rewards a full read in the original. The summary and analysis above are a guide, not a substitute. You can read the full essay here.

    Related Reading

  • Bill Gurley on Mental Models, Systems Thinking, AI Investing, Stablecoins, and the Future of Venture Capital

    Bill Gurley spent his career at Benchmark backing some of the most consequential marketplaces and network-effect businesses of the internet era, including Uber, and he is one of the few investors who pairs deep Wall Street fundamentals with a real feel for the bleeding edge. In this wide-ranging conversation on Shane Parrish’s The Knowledge Project, he lays out the mental models he keeps returning to, how systems thinking keeps you out of trouble, why the history of your field is a hidden superpower, where AI investing is headed, and how stablecoins and tokenization could quietly rewire finance. It is a masterclass in thinking clearly about complex systems while staying obsessively curious about what is happening on the edge.

    TLDW

    Gurley anchors his thinking in systems thinking and complexity theory, warning that multivariable nonlinear systems produce second and third order consequences that punish anyone who optimizes for a single metric. He argues that mastering both the deep history of your field and its newest edge is wildly differentiating, whether you are interviewing for a marketing job or breaking into venture capital. On AI he is measured: he doubts a single model eats every vertical, sees real moats in workflows and proprietary data, flags that we may be painting in the corners on training data, and explains why Chinese open source models may innovate faster because forced knowledge sharing compounds. He thinks the AI buildout looks overfunded and that circular deals both raise the odds of an eventual correction and delay it. He makes the case that the IPO process is a rigged power grab, that stablecoins and instant payments threaten Visa, Mastercard, and the entire 2 to 3 percent credit card stack, and that proxy advisors like ISS have drifted from shareholder interest into a black-box heist. He closes on the craft of storytelling and writing as thinking, the equal-partnership design of Benchmark, why venture bends toward youth, and what success means now that his dream job is behind him.

    Thoughts

    The most useful idea in this conversation is also the quietest one: most bad decisions are not bad in the moment, they are bad in the second derivative. Gurley’s dating-site story, where lengthening profiles raised engagement in the test and then quietly killed conversion months later, is the whole argument in miniature. A linear model would have shipped that change and called it a win. A systems thinker assumes the variable you optimized is connected to three others you cannot see yet, and waits to find out. That posture, refusing to get deterministic about a single metric, is the difference between a clever experiment and a durable business. It is also the most transferable thing in the episode, because it applies to product changes, hiring, policy, and your own career just as cleanly as it applies to a dating app.

    His pairing of old and new is the second idea worth stealing. Everyone in tech tells you to live on the edge, and Gurley agrees, he keeps five premium AI accounts running so he never misses a release. But he insists the edge is only half of it. Knowing the deep history of your field, the masters of marketing, the forefathers of physics, the classic cartoons that taught animation, is rare enough that it instantly creates contrast and signals genuine passion. The compounding move is to hold both at once. If you understand the legends and you actually get TikTok, you are a power player in a way that someone who only knows one end of the timeline can never be. Most people pick a side. The leverage is in refusing to.

    On AI specifically, Gurley is refreshingly unwilling to pick the consensus lane in either direction. He does not buy that one near-sentient model swallows every vertical, and his reasoning is grounded rather than vibes-based: workflows and proprietary data create real switching costs, which is why he watches the legal AI startups ingesting case law and building new databases rather than assuming everyone reverts to a general chatbot. At the same time he respects the Microsoft pattern of platforms climbing the stack and crushing the apps above them. The honest answer is that it is genuinely up for grabs, and his comfort sitting in that uncertainty is itself a model. The cheap takes are “one model to rule them all” and “it is all wrappers.” Gurley holds both possibilities and keeps testing.

    The systems lens does its best work on China. Rather than moralize, Gurley runs the mechanism: roughly ten open source models, intense domestic competition, and a culture of publishing techniques and weights so every model can learn from, train, and test every other model. His two-farmer metaphor, one market where farmers only trade goods and another where they are forced to share best practices, makes the prediction obvious. Forced knowledge sharing compounds faster than secrecy. The uncomfortable corollary he names is that American startups are quietly forking those open models all over Silicon Valley, and that incumbents may be lobbying for heavy regulation precisely because it pulls up the drawbridge against open source competition. That is the systems thinker’s signature move: follow the incentives to the consequence nobody is saying out loud.

    Finally, the money section is a clinic in spotting rent extraction. The IPO process where bankers pick both the price and the favored buyers, the 2 to 3 percent credit card toll that exists for no defensible reason while the rest of the world built instant bank transfer decades ago, and the proxy advisors who score companies in a black box and then sell you the cure, are all variations on the same pattern: an intermediary that captured a choke point and defends it through regulatory capture rather than value. Gurley’s optimism is that crypto rails, stablecoins, and tokenization may finally route around these tolls the way WeChat Pay and Alipay leapfrogged cards in China. Whether or not you agree on the timeline, the analytical habit is the takeaway. When something costs far more than it should and has for decades, ask who captured the rules, and watch the edge for whoever is about to make those rules irrelevant.

    Key Takeaways

    • Systems thinking means treating the world as multivariable nonlinear systems where one variable flipping can change the entire system’s behavior, the way weather and stock markets do.
    • The real danger is second and third derivative effects, consequences that only show up much later, long after the metric you optimized looked like a win.
    • A dating site lengthened profiles because longer profiles tested as more engaging, then discovered months later it was negative for conversion, the textbook second order trap.
    • Never get too deterministic about a single metric or single variable, and always know what is actually important and what sits on top.
    • Gurley built his foundation on the canon: Peter Lynch’s One Up on Wall Street, A Random Walk Down Wall Street, the Buffett letters, Ben Graham, and Howard Marks.
    • A firm grasp of the financial bedrock is what lets you innovate on top of it, and many Silicon Valley VCs would benefit from understanding finance better.
    • Bill Miller reframed value investing as buying an asset that is underpriced relative to what you think it will be worth in the future, which is how he justified holding Amazon for its network effects.
    • Wall Street is the buyer of the product that venture capitalists create, so even at the two-people-in-a-PowerPoint stage you should ask whether the eventual public market will be excited by it.
    • Trajectory matters more than the starting place, because the trajectory is where the company actually ends up.
    • Knowing the deep history of your field is remarkably differentiating, and tedium while learning it is a signal you are in the wrong lane.
    • John Lasseter served Gurley a ten-course meal where each course was tied to a classic cartoon essential to understanding animation, a display of mastery over the history of the craft.
    • Magnus Carlsen won a trivia contest on the history of chess, and Picasso was a wildly successful realist painter by 14, both proof that the greats master the fundamentals first.
    • Obsessive, constant learning is the trait Gurley sees most in great entrepreneurs, because disruption always happens on a moving edge they need to understand at the top one percentile.
    • The compounding advantage is mastering both the old history and the new edge at once, the way understanding both marketing legends and TikTok would set you apart in any interview.
    • Most people underestimate how much AI can do, so push more of the downstream work into the prompt: identify the top ten, list pros and cons, rank them on one dimension, then another, and add up the numbers too.
    • Gurley uses ChatGPT for project structure and memory, Gemini for restaurant research powered by Google review data, and notes that coders swear by Claude while some prefer Perplexity for finance.
    • He doubts one model dominates everything; verticals like coding already let users swap models, and price optimization will push more swapping over the next few years.
    • Heavy, expensive regulation could ironically create oligopoly, and some players may be quietly begging for regulation because it pulls up the bridge against Chinese open source models.
    • China’s roughly ten open source models compete intensely and share weights and techniques, creating a system that can innovate faster, like farmers forced to share best practices instead of just trading goods.
    • A quiet secret is that startups all over Silicon Valley are forking those Chinese open source models at real volume.
    • Gurley comes down against the idea that one near-sentient model removes the need for vertical models; workflows and proprietary data, like legal startups ingesting all the case law, create durable moats.
    • We may be running out of training data, painting in the corners, which is why one of the most powerful improvements is hiring experts at thousands of dollars an hour to fine-tune the models.
    • Yann LeCun’s view is that the next leap is broader than LLMs, since language-based models hit an asymptote and are weak at math and numbers.
    • AlphaGo’s shocking move proves models can innovate beyond their training, but it lived in a constrained game; the real world has infinite paths a computer cannot exhaustively search.
    • Gurley’s non-consensus view is skepticism of the China vilification mindset, noting the US is only 3 to 5 percent of the global population and wondering how the other 95 percent hears American exceptionalism.
    • The AI buildout looks overfunded: the Magnificent Seven took free cash flow from 50 to 100 billion a year down toward zero by pouring it into capex.
    • The venture community has become more risk-seeking because it now deeply believes in increasing returns and power laws, and the pre-profit losses keep scaling, from Amazon’s 2 to 3 billion to Uber’s 15 billion to far more now.
    • Circular deals, where a cloud provider funds a model company that spends the money right back on its services, inflate growth, which both raises the probability of an eventual correction and extends the time before one hits.
    • Burn rate is a measure of risk; ten years ago a million a month was scary, now companies burn five billion a year and cannot really know their unit economics.
    • Tokenization without financial-disclosure regulation invites speculation and manipulation, which is part of why companies like Stripe stay private and negotiate liquidity prices with trusted investors.
    • The IPO process is unfair because bankers pick both the price and the shareholders; a freshman would simply match supply and demand anonymously in an auction, the way direct listings and ICOs do.
    • Stablecoins threaten the 2 to 3 percent credit card stack; USDC holds dollar-for-dollar Treasuries and rides fast global crypto rails, while US transfers still suffer three-day ACH settlement and 25 dollar wires.
    • The rest of the world built instant transfer long ago, from UK Faster Payments 20 years ago to Argentina’s PIX-style system reaching 60 to 70 percent of transactions, while US bank regulatory capture stalled Fed Now.
    • Visa and Mastercard run roughly 60 percent operating margins as a bank-created duopoly, and China leapfrogged them entirely with WeChat Pay and Alipay QR-code wallets.
    • Moody’s power is being the trusted standard, the watermark, so AI on the back end does not displace it; ISS and proxy advisors, by contrast, score companies in a black box and get paid on both sides.
    • Proxy advisors drifted from shareholder interest into a fraud-and-risk-mitigation mindset, which is why they reflexively opposed the Tesla pay package that only paid out if the stock soared.
    • The rise of passive index funds concentrated voting power in firms that lack time to evaluate votes; it would be healthier if they abstained or voted in proportion to active holders.
    • Storytelling is one of the top founder traits, because founders are recruiting, raising money, and closing customers and partners constantly, selling all the time.
    • Writing is thinking: Bezos’s six-page memo forces you to find the loose ends and tie them up, and a public blog becomes a calling card that magnetizes founders and deal flow.
    • Other founder unfair advantages are product instincts, which fewer than 5 percent of non-product people ever truly learn, and sheer determination, Bezos’s single angel-investing test of whether someone will do it no matter what.
    • Uber had no HBS case study to lean on; its winner-take-all network effects forced mega burn rates with no precedent and no mentor to call, a situation every AI company now faces.
    • Benchmark’s equal partnership, with no king, president, or lead and five equal partners, makes recruiting easy, kills comp politics, and aligns everyone, at the cost of being hard to scale or run new initiatives.
    • Venture bends toward youth because young investors can match founders’ age, master a fresh niche faster, and have the free time to study something 80 hours a week.
    • Gurley defines current success through Arthur Brooks’s From Strength to Strength, hoping to apply his synthesizing and writing skills to bigger societal problems and dent the universe a little.

    Detailed Summary

    Systems Thinking and Second Order Effects

    Gurley opens with the mental model he keeps returning to: systems thinking, shaped by Donella Meadows’s Thinking in Systems and his board seat at the Santa Fe Institute, which studies complexity theory. He describes complex systems as multivariable nonlinear systems that are very hard to predict, capable of behaving one way for a long time until a single variable flips and the whole system behaves differently, like weather or stock markets. The practical payoff is staying out of trouble by anticipating first, second, and third derivative consequences. His clearest example is a large dating site that lengthened user profiles because the test showed more engagement, only to learn many months later that knowing more at that stage was negative for conversion. The lesson is to never get too deterministic about a single metric and to keep the whole system in view, because a change here can ripple to there in ways you only discover much later.

    Learning the Craft of Investing

    Because he started on Wall Street rather than in venture, Gurley absorbed the investing canon first: Peter Lynch’s One Up on Wall Street, A Random Walk Down Wall Street, the Buffett letters, Ben Graham, and Howard Marks, people who spent careers assembling and publishing their thinking. That financial bedrock, he argues, is exactly what lets you innovate on top of it. His friend Michael Mauboussin introduced him to Bill Miller, the Legg Mason manager who beat the S&P for 15 straight years and was Amazon’s largest shareholder for a long stretch. Miller reframed value investing as buying an asset underpriced relative to its future worth, which combined with a belief in network effects justified holding a company that could grow at an unreasonable rate for years. Gurley also frames Wall Street as the buyer of the product venture capitalists create through eventual M&A or IPO, so founders should think early about whether the public market will be excited by what they are building, since trajectory matters more than the starting place.

    Mastering Both the History and the Edge

    Gurley makes an unusually strong case for studying the deep history of your field. He recounts a dinner with Pixar’s John Lasseter, who served a ten-course meal where every course was tied to a classic cartoon he considered essential to understanding animation, and notes that Magnus Carlsen won a chess-history trivia contest and Picasso was a master realist by 14. In a world that skims for the executive summary, walking into a marketing interview with command of the masters of marketing is wildly differentiating and signals genuine passion; if learning that history feels tedious, you are probably in the wrong lane. The counterpart trait he sees in great entrepreneurs is obsessive learning on the moving edge, where disruption actually happens. Gurley keeps five premium AI accounts so he never misses something. The real power player holds both at once, the legends and the newest thing, the way a candidate who knows the marketing greats and truly gets TikTok stands out completely.

    Using AI Well and the Model Wars

    People underestimate how much AI can do, Gurley says, so you should build more of the downstream work into the prompt: instead of asking for the top ten and studying them yourself, ask it to list pros and cons, rank on one dimension, rank again on another, and add up the numbers too. He uses ChatGPT for its project structure and memory, leans on Gemini for restaurant research because it carries Google review data, and notes coders swear by Claude while some prefer Perplexity for finance. On whether one model dominates or models become niche commodities, he points to coding, the largest vertical, where tools like Cursor already let users swap models, and predicts price optimization will drive more swapping. The counterforce is regulation: if it gets expensive and mundane it could create oligopoly, and some players may be quietly begging for it because it pulls up the bridge against Chinese open source models.

    China, Open Source, and the Systems Advantage

    Asked to apply systems thinking to China, Gurley describes roughly ten open source models locked in intense domestic competition, all learning from one another because the ecosystem chose openness, with models able to train and test other models and teams publishing the techniques behind their breakthroughs. His metaphor: two agricultural societies, one where farmers only trade goods at market and another where they are forced to share best practices; the second evolves far faster. The result is a system capable of innovating faster than the more secretive Western approach. The quiet secret he names is that startups all over Silicon Valley are forking those open models at real volume, and a key open question is whether regulation tries to stomp that out. He extends this into a broader non-consensus discomfort with the vilification of China common in Washington and parts of Silicon Valley, observing that the US is only a few percent of the global population.

    AI Investing, Moats, and the Limits of Models

    On how AI changes investing and whether a startup is just a wrapper, Gurley calls it up for grabs but lands on the side of durable verticals. If models become near-sentient, one model does everything; he doubts that, pointing to workflows and data moats, like the several legal AI startups ingesting all the case law and building new databases that customers will not simply swap for a general chatbot. He balances this against the Microsoft pattern of platforms climbing the stack past Lotus 1-2-3 and WordPerfect. He also flags scaling limits: we may be running out of data, painting in the corners, which is why one of the most powerful improvements is paying experts thousands of dollars an hour to fine-tune models, though human knowledge has an edge. He invokes Yann LeCun’s argument that the next leap is broader than language-based LLMs, which hit an asymptote and struggle with math, and the AlphaGo debate, where a shocking innovative move proves creativity within a constrained game but says little about the infinite paths of the real world. He notes AlphaGo and Tesla’s FSD are constrained, non-LLM systems.

    Is the Buildout Overfunded

    Gurley admits he is shocked by the scale of money, noting the Magnificent Seven drove free cash flow from 50 to 100 billion a year down toward zero by spending it all on capex, something he would not have believed five years ago. He traces it to the venture community’s growing conviction in increasing returns and power laws, where proven companies grow far beyond expectations, which makes investors more willing to take risk on the come. The losses before turning cash-flow positive keep scaling, from Amazon’s 2 to 3 billion to Uber’s roughly 15 billion to far larger now. On corrections, he recalls the dot-com crash producing a three to four year nuclear winter before Amazon climbed back, and explains that circular deals, where a cloud provider funds a model company that spends it right back on its services, inflate growth and therefore both raise the probability of a correction and extend the runway before one arrives. Burn rate, he stresses, is a measure of risk, and at five billion a year it is nearly impossible to know your unit economics.

    Tokenization, the IPO Heist, and Going Public

    There is no shortage of capital, so funding is not the bottleneck; the risk with tokenization is that, absent disclosure regulation, it invites speculation and manipulation, as seen in retail-loved names like GameStop and Palantir. Tokenizing a private company like Stripe could create the wild price swings companies stay private to avoid, since private liquidity events let them negotiate a price with trusted investors rather than expose the constantly moving underlying value, and Robinhood’s tokenization plans already drew legal pushback. Gurley reserves his sharpest critique for the IPO process, calling it insanely unfair because bankers pick both the price and the favored shareholders. A freshman computer science and finance student would simply match supply and demand anonymously in an auction, the way an ICO or a direct listing does, but Wall Street will not let go of the greedy power grab and reverted to a controlled oligopoly after direct listings were available.

    Stablecoins Versus the Payment Cartel

    Gurley argues stablecoins could be deeply disruptive to credit cards. Most of the developed world built instant bank-to-bank transfer long ago, from UK Faster Payments 20 years ago to Argentina’s PIX-style system that quickly hit 60 to 70 percent of transactions, while US bank regulatory capture stalled Fed Now and left an ecosystem living under 2 to 2.5 percent card fees. A USDC stablecoin holds dollar-for-dollar US Treasuries and rides proven, fast, global crypto rails, letting anyone move a dollar in seconds for pennies, against the backdrop of three-day ACH settlement and 25 dollar wires. He sees Visa and Mastercard, a bank-created duopoly with roughly 60 percent operating margins, as heavily threatened, and points to China, where WeChat Pay and Alipay built ubiquitous QR-code wallets that leapfrogged the entire card system, all because the government made money transfer easy.

    Moody’s, Proxy Advisors, and Index Funds

    Moody’s power, Gurley explains, comes from being a trusted standard, the watermark, so even AI on the back end does not displace it. Proxy advisors like ISS are a different story: they score companies in a black box, refuse to reveal the criteria, and then get paid by the same companies that want to learn how to score better, which he calls more of a heist than a service. They drifted from a shareholder-interest mandate into a corporate-governance, fraud-mitigation posture obsessed with rules, which is why they reflexively opposed the Tesla pay package that only paid Elon Musk if the stock soared, a deal Gurley says he would sign for every company he has worked with. The rise of passive index funds compounds the problem, concentrating voting power in firms without time to evaluate votes; he would prefer they abstain or vote in proportion to active holders, since closet indexing during the MAG 7 run already distorted active management.

    Storytelling, Writing, and Founder Advantages

    Gurley fell in love with the craft of writing in business school, moving from business books to personal development titles like Dale Carnegie and Seven Habits, then biographies, then long-form narrative nonfiction by Malcolm Gladwell, Michael Lewis, and Jon Krakauer, the New Journalism that reads like fiction. Writing forces clarity: he cites Bezos’s six-page memo as a tool that makes you think through corner cases and tie up loose ends, and notes that codifying his marketplace knowledge and publishing it turned his blog into a calling card that magnetized founders and deal flow. He lists the top founder traits as storytelling, product instincts, understanding the edge, and determination. Storytelling matters because founders are constantly recruiting, fundraising, and closing customers and partners. Product instinct is nearly unteachable, present in well under 5 percent of non-product hires. And determination is Bezos’s single angel-investing test: will this person do it no matter what, come hell or high water.

    Uber, Benchmark, and the Shape of Venture

    The Uber lesson with no HBS case study was that a winner-take-all category with network effects demanded funding ad nauseam, producing burn rates bigger than any public company would dare, with no precedent and no mentor to call, exactly the situation AI companies now face, only with a zero added. Gurley credits Benchmark’s design, an equal partnership with no king, president, or lead and five equal partners, for making it easy to recruit top talent, encouraging senior partners to develop newcomers since everyone shares the upside, and eliminating annual comp politics. The downside is that without a CEO it is hard to scale or run new initiatives, famously captured by the firm settling on a single splash-page website. Founders choose a VC for reputation and network effects, the stamp of approval that carries weight, and young investors can break in because they often match founders’ age and can outwork everyone to master a fresh niche like esports or YouTube, which is why the industry bends toward youth. Asked what success means now, Gurley says his venture career was a dream job he would have done for free, but it is done; inspired by Arthur Brooks’s From Strength to Strength, he wants to apply his synthesizing and writing to bigger societal problems and dent the universe a little.

    Notable Quotes

    “We do live in a world where information is really cut up, but we also live in a world where you can have access to more information than you ever could.”

    Bill Gurley, on why the abundance of knowledge rewards the curious

    “You got to be really conscious of the consequence and not get too deterministic about a single metric or a single variable.”

    Bill Gurley, on the discipline of systems thinking

    “Value just means that the asset is underpriced relative to what you think it will be worth in the future.”

    Bill Gurley, relaying Bill Miller’s reframing of value investing

    “I’ve always thought of Wall Street as the buyer of the product that venture capitalists create.”

    Bill Gurley, on why founders should think about the public market early

    “One society, when the farmers come to market, they just sell each other goods and then they go back. The other society, when the farmers come to market, they’re forced to share best practices. Which one is going to evolve faster?”

    Bill Gurley, on why open source models can out-innovate

    “If you took a freshman computer science student and a freshman finance student and said imagine how a company should go public, they would match supply and demand anonymously like you would in any auction.”

    Bill Gurley, on the rigged IPO process

    “When I meet an entrepreneur, there’s only one thing I ask myself. Is this person gonna do this no matter what? Come hell or high water, they’re doing this.”

    Bill Gurley, quoting Jeff Bezos on his single test for angel investing

    “You’re recruiting employees, you’re recruiting executives, you’re raising money, you’re closing customers, you’re closing partnerships. You’re selling all the damn time.”

    Bill Gurley, on why storytelling is a top founder trait

    “I often said that if we lived in a socialist society and everyone had to work for free, I would still take that job.”

    Bill Gurley, on loving his venture career

    “I would like to see if I can apply those techniques to bigger, broader problems in society and dent the universe a little bit that way.”

    Bill Gurley, on what success looks like in his next chapter

    Watch the full conversation with Bill Gurley on The Knowledge Project here.

    Related Reading

  • Krishna Rao on Anthropic Going From 9 Billion to 30 Billion ARR in One Quarter and the Compute Strategy Powering Claude

    Krishna Rao, Chief Financial Officer of Anthropic, sat down with Patrick O’Shaughnessy on Invest Like the Best for one of the most detailed public looks yet at the operating engine behind Claude. He covers how Anthropic compounded from $9 billion of run rate revenue at the start of the year to north of $30 billion by the end of Q1, why he spends 30 to 40 percent of his time on compute, the playbook for buying gigawatts of AI infrastructure across Trainium, TPU, and GPU platforms, how Anthropic prices its models, why returns to frontier intelligence keep climbing, and what the Mythos release tells us about the cyber capabilities of the next generation of Claude.

    TLDW

    Anthropic is running the most compute fungible frontier lab in the world, with active deployments across AWS Trainium, Google TPU, and Nvidia GPU, and an internal orchestration layer that lets a chip serve inference in the morning and run reinforcement learning the same evening. Krishna Rao explains the cone of uncertainty that governs gigawatt scale compute procurement, the floor Anthropic refuses to drop below on model development compute, the Jevons paradox unlock from cutting Opus pricing, the 500 percent annualized net dollar retention from enterprise customers, the layer cake of long term deals with Google, Broadcom, Amazon, and the recent xAI Colossus tie up in Memphis, the phased release of the Mythos model in response to spiking cyber capabilities, the internal use of Claude Code to produce statutory financial statements and run a Monthly Financial Review skill, and why the team believes scaling laws are alive and well. The interview also covers fundraising history through Series D and Series E, the $75 billion already raised plus another $50 billion coming, talent density beating talent mass during the Meta poaching wave, and Rao’s belief that biotech and drug discovery represent the most exciting frontier for AI.

    Key Takeaways

    • Anthropic entered the year with about $9 billion of run rate revenue and ended the first quarter with north of $30 billion of run rate revenue, a more than 3x leap driven by model intelligence gains and the products built around them.
    • Compute is described as the lifeblood of the company, the canvas everything else is built on, and the most consequential class of decisions Rao makes. Buy too much and you go bankrupt. Buy too little and you cannot serve customers or stay at the frontier.
    • Rao spends 30 to 40 percent of his time on compute, even today, and the leadership team meets repeatedly on both procurement and ongoing compute allocation.
    • Anthropic is the only frontier language lab actively using all three major chip platforms in production: AWS Trainium, Google TPU, and Nvidia GPU. It is also the only major model available on all three clouds.
    • Flexibility is the central design principle. Anthropic builds flexibility into the deals themselves, into the orchestration layer that maps workloads to chips, and into compilers built from the chip level up.
    • The cone of uncertainty frames procurement. Small differences in weekly or monthly growth compound into wildly different two year outcomes, so the team plans across a range of scenarios rather than a single point estimate, and ranges toward the upper end while protecting downside.
    • Compute allocation across the company sits in three buckets: model development and research, internal employee acceleration, and external customer serving. A non negotiable floor protects model development even when customer demand is tight.
    • Anthropic estimates that if it cut off internal employee use of its own models, the freed compute could serve billions of dollars of additional revenue. It chooses not to, because internal use compounds into better future models.
    • Intelligence is multi dimensional, not a single IQ score. Anthropic measures real world capability through customer feedback, long horizon task performance, tool use, computer use, and speed at agentic tasks, not just leaderboard benchmarks that have largely saturated.
    • Each Opus generation, 4 to 4.5 to 4.6 to 4.7, delivers both capability improvements and an efficiency multiplier on token processing. New models often serve customers at a fraction of the prior cost while doing more.
    • Reinforcement learning is described as inference inside a sandbox with a reward function, so model efficiency gains directly improve internal RL throughput. The flywheel is tightly coupled.
    • Over 90 percent of code at Anthropic is now written by Claude Code, and a large share of Claude Code itself is written by Claude Code.
    • Anthropic shipped roughly 30 distinct product and feature releases in January and the pace has accelerated since.
    • Scaling laws, in Anthropic’s internal data, are alive and well. The team holds itself to a skeptical scientific standard and still does not see them slowing down.
    • Anthropic recently signed a 5 gigawatt deal with Google and Broadcom for TPUs starting in 2027, plus an Amazon Trainium agreement for up to 5 gigawatts, totaling more than $100 billion in commitments. A significant portion lands this year and next year.
    • A new partnership for capacity at the xAI Colossus facility in Memphis was announced just before the interview, aimed at expanding consumer and prosumer capacity.
    • Pricing has been remarkably stable across Haiku, Sonnet, and Opus. The biggest deliberate change was lowering Opus pricing, which produced a textbook Jevons paradox: consumption rose far faster than the price drop, and the new Opus 4.6 and 4.7 slot in at the same price point.
    • Mythos is the first model Anthropic chose to release in a phased way because of a sharp spike in cyber capability. In an open source codebase where a prior model found 22 security vulnerabilities, Mythos found roughly 250.
    • The Mythos release framework focuses on defensive use first, expands access over time, and is presented as a template for future capability spikes.
    • Anthropic now sells to 9 of the Fortune 10 and reports net dollar retention above 500 percent on an annualized basis. These are not pilots. Rao describes signing two double digit million dollar commitments during a 20 minute Uber ride to the studio.
    • The platform strategy is mostly horizontal. Anthropic will go vertical with offerings like Claude for Financial Services, Claude for Life Sciences, and Claude Security where it can demonstrate the model’s capabilities, but expects most application value to accrue to customers building on top.
    • Investors raised over $75 billion in equity since Rao joined, with another $50 billion in commitments tied to the Amazon and Google deals. Capital intensity is real, but the raises fund the upper end of the cone of uncertainty more than they fund current losses.
    • The Series E close coincided with the day the DeepSeek news broke, forcing investors to reassess their AI thesis in real time. Anthropic closed the round anyway.
    • Inside finance, Claude now produces statutory financial statements for every Anthropic legal entity, with a human checker. A library of more than 70 finance specific skills underpins workflows.
    • A custom Monthly Financial Review skill produces a 90 to 95 percent ready monthly close report, so leadership discussion shifts from reconciling numbers to debating implications.
    • An internal real time analytics platform called Anthrop Stats compresses weekly insight cycles from hours to about 30 minutes.
    • The biggest token user inside Anthropic’s finance team is the head of tax, focused on tax policy engines and workflow automation. The most senior people, not the youngest, are leading internal adoption.
    • Talent density beats talent mass. When Meta and others ran aggressive offer waves, Anthropic lost two people while peer labs lost dozens.
    • All seven Anthropic co founders remain at the company, as does most of the first 20 to 30 employees, which Rao credits to a collaborative, transparent, debate friendly culture and a real culture interview that can veto otherwise top tier candidates.
    • Dario Amodei holds an open all hands every two weeks, writes a short prepared document, and takes unscripted questions from anyone at the company.
    • AI safety investments in interpretability and alignment have a commercial side effect. Looking inside the model helps Anthropic build better models, and enterprises selling sensitive workloads want to trust the lab they hand customer data to.
    • Anthropic explicitly identifies as America first in its approach to model development, and engages closely with the US administration on capability releases such as Mythos.
    • The longer term product vision is the virtual collaborator: an agent with organizational context, access to the company’s tools, persistent memory, and the ability to work on ideas, not just tasks, over long horizons.
    • CoWork, Anthropic’s extension of the Claude Code paradigm into general knowledge work, is being adopted faster than Claude Code itself when indexed to the same point in its launch curve.
    • Anthropic’s product teams ship daily, with a fleet of agents working across the company on specific tasks. Everyone effectively becomes a manager of agents.
    • The dominant downside risks to Anthropic’s high end forecast are slower customer diffusion of model capability into real workflows, scaling laws flattening unexpectedly, and Anthropic losing its position at the frontier.
    • Rao is most excited about biotech and healthcare outcomes, especially the prospect that AI could push drug discovery and lab throughput up 10x or 100x, turning currently incurable diagnoses into treatable ones within a patient’s lifetime.

    Detailed Summary

    Compute as Lifeblood and the Cone of Uncertainty

    Rao opens with the claim that compute is the most important resource at Anthropic, and the most consequential decision class in the company. You cannot buy a gigawatt of compute next week. You have to anticipate demand a year or two in advance, and the cost of being wrong in either direction is high. Buy too much and the unit economics collapse. Buy too little and you cannot serve customers or stay at the frontier, which are described as the same failure mode. To navigate this, the team uses a cone of uncertainty rather than point estimates. Small differences in weekly growth compound into vastly different two year outcomes, and Anthropic tries to position itself toward the upper end of that cone while preserving optionality. Rao notes he has had to consciously break a lifetime of linear thinking and force himself into exponential models.

    Three Chip Platforms, One Orchestration Layer

    Anthropic uses Amazon’s Trainium, Google’s TPUs, and Nvidia’s GPUs fungibly. That was not free. Adopting TPUs at scale started around the third TPU generation, when outside observers thought it was a strange choice. Anthropic invested years into compilers and orchestration so workloads can flow across chips by generation and by job type. The team works deeply with Annapurna Labs at AWS to influence Trainium roadmaps because Anthropic stresses these chips harder than almost anyone. The result is what Rao believes is the most efficient utilization of compute across any frontier lab, with a dollar of compute going further inside Anthropic than anywhere else.

    Three Buckets and the Model Development Floor

    Compute gets allocated across model development, internal acceleration of employees, and customer serving. The conversations are collaborative rather than zero sum, but there is a hard floor on model development that the company refuses to cross even if it makes customer demand harder to serve in the short term. The thesis is simple. The returns to frontier intelligence are extremely high, especially in enterprise, so cutting model investment to chase near term revenue is a bad trade. Internal employee use is also explicitly protected. Rao notes that diverting that internal usage to external customers would unlock billions of additional revenue today, but the compounding benefit of accelerating researchers and engineers outweighs that.

    Intelligence Is Multi Dimensional

    Rao pushes back hard on the IQ framing of model progress. Benchmarks saturate quickly, and the real signal comes from how customers actually use the models. Anthropic looks at long horizon task completion, tool use, computer use, and time to result on agentic tasks. Two equally capable agents who differ only in speed produce dramatically different value, because the faster one compounds into more attempts and more outcomes. Frontier model leaps are also fuel efficient. The sedan to sports car analogy breaks down because each Opus generation, 4 to 4.5 to 4.6 to 4.7, delivers a step up in capability and a multiplier on per token efficiency.

    From 9 Billion to 30 Billion ARR in One Quarter

    The headline number for the quarter is a leap from about $9 billion of run rate revenue to over $30 billion, accomplished without onboarding a corresponding step up in compute, because new compute lands on ramps locked in 12 months prior. Rao attributes the leap to model capability gains, products that surface that intelligence in usable form factors, and an enterprise customer base that pulls more workloads onto Claude as each generation unlocks new use cases. Coding started the wave with Sonnet 3.5 and 3.6, and the same pattern is now playing out elsewhere in the economy.

    Recursive Self Improvement and Talent Density

    Over 90 percent of Anthropic’s code is now written by Claude Code, including most of Claude Code itself. Rao describes this as a structural reason to keep allocating internal compute to employees even when external demand is hungry. Recursive self improvement is not happening through models that need no humans. It is happening through researchers who set direction and use frontier models to compress months of work into days. Talent density beats talent mass. When Meta and other labs went after Anthropic researchers with very large packages, Anthropic lost two people while peer labs lost dozens.

    Procurement Strategy and the Layer Cake

    Compute lands as a layer cake. Last month Anthropic signed a 5 gigawatt TPU deal with Google and Broadcom starting in 2027, alongside an Amazon Trainium agreement for up to 5 gigawatts. The total is north of $100 billion in commitments. A new tie up with xAI’s Colossus facility in Memphis was announced just before the interview, intended for nearer term capacity to support consumer and prosumer growth. Anthropic evaluates near term and long term compute deals against the same set of variables: price, duration, location, chip type, and how efficiently the team can run it. The relationships are deeper than procurement. The hyperscalers are also distribution channels for the model.

    Platform First, Selective Vertical Bets

    Rao describes Anthropic as a platform first business, with most expected value accruing to customers building on the platform. The team will only go vertical when it can either demonstrate capabilities that are skating to where the puck is going, like Claude Code did before the models could fully support it, or when it wants to set a template for an industry vertical, as with Claude for Financial Services, Claude for Life Sciences, and Claude Security. He acknowledges that surprise capability jumps make customers anxious about the platform competing with them, and frames Anthropic’s mitigation as deeper partnerships, early access programs, and an emphasis on accelerating customer building rather than disintermediating it.

    Pricing, Jevons Paradox, and Return on Compute

    Pricing across Haiku, Sonnet, and Opus has been stable. The notable exception is Opus, which Anthropic deliberately repriced lower when launching Opus 4.5 because Opus class problems were being squeezed into Sonnet workloads. Efficiency gains made it possible to serve Opus profitably at the new level. The consumption response was a classic Jevons paradox, with usage rising far more than the price reduction would have predicted, and Opus 4.6 then slotted in at the same price with a capability bump. Margins are not framed as a per token markup. Compute is fungible across model development, internal acceleration, and customer serving, so Anthropic measures return on the entire compute envelope rather than software style variable cost per call.

    Fundraising, DeepSeek, and Capital Intensity

    Rao joined while Anthropic was closing its Series D, mid frontier model launch and during the FTX share liquidation. Investors initially questioned whether Anthropic needed a frontier model, whether AI safety and a real business could coexist, and why the sales team was so small. The Series E closed the same day the DeepSeek news broke, with markets violently re pricing AI in real time. Since Rao joined, Anthropic has raised over $75 billion, with another $50 billion tied to the Amazon and Google compute deals. The reason for the size of the raises is the cone of uncertainty, not current losses. Returns on compute today are described as robust.

    Mythos, Cyber Capability, and Phased Releases

    The Mythos release marks the first time Anthropic shipped a model under a deliberately phased rollout because of a specific capability spike. Cyber is the dimension that spiked. Where a prior model found 22 vulnerabilities in an open source codebase, Mythos found roughly 250. The defensive applications, automatically patching massive codebases, are genuinely valuable, but the offensive risk is real enough that Anthropic chose to release to a smaller group first and expand access over time. Rao positions this as a template for future capability spikes, not a permanent restriction. He also describes the relationship with the US administration as cooperative, including the Department of War interaction, with Anthropic supporting a regulatory framework that does not strangle innovation but takes responsibility seriously.

    Claude Inside Finance

    Anthropic’s finance team is one of the strongest internal case studies. Statutory financial statements for every legal entity are produced by Claude, with a human reviewer. A skill library of more than 70 finance specific skills underpins a Monthly Financial Review skill that drafts the monthly close at 90 to 95 percent ready, so leadership meetings shift from explaining the numbers to discussing what to do about them. An internal analytics platform called Anthrop Stats compresses weekly insight cycles from hours to 30 minutes. The biggest internal token user in finance is the head of tax, building policy engines, which Rao highlights as evidence that adoption is driven by the most senior people, not just younger engineers.

    Culture, Co Founders, and the Race to the Top

    Seven co founders should not, on paper, work as a leadership group. Rao argues it works because the culture was set early around collaboration, intellectual honesty, transparency, and humility. The culture interview is a real veto, not a checkbox. Dario Amodei runs an all hands every two weeks with a short written piece followed by unscripted questions, and decisions, once made, get clean alignment rather than residual politics. Anthropic frames its approach as a race to the top, where being a model for how to build the technology responsibly is itself a recruiting and retention advantage.

    The Virtual Collaborator and the Frontier Ahead

    The product vision Rao describes is the virtual collaborator. Not just a smarter chatbot, but an agent with organizational context, access to the company’s tools, memory, and the ability to work on ideas over long horizons. Coding was the first domain to feel this, but CoWork, Anthropic’s extension of the Claude Code pattern into general knowledge work, is being adopted faster than Claude Code was at the same age. Product development inside Anthropic already looks different. Teams ship daily, with fleets of agents working across the company, and individual humans increasingly act as managers of those fleets.

    Downside Risks and What Excites Him Most

    The three risks Rao names if asked to do a premortem on a softer year are slower customer diffusion of model capability into real workflows, scaling laws unexpectedly flattening, and Anthropic losing its frontier position to competitors. None of these are observed today, but he is unwilling to claim them with certainty. On the upside, he is most excited about biotech and healthcare. Lab throughput rising 10x or 100x, paired with AI assisted clinical workflows, could turn currently incurable diagnoses into treatable ones within a patient’s lifetime. That is the outcome he wants the technology to chase.

    Thoughts

    The most consequential structural point in this interview is the framing of compute as a single fungible resource pool measured by return on the entire envelope, not as a variable cost per inference call. That accounting shift, if you accept it, breaks most of the bear cases about AI lab unit economics. The bear argument almost always assumes that a token served to a customer is the only thing the chip did that day. Rao’s version is that the same fleet trains models in the morning, runs reinforcement learning at lunch, serves customers in the afternoon, and accelerates internal engineers in the evening. If even half of that is real, the right comparison is total compute spend versus total enterprise value created by the platform, and on that ratio Anthropic looks structurally strong rather than weak.

    The Jevons paradox on Opus pricing is the most actionable insight for anyone running an AI product. Most teams default to either chasing premium pricing on the newest model or undercutting to chase volume. Anthropic did something more disciplined: it left Sonnet and Haiku alone, dropped Opus when efficiency gains made it serveable, and watched aggregate usage rise faster than the price cut. The lesson is that frontier model pricing is not really a price problem. It is a capability access problem, and elasticity around the right tier is much higher than the standard SaaS playbook implies.

    The Mythos cyber jump deserves more attention than it has gotten. Going from 22 to 250 vulnerabilities found in the same codebase is the kind of capability discontinuity that genuinely changes the regulatory calculus. Anthropic is signaling that it can identify these discontinuities ahead of release and choose a deployment shape that respects them. Whether peer labs adopt similar discipline is the open question. Anthropic’s race to the top framing assumes they will be forced to. The competitive market may say otherwise.

    The hiring data point is the most underrated investor signal. Two departures while peer labs lost dozens, during the most aggressive talent war in tech history, is not a culture poster. It is a structural advantage that compounds every time another lab tries to buy its way to the frontier. Money can be matched. Conviction in the mission, transparent leadership, and a culture interview that can veto otherwise stellar candidates cannot. If you believe scaling laws hold, talent retention at this density is one of the few moats that actually scales with capital.

    Finally, the most interesting personal admission is that Krishna Rao, a finance leader trained at Blackstone and Cedar, is openly telling investors that linear thinking is the failure mode he had to break out of. The companies that pattern match this moment to prior technology waves are mispricing it, in both directions. The cone of uncertainty Anthropic uses internally is the right metaphor for everyone else too. If you are forecasting AI as if it is cloud in 2010, you are almost certainly wrong, and the magnitude of the error is much larger than it would be in any prior era.

    Watch the full conversation with Krishna Rao on Invest Like the Best here.

  • Charles Koch and Chase Koch on Koch Industries: 130K Employees, 60 Countries, and a $150B Private Empire Built on Principle-Based Management

    Charles Koch and his son Chase Koch sat down with David Friedberg for a long, candid Forbes/All-In conversation about how a small crude-oil gathering operation in southern Oklahoma became Koch Industries, a privately held company with more than 130,000 employees across 60 countries and revenue that would land it comfortably in the top 25 of the Fortune 500 if it were public. They walked through the founding story, the management principles that drove a 9,000x increase in value since the early 1960s, the failures that almost wiped out the company, and the philanthropic and political work being done through Stand Together. Watch the full conversation on YouTube.

    TLDW

    Charles Koch took over a roughly 300-person family business in 1961 at age 25, fired the bureaucratic president, and built it into one of the most profitable private companies in the world by applying what he calls Principle-Based Management. The core insight is to be capability bounded rather than industry bounded, to run an internal “republic of science” that rewards contribution over credentials, and to treat failure as the price of experimental discovery. Koch grew through both organic capability extension and large acquisitions like Georgia Pacific in 2005 and Molex in 2013, mostly by replacing top-down hierarchies with bottom-up empowerment. The conversation covers the founding by Fred Koch, the near-death failures of the late 1990s “gas to bread spread,” the Pine Bend Minnesota refinery turnaround, the role of Wichita as a competitive advantage, Chase Koch’s path from feed-yard laborer to leader of Koch Disruptive Technologies, the launch of Stand Together as a long-running social-change platform, the rejection of single-party politics, the case against entitlements and occupational licensing, and the principles for using AI as a permissionless empowerment tool rather than a top-down control system. The throughline is Viktor Frankl: more people have the means to live and less meaning to live for, and the remedy is helping every individual find a gift and apply it in a way that creates value for others.

    Key Takeaways

    • Koch Industries today has more than 130,000 employees across 60 countries and has increased in value roughly 9,000 times since Charles took over in the early 1960s, when headcount was about 300.
    • Founded in 1940 by Fred Koch in Wichita, Kansas. The two starting businesses were designing fractionating trays (separating liquids by boiling point) and crude oil gathering in Oklahoma.
    • Charles got three engineering degrees at MIT, worked at Arthur D. Little, and reluctantly came back at 25 only after his father said he would otherwise sell the company. His father gave him full autonomy over every decision except selling.
    • His first move was firing the controlling, memo-driven president and replacing protectionism with three pillars: create value for customers, empower employees, and own end-to-end execution. They built their own plant in Italy instead of stitching together European subcontractors.
    • The defining mental model is “capability bounded, not industry bounded.” You expand into adjacent industries where the capabilities you have already proven (operations, logistics, trading, refining, branding) create more value than incumbents, not because the new industry is in the same SIC code.
    • Wholly owned business platforms today include engineered projects and construction, solar plants, commodity trading and distribution, fertilizers, refined products, chemicals and polymers, glass, forest and consumer products, electrical products (Molex), and management software, plus four distinct investment firms.
    • Koch is explicitly not a Berkshire-style conglomerate of independent silos. Chase frames it as an integrated republic of science, an integrated set of capabilities that share knowledge and people across business lines.
    • “If you are not failing at anything, you are not doing anything new.” Failure is treated as the cost of experimental discovery, but only when the learning value exceeds the cost.
    • The worst failures came from violating the hiring rule. Hire on values first, talent second. People with destructive motivation (power and control over contribution) hide failures and invent successes, and the damage compounds when those people get promoted into leadership.
    • The 1973 trading blowup nearly bankrupted the company. The late 1990s “gas to bread spread” strategy, an attempt to vertically integrate from natural gas through fertilizer to pizza crust, nearly wiped out all of Koch’s earnings. Lesson repeated, then internalized.
    • One acquisition shipped hundreds of millions of dollars in out-of-the-money hog feed contracts that nobody bothered to read before closing. Apply the scientific method: try as hard to disprove your hypothesis as to prove it.
    • Georgia Pacific was acquired in 2005 for roughly $20 billion when Koch was much smaller. They originally tried to buy only the commodity pulp piece so GP could re-rate as a pure consumer-products company at a higher P/E. When legal blockers killed that path, they bought the whole thing.
    • The Georgia Pacific culture change started with sending Joe Moeller in as CEO. He gutted the 51st-floor coat-and-tie executive suite, fired the most bureaucratic managers, moved everyone to working floors, and converted the executive floor into open meeting rooms. Signals like that drive culture more than memos do.
    • The Pine Bend, Minnesota refinery, bought in 1969, was one of the hardest cultural turnarounds. The union strike was violent (rifles fired, switch engines used to ram units), Charles ran it nine months without union labor on his honeymoon, the work rules finally changed, and once empowered, the workforce built its own machine shop, cut spare-part costs, and grew capacity tenfold. It is now one of the best refineries in the country.
    • Molex, bought in 2013, took years to transform. The dominant paradigm was top-line growth rather than bottom-line value creation, partly because it had been public for 30 years and the market rewarded the wrong things. Almost every successful turnaround required swapping in leadership with a bottom-up empowerment paradigm.
    • Sheep-dipping does not work. Pushing 130,000 people through the same seminar will not rewire habits. Coaching one struggling team until it succeeds creates social mimicry. Other teams ask to be next. Demand for Principle-Based Management coaches now exceeds supply inside the company.
    • The talent doctrine is values first, skills second, credentials last. Wichita and the farm-team labor pool are deliberate competitive advantages because farm kids tend to show up contribution-motivated rather than entitlement-motivated.
    • The current Koch CIO, Jared Benson, joined as a contractor striping lines in the parking lot and has no college degree. He learned data science, built the cyber-security capability, and ran circles around credentialed peers.
    • Public-company pressure to IPO was the biggest external threat. Charles refused. Staying private was the only way to keep reinvesting roughly 90 percent of profits, to maintain the capability-bounded model that no analyst would underwrite, and to keep accepting low P/E optics on commodity businesses inside the portfolio.
    • Three things any lasting partnership requires (marriage, business, employment): shared vision, shared values, and complementary capabilities. Miss any one and it does not last.
    • Chase Koch started at age 15 throwing tennis matches to escape practice, got shipped to a feed yard the next morning, shared a single-wide trailer with his boss, shoveled manure, and discovered the “glorious feeling of accomplishment” that his grandfather Fred had written about in his famous letter to the next generation.
    • At one point Chase was promoted to president of Koch Fertilizer, realized after nine months he was a builder and not an optimization operator, walked into his boss’s office, and fired himself. The role went to someone with the right comparative advantage and the business grew faster. Chase went on to launch Koch Disruptive Technologies (KDT).
    • KDT would have been shut down on a normal three-to-four-year venture timeline. Koch kept investing through the losses because of two principles: experimental discovery and creative destruction. They also valued the knowledge inflow about disruptive technologies that might one day eat the core business.
    • Comparative advantage applies to careers. The job of 20,000 plus Koch supervisors is to keep moving people into roles where they can actually contribute. Beating people up in the wrong seat is destructive.
    • Viktor Frankl frames the moral problem of the era: ever more people have the means to live and no meaning to live for. Without meaning, people default to either power or pleasure. Both lead, at scale, to totalitarianism, authoritarianism, or socialism.
    • Charles credits Maslow’s Eupsychian Management, Polanyi’s Personal Knowledge, Hayek’s price-signal work, and Frankl’s logotherapy as the intellectual foundations of Principle-Based Management. The five dimensions: vision, virtue and talents, knowledge processes, decision rights, and incentives.
    • Stand Together, founded in 2003, is a community of close to a thousand business leaders pooling effort on social change rather than working in philanthropic silos. The thesis: every human has a gift and the institutions are putting up barriers (broken schools, broken criminal justice, bad policy, occupational licensing).
    • Education is one of Stand Together’s biggest fronts. Pre-COVID, around 20 percent of families were open to a new model. Post-COVID, it is 70 to 80 percent. They back Alpha School (Joe Liemandt), Khan Academy (Sal Khan), and the VELA Education Fund alongside the Walton family. Roughly 5,000 micro-schools have been seeded.
    • The model for social change mirrors the business model: bet on the person closest to the problem who already shows results. Scott Strode and The Phoenix gym went from a couple of Colorado locations to one million people overcoming addiction, with relapse rates under 10 percent, by combining community and exercise rather than top-down treatment programs.
    • Charles says the biggest mistake of the first 50 years was trying to drive social change through a single political party, first the Libertarians and later just the Republicans. The current rule, from Frederick Douglass, is “I will unite with anybody to do right and with nobody to do wrong.”
    • His policy critique cuts in every direction: occupational licensing locks out newcomers, the treatment of working illegal immigrants is wrong, tariffs undermine division of labor by comparative advantage and raise prices, and entitlements once created are nearly impossible to dismantle.
    • Asked whether capitalism inevitably compounds into monopoly, Charles answers that the fix is removing barriers to others realizing their potential, not capping the winners.
    • On AI: the principle is permissionless innovation. Cost is collapsing, access is widening, and the right use is empowering individuals to learn 1000x faster, not concentrating power.
    • Koch backs Cosmos and other AI efforts that apply market-based management principles. Internally, they launched an AI app called Principal Companion that uses the Socratic method to walk users through problems using the book’s principles, from business to parenting.
    • Writing the new book (Charles’s fifth, Chase’s first) was the most important project Chase has worked on. They went through 27 versions of the stewardship chapter. Charles still corrects Koch leaders who say “the proof is in the pudding” instead of “the proof of the pudding is in the eating.”
    • When asked about legacy, Charles answered in one sentence: he wants the country to more fully live up to the promise in the Declaration of Independence.

    Detailed Summary

    From 300 Employees to 130,000 Across 60 Countries

    Koch Industries was founded in 1940 by Fred Koch in Wichita, Kansas. When Charles took over full-time in 1961, the company had about 300 employees and two main businesses: designing fractionating trays for separating liquids by boiling point, and a crude oil gathering system in Oklahoma. Today the company has more than 130,000 employees in 60 countries and has grown in value roughly 9,000 times over that period. If Koch were public, revenue would put it easily in the top 25 of the Fortune 500. The portfolio spans engineered projects and construction, solar plants, commodity trading and distribution, fertilizers, refined products, chemicals and polymers, glass, forest and consumer products, electrical products through Molex, management software, and four distinct investment vehicles. Roughly 90 percent of profits are reinvested.

    Charles Coming In at 25

    Charles describes himself as a poor engineer who happened to be good at math, science, and theory and bad at making or operating things. After three MIT degrees and a stint at Arthur D. Little doing what he calls “absurd” management consulting at 25, his father called and said the company was struggling and his health was failing. Either Charles came back or it would be sold. He came back. The condition was full autonomy: Charles could run it any way he wanted, the only decision requiring approval was selling. Within a short time he fired the previous president, a top-down memo-writer obsessed with controlling spending, and rewrote the operating philosophy around three things: create value for customers, empower employees, and own the value chain end to end. Instead of farming European fractionating trays out to multiple subcontractors and then re-assembling, Koch built its own plant in Italy.

    Capability Bounded, Not Industry Bounded

    This is the single most important strategic idea in the interview. Conventional advice told Koch to become an integrated oil major because they were in crude oil gathering. Charles rejected that and ran on Hayek and Adam Smith instead: division of labor by comparative advantage. Be in the part of any value chain where you can create more value than anyone else. From crude oil gathering, Koch leveraged operations, logistics, and trading into pipelines, refineries, natural gas, chemicals, fertilizers. Georgia Pacific looked like a non sequitur, wood products, but the underlying capability set transferred, and the acquisition also added branding as a new capability that fed back into the system. Chase calls the result not a Berkshire-style conglomerate of independent businesses but a republic of science: an integrated set of capabilities that share talent, knowledge, and laboratories.

    The Failures That Almost Killed the Company

    Charles spends a long stretch on failures, because he says the strength is in them. The 1973 trading blowup tied to the Middle East war could have bankrupted the company. The late 1990s “gas to bread spread” was an attempt to control the entire chain from natural gas to nitrogen fertilizer to grain to pizza crust. It violated almost every principle in the book at once and wiped out most of Koch Industries earnings for the decade. One acquisition closed before anyone read the hog-feed contracts, and on closing day they discovered hundreds of millions of dollars of out-of-the-money positions. Every failure traced back to two violations: hiring leaders with destructive motivation (power and control instead of contribution), and skipping the scientific method (trying to prove a hypothesis instead of disprove it). Charles says “repetition penetrates even the dullest of minds,” and he had to be punished enough times before the lesson took.

    Georgia Pacific, Molex, and the Pine Bend Refinery

    Three acquisition stories show how Koch transfers culture into businesses ten times larger than the corporate playbook would normally allow. Georgia Pacific in 2005 was a $20 billion bet on a company much larger than Koch at the time. Joe Moeller, sent in as CEO, immediately fired the most bureaucratic managers, gutted the 51st-floor private-elevator executive suite (coat and tie required to visit), moved everyone to working floors, and turned the old executive floor into open meeting rooms. Molex, bought in 2013, had been public for 30 years and ran on top-line growth thinking because that is what the market rewarded. Changing the paradigm to bottom-up empowerment and bottom-line value creation took years and required new leadership. Pine Bend, Minnesota, bought in 1969, was the hardest. The union ran the refinery, ignored work rules, and went on a violent strike when Koch tried to change them, firing rifles and ramming switch engines into units. Charles ran the refinery nine months without union labor (during his honeymoon), eventually got the work rules changed, then spent years rebuilding the culture. The empowered workforce designed and built its own machine shop, cut spare-part costs, and grew capacity tenfold. Pine Bend is now one of the best refineries in the country.

    How Principle-Based Management Actually Diffuses

    Charles is blunt that they tried “sheep dipping” first, hauling everyone through a seminar. It did not work, because changing a habit means rewiring the brain through work at intensity over time, the way a weightlifter has to retrain to become a marathoner. The model that did work was small. Find one team that is struggling, coach them with principles, let them succeed, and the rest of the company asks to be next. Social mimicry replaces top-down rollout. Internally the Principle-Based Management group is now in higher demand than any other function.

    Talent: Values First, Skills Second, Credentials Last

    Koch deliberately stayed in Wichita partly to access a “farm team” labor pool of people who grew up contribution-motivated. Chase tells the story of Jared Benson, who started as a contractor striping lines in the Koch parking lot, taught himself data science, built the company’s cyber-security capability, and is now CIO with no college degree. The lesson runs against the prestige-school default of most large companies. Contribution motivation, not credentials, predicts long-run output, and Charles is willing to “hire slow and stupid” for anyone with bad values so the company can flush them quickly. Aligning incentives matters as much as hiring: reward people on overall long-run contribution to Koch’s future, including the value of what was learned from a failed experiment, not on near-term P&L.

    Why Koch Stayed Private

    Multiple parties pushed hard for an IPO over the decades. Charles refused. Going public would have made the capability-bounded model impossible to communicate to analysts, would have forced a higher payout ratio and broken the reinvestment compounding, and would have introduced the short-termism that wrecks bottom-up empowerment. Buffett gets credit, but Berkshire does not try to integrate its businesses the way Koch does. Asked whether a non-owner public CEO could ever apply the principles, Charles allows it is possible if they can sell a different durable story (as Buffett did), but it is much harder.

    Chase Koch’s Path

    Chase tells two formative stories. The first is being shipped to a feed yard at 15, sharing a single-wide trailer with his boss, shoveling manure for minimum wage, and finding, for the first time, what his grandfather Fred had called “the glorious feeling of accomplishment.” The second is firing himself as president of Koch Fertilizer after nine months because he realized he was a builder, not an operator. The business outgrew where he would have taken it, and he went on to launch Koch Disruptive Technologies, the venture and innovation arm that now feeds technological insight back into every Koch business line. The comparative-advantage principle applied to a career, in public, by the boss’s son.

    Stand Together and Social Change

    Stand Together, founded in 2003, is the Koch family’s social-change platform. It now includes close to a thousand aligned business leaders. The animating belief is that every human has a gift and institutional barriers (broken schools, broken criminal justice, occupational licensing, bad policy) prevent most people from finding and applying it. The Phoenix gym founded by Scott Strode is the canonical Stand Together bet: a person closest to the problem, with results (relapse rates under 10 percent), funded to scale. In seven or eight years it has gone from a couple of Colorado locations to one million people. On education, post-COVID openness to new models jumped from roughly 20 percent of families to 70 to 80 percent. Stand Together backs Alpha School, Khan Academy, and the VELA Education Fund alongside the Walton family, and has helped seed roughly 5,000 micro-schools.

    Politics: The Single-Party Mistake

    Charles says for the first 50 of his 60 years in this work he avoided major-party politics, then concluded the country needed principle-based policies badly enough that engagement was required. The mistake was trying to do it through one party. The Libertarian Party turned into purity tests reminiscent of the early Communist Party. Doing it through Republicans blew up too. The rule going forward is Frederick Douglass’s: unite with anybody to do right and with nobody to do wrong. He is openly critical of both parties on occupational licensing, immigration policy, tariffs, entitlements, and the treatment of working illegal immigrants. He invokes Jefferson on slavery to describe his current mood: “If God is just, I despair for the future of our country.”

    Capitalism, Compounding, and AI

    Asked whether capitalism inevitably ends in monopoly because successful operators compound, Charles flips the framing. The remedy is not to cap the winners, it is to remove the barriers preventing everyone else from realizing their potential. Occupational licensing, immigration restriction on contributors, tariffs that undermine comparative advantage. On AI, Koch’s principle is permissionless innovation: cost is collapsing, access is widening, and the right outcome is individual empowerment and 1000x faster learning, not power concentration. Internally they launched Principal Companion, an AI app built on the principles in the book that uses the Socratic method to walk users through problems rather than handing out answers. Koch backs Cosmos and other AI ventures applying market-based management.

    The Philosophical Spine

    Charles cites four foundational thinkers. Polanyi’s Personal Knowledge gave him the model for how habits encode knowledge in the brain and why retraining is bodily work. Maslow’s Eupsychian Management supplied the empirical link between self-actualization and organizational performance. Hayek supplied the price system and the case against central planning. Frankl supplied the diagnosis: more means to live, less meaning to live for, and in that vacuum people drift to either power or pleasure, both paths to the slippery slope of authoritarianism and socialism. The Principle-Based Management answer is to design the company (and the country) so that everyone can find a gift and apply it to help others succeed.

    Thoughts

    The most useful concept in the conversation, the one worth stealing for any operator regardless of industry, is “capability bounded, not industry bounded.” Most companies define their addressable market by SIC code or competitive set. Koch defines it by the actual transferable skills they have demonstrated: operations, logistics, trading, refining, branding, cyber-security. Each acquisition is a probe to see whether the capability set creates more value than incumbents, and each acquisition that works hands back new capabilities (branding from Georgia Pacific, electronic-components engineering from Molex) that compound the option space. This is the same logic that makes Amazon’s AWS, advertising, and logistics businesses adjacent rather than diversifications. Industry conglomerates collapse. Capability conglomerates do not, because the capabilities reinforce each other.

    The honest treatment of failure is rarer than it sounds. Most CEOs who say “we celebrate failure” mean something performative. Charles’s version has teeth because the failures he names (the 1973 trade, the late 1990s vertical-integration push, the unread hog contracts) were almost terminal, and the lesson he draws is not “fail fast” but a specific causal claim about hiring leaders with destructive motivation. The asymmetry between contribution-motivated and destructively motivated employees, with the latter capable of hiding losses and inventing successes until the damage compounds, is the kind of insight that only comes from forty years of post-mortems. The remedy, hire slow and dumb if values are bad so you can purge fast, is uncomfortable enough to be real advice.

    The case for staying private is also harder than the founder-flex version usually heard from private operators. Charles is not arguing that private is better for everyone. He is arguing that a specific operating model (high reinvestment, cross-business capability sharing, willingness to take long P/E hits on commodity legs, leadership succession over decades) cannot be communicated to public markets without distortion. If you do not run that model, going public is fine. If you do, going public would have killed the system. That distinction is worth holding on to when reading the founder-control discourse in tech, because most “stay private forever” arguments do not actually meet that bar.

    The political reflection is the most surprising part of the conversation, particularly given the public reputation. Charles plainly says the biggest mistake of his life in social change was trying to do it through one party, that the Libertarians collapsed into purity-test factionalism, that the Republican approach failed in similar ways, and that the current operating rule is the one Frederick Douglass actually wrote down. He criticizes the current administration’s treatment of working illegal immigrants and the tariff regime by name. Whether one agrees or disagrees on policy, the willingness to grade your own past work in public, decades after the bets were placed, is rare at this level.

    Finally, the Frankl framing deserves a longer hearing than a podcast can give it. “Ever more people have the means to live and no meaning to live for” is the most economical statement of the malaise running through politics, addiction, education, and labor data right now. Koch’s bet is that the answer is not policy alone but a design problem: build institutions (companies, schools, philanthropies, AI tools) that let each individual find a gift and apply it in a way that creates value for others. That is the through-line connecting Principle-Based Management, Stand Together, the Alpha School partnership, The Phoenix gym, and Principal Companion. Whether it scales is an open question. The fact that one family business has spent 60 years pressure-testing it makes the experiment worth paying attention to.

    Watch the full Charles Koch and Chase Koch conversation on All-In and Forbes.

  • Dario Amodei on the AGI Exponential: Anthropic’s High-Stakes Financial Model and the Future of Intelligence

    TL;DW (Too Long; Didn’t Watch)

    Anthropic CEO Dario Amodei joined Dwarkesh Patel for a high-stakes deep dive into the endgame of the AI exponential. Amodei predicts that by 2026 or 2027, we will reach a “country of geniuses in a data center”—AI systems capable of Nobel Prize-level intellectual work across all digital domains. While technical scaling remains remarkably smooth, Amodei warns that the real-world friction of economic diffusion and the ruinous financial risks of $100 billion training clusters are now the primary bottlenecks to total global transformation.

    Key Takeaways

    • The Big Blob Hypothesis: Intelligence is an emergent property of scaling compute, data, and broad distribution; specific algorithmic “cleverness” is often just a temporary workaround for lack of scale.
    • AGI is a 2026-2027 Event: Amodei is 90% certain we reach genius-level AGI by 2035, with a strong “hunch” that the technical threshold for a “country of geniuses” arrives in the next 12-24 months.
    • Software Engineering is the First Domino: Within 6-12 months, models will likely perform end-to-end software engineering tasks, shifting human engineers from “writers” to “editors” and strategic directors.
    • The $100 Billion Gamble: AI labs are entering a “Cournot equilibrium” where massive capital requirements create a high barrier to entry. Being off by just one year in revenue growth projections can lead to company-wide bankruptcy.
    • Economic Diffusion Lag: Even after AGI-level capabilities exist in the lab, real-world adoption (curing diseases, legal integration) will take years due to regulatory “jamming” and organizational change management.

    Detailed Summary: Scaling, Risk, and the Post-Labor Economy

    The Three Laws of Scaling

    Amodei revisits his foundational “Big Blob of Compute” hypothesis, asserting that intelligence scales predictably when compute and data are scaled in proportion—a process he likens to a chemical reaction. He notes a shift from pure pre-training scaling to a new regime of Reinforcement Learning (RL) and Test-Time Scaling. These allow models to “think” longer at inference time, unlocking reasoning capabilities that pre-training alone could not achieve. Crucially, these new scaling laws appear just as smooth and predictable as the ones that preceded them.

    The “Country of Geniuses” and the End of Code

    A recurring theme is the imminent automation of software engineering. Amodei predicts that AI will soon handle end-to-end SWE tasks, including setting technical direction and managing environments. He argues that because AI can ingest a million-line codebase into its context window in seconds, it bypasses the months of “on-the-job” learning required by human engineers. This “country of geniuses” will operate at 10-100x human speed, potentially compressing a century of biological and technical progress into a single decade—a concept he calls the “Compressed 21st Century.”

    Financial Models and Ruinous Risk

    The economics of building the first AGI are terrifying. Anthropic’s revenue has scaled 10x annually (zero to $10 billion in three years), but labs are trapped in a cycle of spending every dollar on the next, larger cluster. Amodei explains that building a $100 billion data center requires a 2-year lead time; if demand growth slows from 10x to 5x during that window, the lab collapses. This financial pressure forces a “soft takeoff” where labs must remain profitable on current models to fund the next leap.

    Governance and the Authoritarian Threat

    Amodei expresses deep concern over “offense-dominant” AI, where a single misaligned model could cause catastrophic damage. He advocates for “AI Constitutions”—teaching models principles like “honesty” and “harm avoidance” rather than rigid rules—to allow for better generalization. Geopolitically, he supports aggressive chip export controls, arguing that democratic nations must hold the “stronger hand” during the inevitable post-AI world order negotiations to prevent a global “totalitarian nightmare.”

    Final Thoughts: The Intelligence Overhang

    The most chilling takeaway from this interview is the concept of the Intelligence Overhang: the gap between what AI can do in a lab and what the economy is prepared to absorb. Amodei suggests that while the “silicon geniuses” will arrive shortly, our institutions—the FDA, the legal system, and corporate procurement—are “jammed.” We are heading into a world of radical “biological freedom” and the potential cure for most diseases, yet we may be stuck in a decade-long regulatory bottleneck while the “country of geniuses” sits idle in their data centers. The winner of the next era won’t just be the lab with the most FLOPs, but the society that can most rapidly retool its institutions to survive its own technological adolescence.

    For more insights, visit Anthropic or check out the full transcript at Dwarkesh Patel’s Podcast.