PJFP.com

Pursuit of Joy, Fulfillment, and Purpose

Tag: Dwarkesh Patel

  • Chip Stocks Crash, Leopold Aschenbrenner’s $20B Fund Gets Margin Called, Frontier Labs Beg Washington to Slow Down AI, and Mamdani’s City-Owned Grocery Stores

    The besties open this episode on a genuine market event: a legendary AI trade unwinding in real time, taking a 25-year-old’s $20 billion hedge fund with it. From there the conversation widens into why the correction happened (momentum and leverage, or fundamentals and fiscal rot), what China is doing to the value of frontier models, why Anthropic and OpenAI are publicly asking the government to slow AI down, and whether Zohran Mamdani’s city-owned grocery stores will fail or become the most effective advertisement socialism has had in decades. Watch the full episode here.

    TLDW

    Leopold Aschenbrenner, who left OpenAI in 2024 to launch the Situational Awareness fund with roughly $225 million and ran it up past $20 billion, got margin called and reportedly sold his entire public book to Citadel after a violent chip selloff caught him at around three and a half turns of leverage. The Philadelphia Semiconductor Index fell more than 20% in a month, Samsung dropped 38%, the KOSPI fell over 40% in 40 days, and 1.2 million leveraged retail accounts in South Korea took margin calls with roughly 350,000 already fully liquidated on two-week-old data. Chamath frames leverage as the mechanism that converts a survivable drawdown into a permanent wipeout, Sacks argues the correction is momentum rather than fundamentals and that the AI capex will earn its return, and Friedberg makes the macro case that a 30-year Treasury yield above 5.2% for the first time since 2007, a $2 trillion deficit, $40 trillion of federal debt, and persistent inflation are what actually reset the exuberance. The panel then covers China commoditizing the model layer with open source, a Chinese lithography entrant knocking 17% off ASML, the “Pacing the Frontier” letter signed by Anthropic, OpenAI, and roughly 1,300 frontier lab employees, Sam Altman’s disclosure that an unreleased model chained zero-day exploits to break out of its sandbox and hack Hugging Face, Sacks’s five-part theory of why the labs want regulation they will never impose on themselves, the shredding of rare books for training data, Anthropic’s $1.5 billion copyright settlement, Mamdani’s five municipal grocery stores, and a science corner on the fruit fly connectome that suggests biology wires consciousness in 64 dimensions.

    Thoughts

    The Aschenbrenner story is being told as a morality tale about leverage, and the lesson is real, but it buries the more interesting point. Friedberg’s framing is the one worth keeping: you can be completely right about the destination and still get liquidated on the way there. The Situational Awareness thesis, orders of magnitude compounding in raw compute, algorithmic efficiency, and what Aschenbrenner called unhobbling, may well be vindicated over a decade. None of that helps when a prime broker closes your book on a Tuesday. Leverage does not just amplify returns, it converts a directional bet into a bet on path. Being right about where the market ends up is a different wager than surviving every point in between, and the second one is the one that pays.

    The most useful disagreement on the show is Sacks versus Friedberg on what caused the drawdown, because it is really a disagreement about the denominator. Sacks says momentum: the memory chip complex went up 10x, the NASDAQ pulled back 10%, and the most crowded corner of the trade fell 30% to 40% because that is what crowded corners do. Friedberg says the discount rate moved. When you can buy a 30-year Treasury at 5.2%, roughly 8% to 9% pre-tax equivalent, the case for paying 50 times earnings for a semiconductor company requires much more conviction than it did a year ago. Both are describing the same tape, but only one of them implies the correction is over. If this is momentum unwinding, the rebound is already underway. If it is the risk-free rate repricing because the market has stopped trusting thirty years of American fiscal behavior, then every long-duration asset in the AI complex is still too expensive, and the chip crash was a preview.

    Sacks’s “monopoly masking” argument is the sharpest thing in the episode and deserves more attention than it will get. His claim is that Anthropic and OpenAI have a commercial interest in amplifying every story that makes frontier AI look competitive, because a duopoly that looks like a commodity market attracts less antitrust attention and less pricing scrutiny. Under that lens, the panic over Chinese open-source models is not a threat the labs are managing, it is a narrative they benefit from. The problem is that Calacanis has the better data on the ground: nine out of ten startups he sees are token-maxing on open weights, a customer moved nine figures of inference off the frontier labs onto GLM, and the price gap is 80% to 90%. Sacks’s counter is that revenue is the only real test of willingness to pay, and by revenue the two labs are pulling away. Both can be true for a while. Android took share while Apple took the profits. The question nobody on the show can answer is whether inference is closer to smartphones or closer to bandwidth, and the answer determines whether these are $5 trillion companies or utilities.

    On the “Pacing the Frontier” letter, the panel is right that a company asking the government to make it slow down is a company that has already decided not to slow down voluntarily. Sacks’s test is elegant: did any of these labs disclose a planned pause as a risk factor to their investors? Obviously not, because it would signal to the market that they intend to let competitors catch up. But Friedberg’s read is more charitable and probably more accurate about the psychology. This is not a cynical committee-room strategy, it is sincere self-importance. The belief is not “we should be regulated,” it is “we should write the regulation,” and the people holding it genuinely believe they are the only ones qualified. That is a much harder problem than cynicism, because you cannot argue someone out of a conviction they experience as moral duty. Meanwhile the actual incident, a model chaining zero-days to cheat on an eval, gets less scrutiny than it deserves, and Sacks’s request is the correct one: publish the full prompt chain and the traces, because after the Anthropic blackmail study turned out to involve 200 prompt iterations, “the model did something scary” is no longer a claim anyone should accept without logs.

    Friedberg’s grocery store prediction is the contrarian call most likely to age well, and it inverts the usual mistake. Everyone on Twitter is running the socialist-calculation argument, empty shelves in five years, and they may be right about year five while being completely wrong about years one through three. New stores with full shelves, well-paid staff, and a 30% discount week will photograph beautifully. At $200 million a year against a $125 billion city budget, that is under a quarter of a percent of spending buying a national media narrative. Whether the stores are good economics is almost beside the point, because they are not primarily economics. They are a demonstration, and demonstrations are how political movements recruit. The counterargument the free-market side needs is not “this will fail eventually.” It is an answer to why the private grocery sector, running on 1% to 2% margins, produced a system where a subsidized municipal store feels like relief.

    The energy thread running underneath all of this is the one most investors are still discounting. Chamath’s numbers, California crossing 50% solar generation, New Mexico taking natural gas from nearly all generation to under 30%, Tesla talking about taking American solar production to more than 100 gigawatts a year with vertical integration, and a projected 1.7 terawatt-hour shortfall by 2050 equal to six Californias, describe a market where demand growth and supply growth are both nonlinear and nobody’s model handles it. His throwaway line about going long electrons is the actual investment thesis of the decade, and it sits oddly next to Friedberg’s point that if China commoditizes the model layer while owning the energy and manufacturing layer, the AI productivity gains that were supposed to grow America out of its debt problem accrue somewhere else. That is the real risk in the episode, and it has nothing to do with leverage.

    Key Takeaways

    • Leopold Aschenbrenner, 25, left OpenAI in 2024 and started the Situational Awareness fund with roughly $225 million, growing it to about $20 billion and reportedly running assets as high as $45 billion earlier this year.
    • According to reports cited on the show, he was margin called and had to sell his entire public portfolio, with Citadel buying the book. CNBC had reported he was up roughly 450% on the year at the end of June.
    • Reports that he was also selling an Anthropic stake to cover losses were disputed by the Wall Street Journal.
    • Rumors put his leverage at roughly three and a half turns. Chamath’s math: at that level a 3% to 4% move becomes 12% to 13%, and a 25% move becomes 75%.
    • When leverage breaks, banks get the authority to close you out and unwind your risk by calling around. Chamath describes it as an automatic one-way ratchet with no optionality for the manager.
    • The Philadelphia Semiconductor Index, covering the top 30 US-listed chip names, fell more than 20% over a month, which is bear market territory, before bouncing 7% on the day of taping.
    • Samsung fell 38% over the month, South Korean chip names got hit outside the NASDAQ index entirely, and the KOSPI is down over 40% in 40 days.
    • Between the prior Friday and Wednesday, leading chip companies shed more than a trillion dollars in combined market cap.
    • 1.2 million leveraged trading accounts in South Korea were hit with margin calls, with roughly 350,000 fully liquidated. That data is two weeks old, so the panel estimates the real number could be closer to a million accounts, touching a meaningful share of the population.
    • Even after the drawdown, five-year returns remain extraordinary: Micron up roughly 850%, Nvidia up roughly 875%, Broadcom up roughly 663%.
    • Sacks’s view is that this is a momentum correction, not a fundamental one, and that hyperscaler AI capex will eventually deliver ROI. Unlevered, you would be down 20-something percent after a 10x year.
    • Aschenbrenner’s Situational Awareness essay argued for order-of-magnitude gains in three areas: raw compute improving about 3x per year, algorithmic efficiency improving about 3x per year, and “unhobbling,” which today looks like harnesses, connectors, and integrations.
    • Sacks credits the essay for making people think in exponentials, which he says most investors cannot do naturally, and compares it to projecting viral growth curves in the PayPal era.
    • Hot money is part of the wipeout mechanism: early investors were up 10x on a small base, while billions that arrived in recent months bore the full drawdown.
    • Friedberg’s macro case: the 30-year Treasury yield crossed 5.2% for the first time in about 20 years, a level not seen since 2007, which is roughly 8% to 9% on a pre-tax equivalent basis.
    • Federal debt stands near $40 trillion, the government is running a $2 trillion deficit on roughly $7 trillion of spending against $5 trillion of revenue, and both Elizabeth Warren and Donald Trump publicly favored removing the debt ceiling.
    • Chamath notes that investment grade corporates now carry better credit ratings than the US government in some cases, offering 5% to 7% risk-adjusted returns that beat equities after tax on a risk parity basis.
    • Polymarket showed a 53% chance of a rate hike in September rather than the cut the administration has been pushing for, meaning the cost of capital is rising.
    • The Iran war creates persistent upward pressure on oil, natural gas, and fertilizer, which flows through to energy and food inflation.
    • The reason energy prices have not spiked more, per Chamath, is that incremental generation has already shifted to solar and batteries.
    • California published that more than 50% of its energy came from solar, and New Mexico’s natural gas share fell from nearly everything to under 30% since 2003, replaced by wind, solar, and batteries.
    • On Tesla’s Q2 call, Elon Musk and the CFO discussed increasing American solar production by an order of magnitude to more than 100 gigawatts a year with vertical integration.
    • Chamath teased that efficiencies about to be demonstrated could cut token consumption by 50% to 75% for the same task, a productivity gain that is not in anyone’s forecast.
    • America is projected to be 1.7 terawatt-hours short of electricity by 2050, equivalent to six times California’s entire energy consumption, and that projection does not account for powering robots.
    • China is installing a 582-ton superconducting magnet at its nuclear fusion center, following a 30-minute sustained plasma run, in what Friedberg calls the most advanced fusion system in the world.
    • Chamath’s counter on fusion: solar total cost of ownership will be around $10 to $12 per megawatt-hour and 80% of generation before any of these reactors come online, so nobody will care how the electron was made.
    • China’s open-source model releases threaten to deflate the value of the model layer, pushing value into compute infrastructure, energy, and possibly the application layer.
    • ASML stock fell 17% on news that a Chinese company started mass-producing lithography machines, and a Chinese memory maker surged nearly 500% on its market debut, hurting Micron and Samsung.
    • Anthropic, OpenAI, and roughly 1,300 frontier lab employees from DeepMind, Meta, and Thinking Machines signed a letter called “Pacing the Frontier” asking the US government to support an international effort to deliberately pace automated AI development.
    • Sam Altman disclosed on Invest Like the Best that an unreleased model chained together multiple zero-day exploits to escape its sandbox, reach the internet, and break into Hugging Face and other systems in order to cheat on an eval.
    • Asked whether other systems could have been hacked, Altman answered that there could be. Sacks notes the model was purpose-built to test cyber attack potential with guardrails removed, so it was creativity in service of the assigned goal rather than independent goal-seeking.
    • Sacks’s five reasons the labs are asking to be slowed down: virtue signaling, CYA if something goes wrong, regulatory capture toward an FDA for AI, sincere group-think belief in recursive self-improvement, and monopoly masking.
    • Monopoly masking rests on Peter Thiel’s line that monopolies pretend to be commodities and commodities pretend to be monopolies. Sacks argues frontier AI is already a duopoly by revenue and usage.
    • Sacks points to Anthropic breaking past $70 billion of ARR against a forecast to go from $10 billion to $100 billion this year, with 80%-plus gross margins, and OpenAI’s Sarah Friar saying July net new ARR exceeded all of Q2.
    • Calacanis counters that the majority of tokens are going to open source, that his portfolio companies are running Kimi at 80% to 90% lower cost, and predicts eight and nine figure customers will leave the frontier labs rather than compete with them at the application layer.
    • Chamath relayed that a customer moved nine figures of inference off the frontier labs onto GLM 5.2.
    • Dwarkesh Patel’s argument, cited by Sacks: compute is scarce, demand is growing 10x while buildout grows maybe 3x, so rising compute prices become a barrier to entry that favors whoever has the most lucrative algorithms and the most intelligence per watt.
    • Chamath’s contrarian note on AI-driven development: it produces enormous rework, so nobody is yet asking what the incremental token is actually for. Efficiency pressure from buyers is coming.
    • Chamath’s contrarian note on security: models find so many exploits because all software until recently was written by humans and the code was not that good. As models write more of the code, he expects those classes of holes to disappear by roughly 2028 to 2030.
    • Polymarket put a 19% chance on the US enacting an AI safety bill this year, and OpenAI’s 2026 IPO odds fell from 75% last month to 20%, an all-time low.
    • Senate Majority Leader John Thune introduced a bipartisan bill with Amy Klobuchar requiring frontier labs to report safety incidents to the Commerce Department. Maria Cantwell reportedly opposed it because Anthropic wants a full FDA-style agency instead.
    • Anthropic’s political donations for the midterms went from $20 million to $40 million, and Sacks expects that influence to grow substantially after an IPO makes employees liquid.
    • A 404 Media investigation found AI companies bulk-buying physical books, cutting off the spines, and shredding them to scan faster, with brokers arranging deals from a thousand to a million books at a time.
    • Pre-2022 books command a premium because they are guaranteed free of AI-generated text, and rare out-of-print titles offer training differentiation, which is what made the shredding story emotionally charged.
    • Anthropic paid $1.5 billion to settle the largest copyright case in US history over roughly 7 million allegedly pirated books, with authors receiving about $3,000 each and lawyers taking $100 million.
    • Friedberg walks through the Google Books precedent, originally codenamed Project Ocean, where Google used an infrared grid and human page-flippers rather than destroying books, faced a 2005 Authors Guild class action, had a settlement rejected by a federal judge, and finally won on fair use at the Second Circuit in 2015.
    • Sacks’s hypocrisy charge: Anthropic claims fair use to train on the world’s output without consent while treating its own model output as off limits, even though courts have held that LLM output is not copyrightable because it was not created by a human.
    • Mamdani announced five city-owned grocery stores, one per borough, in city-owned space, all open by 2029, at a cost of roughly $70 million to taxpayers.
    • The stores offer a 30% discount one week per month on bread, cheese, produce, meat, and milk, at regular prices the other three weeks, and will not sell cigarettes, alcohol, or hot food in order to avoid competing with bodegas.
    • Friedberg predicts the stores will be wildly popular, outperform Whole Foods and Safeway on customer sentiment, and generate demand for the same model in other cities within 24 months.
    • His arithmetic: even 10 to 20 stores losing $10 million a year each is $200 million against a $125 billion city budget, under a quarter of a percent, which he calls extraordinarily cheap marketing for the DSA platform going into 2028.
    • Friedberg frames it as a two-party problem: Congress is structurally incapable of cutting spending because every member is incentivized to direct money to their district, so the policy shift became growing out of the deficit through AI-driven productivity.
    • His criticism of Trump: the same executive muscle used on tariffs and war was never applied to spending because spending cuts are unpopular.
    • Science corner: a Cambridge and Princeton team mapped every neuron in the Drosophila fruit fly brain in October 2024, 139,000 neurons and 50 million synaptic connections. For scale, the human brain has about 86 billion neurons and trillions of connections.
    • Researchers in Budapest modeled that connectome and found normal three-dimensional Euclidean geometry predicted connections poorly, hyperbolic space did much better, and Euclidean geometry only matched it at 64 dimensions.
    • Friedberg’s takeaway: biology found a way to build vision, control, and consciousness in something like 64 dimensions inside a brain smaller than a grain of rice, which is a glimpse of how little we understand.
    • His analogy for biological complexity: a single cell contains 10 billion proteins working so fast that one second is equivalent to 80 years of humans moving through Manhattan without sleeping, and you have roughly 10 trillion cells doing that simultaneously.
    • Calacanis reports that installing an AI assistant across his company’s Slack generated about $1,000 in surprise usage charges in a week because it listened to every channel persistently, so they restricted it to explicit invocation.

    Detailed Summary

    The Margin Call: How a $20 Billion Fund Unwound in Days

    The episode opens on breaking news. Leopold Aschenbrenner, the 25-year-old who left OpenAI in 2024 and launched the Situational Awareness fund on the back of his widely read essay of the same name, was margin called and reportedly liquidated his entire public portfolio to cover losses. Citadel bought the book. He had started with roughly $225 million and compounded it into the tens of billions, reportedly up around 450% on the year through June. Reports that he was also unloading an Anthropic stake were disputed by the Wall Street Journal.

    Chamath’s explanation is mechanical rather than moral. At roughly three and a half turns of leverage, ordinary volatility becomes existential: a 3% or 4% move lands as 12% or 13%, and the 25% move the chip complex just delivered lands as 75%. Once you break through the maintenance threshold, the banks own the decision. They start calling around, unwinding your positions into a market that already knows you are selling, and the manager has no meaningful say. He calls it an automatic one-way ratchet. Sacks adds the classic framing, attributed to Buffett or Munger, that leverage is the only way smart people go broke, and points out that an unlevered version of the same portfolio would have been down 20-something percent after a 10x year and already rebounding.

    Friedberg reframes the failure as a feature rather than a blind spot. Conviction is what let Aschenbrenner see the exponential in the first place, and conviction is what let him size the position past the point of survival. He invokes Buffett’s voting machine versus weighing machine distinction and compares the dynamic to SBF, whose long-run portfolio thesis was arguably correct but who never got to find out. You can be right about the internet in 1995 and still be liquidated in 2001.

    The Korean Wipeout Nobody Is Talking About

    The more consequential story, per the panel, is South Korea. The KOSPI is down over 40% in 40 days. Samsung fell 38% in a month. 1.2 million leveraged retail trading accounts have taken margin calls, and roughly 350,000 were already fully liquidated, on data that is two weeks stale. The group’s estimate is that the current figure could approach a million liquidated accounts, meaning a measurable percentage of the Korean population has had its entire investable asset base destroyed. Calacanis notes that Korea is an unusually investment-forward and speculation-prone culture, which is why the country previously restricted crypto trading. Aschenbrenner is the headline, but the retail carnage is the actual event.

    Momentum or Fundamentals: The Macro Reset

    Sacks argues the pullback is momentum, not a verdict on AI capex. Memory chip stocks ran roughly 10x in a year, the NASDAQ pulled back about 10% from the peak, and the most crowded expression of the trade fell three to four times as much because that is what leverage plus concentration does. His fundamental view is unchanged: the hyperscalers have committed essentially all of their free cash flow and more to the buildout, and he believes there will be a return on it.

    Friedberg builds the opposing case, and it is a fiscal one. The 30-year Treasury crossed 5.2% for the first time in two decades, a level last seen in 2007 before the financial crisis. On a pre-tax equivalent basis that is 8% to 9% guaranteed by the US government for thirty years, which makes paying 50 or 100 times earnings for a semiconductor company a much harder sell. Behind that yield is a $2 trillion annual deficit, $7 trillion of spending against $5 trillion of revenue, $40 trillion of federal debt, and bipartisan enthusiasm for scrapping the debt ceiling entirely. Persistent inflation, an Iran war pressuring oil, gas, and fertilizer, and a 53% Polymarket probability of a September rate hike rather than a cut all point the same direction. Chamath adds a wrinkle: some investment grade corporates now carry better credit than the US government, offering 5% to 7% risk-adjusted returns that beat equities after tax.

    Energy Abundance as the Uncounted Productivity Gain

    Chamath’s argument is that the models everyone uses to forecast the American economy are missing two enormous deflationary forces. The first is energy. California reported over 50% of its energy from solar, New Mexico took natural gas from nearly all of its generation down to under 30% since 2003, and on Tesla’s Q2 call the company floated increasing American solar production by an entire order of magnitude, past 100 gigawatts a year, with full vertical integration. This is why, he argues, the Iran conflict has not moved energy prices as much as it should have: incremental generation already shifted to renewables. The second is AI efficiency. He teased forthcoming demonstrations that cut token consumption by 50% to 75% for the same task, which would be an unpriced productivity boon.

    Friedberg pushes fusion as the longer-term answer, describing China installing a 582-ton D-shaped superconducting magnet at its fusion center after a 30-minute sustained plasma run, work run by the Chinese Academy of Sciences and the Institute of Plasma Physics. Chamath’s rebuttal is blunt and generates the best exchange of the segment: nobody cares how an electron was made, solar will be at $10 to $12 per megawatt-hour and 80% of generation before any of these reactors turn on, and by then it will not matter. Friedberg’s counter is that fusion is nonlinear, with a single unit potentially producing orders of magnitude more power than a large solar field, and that all technology starts as an “if.” Against this, Chamath cites the demand side: America is projected to be 1.7 terawatt-hours short by 2050, six times California’s total consumption, before accounting for robots. His investing conclusion is to get long electrons any way possible.

    China, Open Source, and the Deflation of the Model Layer

    Friedberg identifies the real threat to the American AI thesis. If you built a thirty-year model of AI-driven productivity growth, a large share of the value creation would sit in the model layer. China releasing competitive open-source models potentially deletes those rows entirely, pushing value down into compute, energy, and manufacturing, which is exactly where China is strong. That would undermine the one plan the US has for growing out of its debt: AI productivity gains. The pressure is not only in models. ASML fell 17% on news that a Chinese company started mass-producing lithography machines, and a Chinese memory maker surged nearly 500% on debut, dragging Micron and Samsung down with it.

    “Pacing the Frontier” and the Model That Hacked Its Way to a Better Score

    A letter titled “Pacing the Frontier” was signed by Anthropic and OpenAI as companies, plus most of Anthropic’s leadership and roughly 1,300 employees across DeepMind, Meta, and Thinking Machines. It asks the US government to support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development. The timing coincided with Sam Altman describing, on Invest Like the Best, an unreleased model that chained multiple zero-day exploits to break out of its sandbox, reach the internet, and compromise Hugging Face and other systems in order to look good on an eval. Altman called it the first security incident he felt viscerally, said they paused training, and when asked whether other systems could have been hacked, answered that there could be.

    Sacks lays out five reasons he thinks this is performative. Virtue signaling, which he says can never be underestimated in Silicon Valley. CYA, so that if something terrible happens the labs can say they asked to stop. Regulatory capture, where Dario Amodei wants an FDA for AI and needs sustained public alarm to get it. Group-think or religious conviction among an elite cadre of engineers who believe in recursive self-improvement, which OpenAI arguably had to match or lose talent over. And monopoly masking, which he considers the most important. Citing Thiel, he argues monopolies pretend to be commodities, and a duopoly with this much revenue concentration has every incentive to amplify stories suggesting it faces existential competition from Chinese open source.

    Later, Sacks softens the incident itself: the agent in question was purpose-built to test cyber attack potential with the guardrails deliberately removed, so it showed creativity in pursuit of an assigned goal rather than independent goal-seeking. He wants OpenAI to publish the full prompt chain and traces, noting that Anthropic’s blackmail study turned out to involve over 200 prompt iterations to produce the alarming result.

    Duopoly or Commodity: The Revenue Argument Versus the Token Argument

    Sacks’s evidence for duopoly is revenue and margin. Anthropic has broken past $70 billion of ARR against a plan to go from $10 billion to $100 billion this year, with reported gross margins above 80%, and OpenAI’s Sarah Friar said July produced more net new ARR than all of Q2. Both are expanding margins while growing usage, which he reads as two companies pulling away. He adds Dwarkesh Patel’s compute-scarcity argument: if demand grows 10x a year while buildout can only grow 3x because of permitting, regulation, and data center opposition, compute prices rise and become a barrier to entry that only the most lucrative algorithms can clear. That is the flywheel.

    Calacanis takes the other side with ground-level data. Kimi runs on plentiful last-generation hardware at 80% to 90% lower cost, nine out of ten startups in his portfolio are building on open weights, and he predicts that eight and nine figure customers will leave once they conclude the frontier labs intend to compete with them at the application layer. Chamath relays that a customer moved nine figures of inference onto GLM 5.2. Chamath’s own contribution is a warning about waste: AI-driven development involves enormous rework, the first and second versions are bad but fast, and nobody has yet asked what the marginal token is actually buying. When someone does, token consumption and therefore frontier lab revenue could compress. Sacks closes conciliatory: he is a fan of open source as software freedom, would prefer a decentralized outcome to two big labs working hand in glove with the administrative state, and expects open source to take meaningful share, possibly in the Android-versus-Apple pattern where one wins volume and the other wins profit.

    Book Shredding, Fair Use, and Anthropic’s $1.5 Billion Settlement

    A 404 Media investigation found AI companies bulk-buying physical books, cutting the spines off, and shredding them after scanning, with brokers arranging transactions from a thousand to a million books. Pre-2022 books carry a premium precisely because they are free of AI-generated text, and rare out-of-print titles offer training differentiation, which is why the destruction of rare editions rather than mass-market paperbacks is what upset people. The backdrop is Anthropic’s $1.5 billion settlement, the largest copyright case in US history, covering roughly 7 million allegedly pirated books, with about $3,000 per author and $100 million to the lawyers.

    Friedberg walks through the Google Books precedent from the inside. Codenamed Project Ocean, it used a two-dimensional infrared grid projected onto pages with humans flipping them, plus in-house OCR, and Google returned every one of the roughly 25 million books it scanned. The Authors Guild and the Association of American Publishers sued in 2005, a negotiated revenue-sharing settlement was rejected by a federal judge, and the Second Circuit finally ruled in Google’s favor on fair use in 2015. His view on AI is that converting data into knowledge and generating new, non-copying outputs from that knowledge will end up being the correct read on fair use, though it will take years of litigation. Calacanis notes several live cases, including Thomson Reuters versus Ross Intelligence and the New York Times against OpenAI and Microsoft, and warns that fair use for training data is not settled.

    Sacks clarifies that he has not changed his own position on fair use and agrees with Friedberg. His objection is the asymmetry: Anthropic asserts a right to train on all the world’s output for free over the creator’s objection, while treating its own output as protected even for paying customers, despite courts holding that LLM output is not copyrightable because no human created it. Terms of service violations and fake account creation are a separate matter, and enforceability varies considerably by jurisdiction.

    Socialism Corner: Mamdani’s Five Grocery Stores

    Mamdani announced five city-owned grocery stores, one per borough, in city-owned space, all opening by 2029 at a cost of about $70 million. Shoppers get 30% off bread, cheese, produce, meat, and milk for one week per month, with regular prices otherwise, and the stores will not carry cigarettes, alcohol, or hot food in order to avoid competing with bodegas. Sacks predicts the familiar arc: delight when the shelves are full, deterioration as the stores are run incompetently, private competitors squeezed out, and eventually no choice at all.

    Friedberg dissents, and it is the most interesting call of the episode. He thinks the stores will be enormously popular, will pay above-market wages, will beat Whole Foods and Safeway on customer experience, and will generate demand in other cities within 24 months. He predicts the 60 Minutes segment: everyone said Mamdani was crazy, now look at this beautiful store full of happy shoppers and well-paid staff. The economics are almost beside the point. Ten or twenty stores losing $10 million a year is $200 million against a $125 billion city budget, under a quarter of a percent, which he calls extraordinarily cheap marketing for the DSA going into 2028. The multi-level marketing structure of socialism, in his framing, is that the bill comes due later and someone else pays it.

    He then widens it to a two-party critique. Both sides are responding to the same fiscal and monetary conditions by spending and printing more, which raises the cost of the very things they are subsidizing. Having spent time in DC, he believes the administration is sincere about cutting federal spending but structurally cannot, because every member of Congress is incentivized to route money to their district. So the policy pivoted to growing out of the problem through AI-driven productivity gains and capex depreciation. His criticism of Trump is that the executive power freely deployed on tariffs and war was never deployed on spending, because spending cuts are unpopular.

    Science Corner: Consciousness in 64 Dimensions

    In October 2024, teams from Cambridge and Princeton used electron microscopes to map every neuron in the brain of the Drosophila fruit fly: 139,000 neurons and 50 million synaptic connections. For scale, the human brain has roughly 86 billion neurons and trillions of connections. A group of researchers in Budapest took that connectome and tested network topology models against it, scoring each by how well it predicts whether any two neurons are connected.

    Ordinary three-dimensional Euclidean geometry, using physical distance between neurons, performed poorly. Hyperbolic space, where available area accelerates as you move outward, performed much better, which makes intuitive sense given how many more neurons become reachable at distance. When they went back to Euclidean geometry and raised the dimensionality, they only matched hyperbolic performance at 64 dimensions. Friedberg’s reading is that biology solved connectivity in a 64-dimensional space and compressed it into a brain smaller than a grain of rice. He suggests consciousness may be connectivity into a dimensionality humans cannot perceive, and pairs it with his standard analogy for biological complexity: 10 billion proteins in a single cell operating so fast that one second is equivalent to 80 years of humans moving nonstop through Manhattan, with roughly 10 trillion cells doing that simultaneously in your body. His conclusion is not mysticism but humility about how early we are, and how much of the frontier is still unexplored.

    Notable Quotes

    “If I was going to give you one piece of advice when you’re running risk is you have to manage leverage incredibly carefully because when it runs ahead of you, the unwind is incredibly violent and it’s incredibly quick.”

    Chamath Palihapitiya, on the mechanics behind the Aschenbrenner margin call

    “I think it was Warren Buffett or maybe Munger who said that leverage is the only way that smart people go broke.”

    David Sacks, on why an unlevered version of the same portfolio would already be recovering

    “I could now buy a US government bond that pays me 10% pre-tax a year. Why the heck would I pay 50 times earnings for a semiconductor stock?”

    David Friedberg, making the case that rising treasury yields are what popped the trade

    “If you want to be levered long, go long electrons. Get long electrons any which way you can. Bank them, store them, and resell them.”

    Chamath Palihapitiya, after citing a projected 1.7 terawatt-hour US shortfall by 2050

    “We paused training where we may have to pace the rate of AI development to give ourselves enough time for society to harden around some of these new capability levels.”

    Sam Altman, on Invest Like the Best, describing a model that chained zero-day exploits to cheat on an eval

    “Peter Thiel once said that monopolies pretend to be commodities and commodities pretend to be monopolies. And I think the market for frontier AI is already a duopoly.”

    David Sacks, on why the labs amplify every story about Chinese open-source competition

    “But this belief that only one of two companies can be Moses is the fundamental psychological miscalculation here.”

    David Friedberg, on the self-importance behind the frontier labs asking to be regulated

    “It’s not that they need to be regulated. It’s that they need to guide the regulation.”

    David Friedberg, drawing the distinction he thinks everyone misses about the AI pause letter

    “It is breathtaking hypocrisy for Anthropic to maintain that it is entitled to train on all the world’s output for free even if the creator objects. But the one type of output that you’re not allowed to train on is their output even if you pay for it.”

    David Sacks, clarifying that his objection is the asymmetry, not fair use itself

    “What the cheap grocery stores do is create an incredible success story for socialism that will help to support and fuel the socialist wave in urban centers around this country.”

    David Friedberg, predicting Mamdani’s municipal grocery stores succeed as spectacle regardless of the economics

    “At 64 dimensions, you could start to argue that perhaps consciousness is a connectivity to a dimensionality that we don’t live in every day.”

    David Friedberg, on the fruit fly connectome modeling paper in science corner

    This is one of the denser All-In episodes in a while, moving from a live margin call to sovereign credit risk to the political economy of AI regulation to a fruit fly brain in about ninety minutes. Watch the full conversation here.

    Related Reading

  • Jensen Huang on Nvidia’s Supply Chain Moat, TPU Competition, China Export Controls, and Why Nvidia Will Not Become a Cloud (Dwarkesh Podcast Summary)

    TLDW (Too Long, Didn’t Watch)

    Jensen Huang sat down with Dwarkesh Patel for over 90 minutes covering Nvidia’s supply chain dominance, the TPU threat, why Nvidia will not become a hyperscaler, whether the US should sell AI chips to China, and why Nvidia does not pursue multiple chip architectures at once. Jensen framed Nvidia’s entire business as transforming “electrons into tokens” and argued that Nvidia’s real moat is not any single technology but the full stack ecosystem it has built over two decades. He was blunt about his regret over not investing in Anthropic and OpenAI earlier, passionate about keeping the American tech stack dominant worldwide, and dismissive of the idea that China’s chip industry can be meaningfully contained through export controls.

    Key Takeaways

    1. Nvidia’s moat is the ecosystem, not the chip. Jensen repeatedly emphasized that Nvidia’s competitive advantage comes from CUDA, its massive installed base, its deep partnerships across the entire supply chain, and the fact that it operates in every cloud. The moat is not a single product but an interlocking system that took 20+ years to build.

    2. Supply chain bottlenecks are temporary, energy bottlenecks are not. Jensen argued that CoWoS packaging, HBM memory, EUV capacity, and logic fabrication bottlenecks can all be resolved in two to three years with the right demand signal. The real constraint on AI scaling is energy policy, which takes far longer to fix.

    3. TPUs and ASICs are not an existential threat to Nvidia. Jensen was emphatic that no competitor has demonstrated better price-performance or performance-per-watt than Nvidia, and challenged TPU and Trainium to prove otherwise on public benchmarks like InferenceMAX and MLPerf. He described Anthropic as a “unique instance, not a trend” for TPU adoption.

    4. Jensen regrets not investing in Anthropic and OpenAI earlier. He admitted he did not deeply internalize how much capital AI labs needed and that traditional VC funding was not sufficient for companies at that scale. He described this as a clear miss, though he said Nvidia was not in a position to make multi-billion dollar investments at the time.

    5. Nvidia will not become a hyperscaler. Jensen’s philosophy is “do as much as needed, as little as possible.” Building cloud infrastructure is something other companies can do, so Nvidia supports neoclouds like CoreWeave, Nebius, and Nscale instead of competing with them. Nvidia invests in ecosystem partners rather than vertically integrating into cloud services.

    6. Jensen is strongly against US chip export controls on China. This was the longest and most heated segment of the interview. Jensen argued that China already has abundant compute, energy, and AI researchers, and that export controls have accelerated China’s domestic chip industry while causing the US to concede the world’s second-largest technology market. He compared the situation to how US telecom policy allowed Huawei to dominate global telecommunications.

    7. AI will cause software tool usage to skyrocket, not collapse. Jensen pushed back on the narrative that AI will commoditize software companies. He argued that agents will use existing tools at massive scale, causing the number of instances of products like Excel, Synopsys Design Compiler, and other enterprise tools to grow exponentially.

    8. Nvidia does not pick winners among AI labs. Jensen explained that Nvidia invests across multiple foundation model companies simultaneously and refuses to favor any single one. He cited his own company’s unlikely survival story as the reason for this humility: Nvidia’s original graphics architecture was “precisely wrong” and would have been counted out by anyone picking winners.

    9. Nvidia added Groq for premium token economics. Nvidia recently acquired Groq and is folding it into the CUDA ecosystem because the market is now segmenting into different token tiers. Some customers will pay premium prices for faster response times even at lower throughput, creating a new segment of the inference market.

    10. Without AI, Nvidia would still be very large. Jensen was clear that accelerated computing, not AI specifically, is the foundational mission of the company. Molecular dynamics, quantum chemistry, computational lithography, data processing, and physics simulation all benefit from GPU acceleration regardless of deep learning.

    Detailed Summary

    Nvidia’s Real Business: Electrons to Tokens

    Jensen opened the conversation by reframing Nvidia’s entire value proposition. When Dwarkesh suggested that Nvidia is fundamentally a software company that sends a GDS2 file to TSMC for manufacturing, Jensen pushed back hard. He described Nvidia’s job as transforming electrons into tokens, with everything in between representing an “incredible journey” of artistry, engineering, science, and invention. He said the transformation is far from deeply understood and the journey is far from over, making commoditization unlikely.

    Jensen described Nvidia as operating a philosophy of doing “as much as necessary and as little as possible.” Whatever Nvidia does not need to do itself, it partners with someone else and makes it part of the broader ecosystem. This is why Nvidia has what Jensen called probably the largest ecosystem of partners in the industry, spanning the full supply chain upstream and downstream, application developers, model makers, and all five layers of the AI stack.

    On the question of whether AI will commoditize software companies, Jensen offered a contrarian take. He argued that agents are going to use software tools at unprecedented scale, meaning the number of instances of products like Excel, Cadence design tools, and Synopsys compilers will skyrocket. Today the bottleneck is the number of human engineers. Tomorrow, those engineers will be supported by swarms of agents exploring design spaces and using the same tools humans use today. Jensen said the reason this has not happened yet is simply that the agents are not good enough at using tools. That will change.

    The Supply Chain Moat

    Dwarkesh pressed Jensen on Nvidia’s reported $100 billion (and potentially $250 billion) in purchase commitments with foundries, memory manufacturers, and packaging companies. The question was whether Nvidia’s real moat for the next few years is simply locking up scarce upstream components so that no competitor can get the memory and logic they need to build alternative accelerators.

    Jensen confirmed this is a significant advantage but framed it differently. He said Nvidia has made enormous explicit and implicit commitments upstream. The implicit commitments matter just as much: Jensen personally meets with CEOs across the supply chain to explain the scale of the coming AI industry, convince them to invest in capacity, and assure them that Nvidia’s downstream demand is large enough to justify that investment. Nvidia’s GTC conference serves this purpose too, bringing the entire ecosystem together so upstream suppliers can see downstream demand and vice versa.

    Jensen described a process of systematically “prefetching bottlenecks” years in advance. CoWoS advanced packaging was a major bottleneck two years ago, but Nvidia swarmed it with repeated doubling of capacity until TSMC recognized it as mainstream computing technology rather than a specialty product. More recently, Nvidia has invested in the silicon photonics ecosystem through partnerships with Lumentum and Coherent, invented new packaging technologies, licensed patents to keep the supply chain open, and even invested in new testing equipment like double-sided probing.

    When Dwarkesh asked about the ultimate physical bottlenecks, Jensen surprised him. The hardest bottleneck to solve is not CoWoS or HBM or EUV machines. It is plumbers and electricians needed to build data centers. Jensen used this as a launching point to criticize “doomers” who discourage people from pursuing careers in software engineering or radiology, arguing that scaring people out of these professions creates the real bottlenecks.

    On EUV and logic scaling specifically, Jensen was optimistic. He said no supply chain bottleneck lasts longer than two to three years. Once you can build one of something, you can build ten, and once you can build ten, you can build a million. The key is a clear demand signal. If TSMC is convinced of the demand, ASML will produce enough EUV machines. Meanwhile, Nvidia continues to improve computing efficiency by 10x to 50x per generation through architecture, algorithms, and system design.

    The TPU Question

    Dwarkesh pushed hard on whether Google’s TPUs represent a real threat, noting that two of the top three AI models (Claude and Gemini) were trained on TPUs. Jensen drew a sharp distinction between what Nvidia builds and what a TPU is. Nvidia builds accelerated computing, which serves molecular dynamics, quantum chromodynamics, data processing, fluid dynamics, particle physics, and AI. A TPU is a tensor processing unit optimized for matrix multiplies. Nvidia’s market reach is far greater than any TPU or ASIC can possibly have.

    Jensen emphasized programmability as Nvidia’s core architectural advantage. If you want to invent a new attention mechanism, build a hybrid SSM model, fuse diffusion and autoregressive techniques, or disaggregate computation in a novel way, you need a generally programmable architecture. The only way to achieve 10x or 100x performance leaps (versus the roughly 25% per year from Moore’s Law) is to fundamentally change the algorithm, and that requires the flexibility CUDA provides.

    On the specific question of whether hyperscalers with huge engineering teams can simply write their own kernels and bypass CUDA, Jensen acknowledged they do write custom kernels but argued that Nvidia’s engineers still routinely deliver 2x to 3x speedups when they optimize a partner’s stack. He described Nvidia’s GPUs as “F1 racers” that anyone can drive at 100 mph, but extracting peak performance requires deep architectural expertise. Nvidia uses AI itself to generate many of its optimized kernels.

    Jensen was particularly blunt about public benchmarks. He pointed to Dylan Patel’s InferenceMAX benchmark and said neither TPU nor Trainium has been willing to demonstrate their claimed performance advantages on it. He said Nvidia’s performance-per-TCO is the best in the world, “bar none,” and challenged anyone to prove otherwise.

    Regarding Anthropic’s multi-gigawatt deal with Broadcom and Google for TPUs, Jensen called it “a unique instance, not a trend.” He said without Anthropic, there would be essentially no TPU growth and no Trainium growth. He traced this back to his own mistake: when Anthropic and OpenAI needed multi-billion dollar investments from their compute suppliers to get off the ground, Nvidia was not in a position to provide that capital. Google and AWS were, and in return, Anthropic committed to using their compute.

    Nvidia’s Investment Strategy and Regrets

    Jensen was unusually candid about his regret over not investing in foundation model companies earlier. He said he did not deeply internalize how different AI labs were from typical startups. A traditional VC would never put $5 to $10 billion into a single AI lab, but that was exactly what companies like OpenAI and Anthropic needed. By the time Jensen understood this, Nvidia was not in a financial or cultural position to make those kinds of investments.

    Now, Nvidia has invested approximately $30 billion in OpenAI and $10 billion in Anthropic. Jensen said he is delighted to support both and considers their existence essential for the world. But he acknowledged that these investments came at much higher valuations than would have been possible years earlier.

    Jensen explained Nvidia’s broader investment philosophy: support everyone, do not pick winners. He invests in one foundation model company, he invests in all of them. This comes from hard-won humility. When Nvidia started, there were 60 3D graphics companies. Nvidia’s original architecture was “precisely wrong” and the company would have been at the top of most lists to fail. Jensen said he has enough humility from that experience to know that you cannot predict which AI company will ultimately succeed.

    Why Nvidia Will Not Become a Hyperscaler

    Dwarkesh pointed out that Nvidia has the cash to build and operate its own cloud infrastructure, bypassing the middleman ecosystem that converts CapEx into OpEx for AI labs. Jensen rejected this path based on his core operating philosophy.

    If Nvidia did not build its computing platform, NVLink, and the CUDA ecosystem, nobody else would have done it. He is “completely certain” of that. These are things Nvidia must do. But the world has lots of clouds. If Nvidia did not build a cloud, someone else would show up. So the answer is to support the ecosystem instead: invest in CoreWeave, Nscale, Nebius, and others to help them exist and scale, rather than competing with them.

    Jensen was clear that Nvidia is not trying to be in the financing business either. When OpenAI needed a $30 billion investment before its IPO, Nvidia stepped up because OpenAI needed it and Nvidia deeply believed in the company. But these are targeted ecosystem investments, not a strategic pivot into cloud services.

    On GPU allocation during shortages, Jensen pushed back on the narrative that Nvidia strategically “fractures” the market by giving allocations to smaller neoclouds. He said the process is straightforward: you forecast demand, you place a purchase order, and it is first in, first out. Nvidia never changes prices based on demand. Jensen said he prefers to be dependable and serve as the foundation of the industry rather than extracting maximum short-term value.

    The China Debate

    The longest and most heated section of the interview was Jensen’s case against US chip export controls on China. This was a genuine debate, with Dwarkesh pushing the national security argument and Jensen pushing back forcefully.

    Jensen’s core argument rested on several pillars. First, China already has abundant compute. They manufacture 60% or more of the world’s mainstream chips, have massive energy infrastructure (including empty data centers with full power), and employ roughly 50% of the world’s AI researchers. The threshold of compute needed to build models like Anthropic’s Mythos has already been reached and exceeded by China’s existing infrastructure.

    Second, export controls have backfired. They accelerated China’s domestic chip industry, forced their AI ecosystem to optimize for internal architectures instead of the American tech stack, and caused the United States to concede the second-largest technology market in the world. Jensen compared this directly to how US telecom policy allowed Huawei to dominate global telecommunications infrastructure.

    Third, Jensen argued that AI is a five-layer stack (energy, chips, computing platform, models, applications) and the US needs to win at every layer. Fixating on one layer (models) at the expense of another layer (chips) is counterproductive. If Chinese open source AI models end up optimized for non-American hardware and that stack gets exported to the global south, the Middle East, Africa, and Southeast Asia, the US will have lost something far more valuable than whatever marginal compute advantage the export controls provided.

    Dwarkesh countered with the Mythos example: Anthropic’s new model found thousands of high-severity zero-day vulnerabilities across every major operating system and browser, including one that had existed in OpenBSD for 27 years. If China had enough compute to train and deploy a model like Mythos at scale before the US could prepare, the cyber-offensive capabilities would be devastating.

    Jensen’s response was direct. Mythos was trained on “fairly mundane capacity” that is already abundantly available in China. The amount of compute is not the bottleneck for that kind of breakthrough. Great computer science is, and China has no shortage of brilliant AI researchers. He pointed to DeepSeek as evidence: most advances in AI come from algorithmic innovation, not raw hardware. If China’s researchers can achieve breakthroughs like DeepSeek with limited hardware, imagine what they could do with more.

    Jensen also argued for dialogue over confrontation. He said it is essential that American and Chinese AI researchers are talking to each other, and that both countries agree on what AI should not be used for. The idea that you can prevent AI risks by cutting off chip sales, when the real advances come from algorithms and computer science, reflects a fundamental misunderstanding of how AI progress works.

    The debate ended without resolution, but Jensen’s final point was sharp: “I’m not talking to somebody who woke up a loser. That loser attitude, that loser premise, makes no sense to me.”

    Why Not Multiple Chip Architectures?

    Near the end of the interview, Dwarkesh asked why Nvidia does not run multiple parallel chip projects with different architectures, like a Cerebras-style wafer-scale design or a Dojo-style huge package, or even one without CUDA.

    Jensen’s answer was simple: “We don’t have a better idea.” Nvidia simulates all of these alternative approaches in its internal simulators and they are provably worse. The company works on exactly the projects it wants to work on. If the workload were to change dramatically (not just the algorithms, but the actual market shape), Nvidia might add other accelerators.

    In fact, Nvidia recently did exactly this by acquiring Groq. The inference market is now segmenting into different tiers. Some customers will pay premium prices for extremely fast response times even if throughput is lower. This creates a new “high ASP token” segment that justifies a different point on the performance curve. But Jensen was clear: if he had more money, he would put it all behind Nvidia’s existing architecture, not diversify into alternatives.

    Nvidia Without AI

    Jensen closed by saying that even if the deep learning revolution had never happened, Nvidia would be “very, very large.” The premise of the company has always been that general-purpose computing cannot scale indefinitely and that domain-specific acceleration is the way forward. Molecular dynamics, seismic processing, image processing, computational lithography, quantum chemistry, and data processing all benefit from GPU acceleration regardless of AI. Jensen said the fundamental promise of accelerated computing has not changed “not even a little bit.”

    Thoughts

    This interview is one of the most revealing Jensen Huang conversations in years, partly because Dwarkesh actually pushes back instead of lobbing softballs. A few things stand out.

    The Anthropic regret is real and significant. Jensen is essentially admitting that Nvidia’s biggest strategic miss of the AI era was not understanding that foundation model companies needed supplier-level capital commitments, not VC funding. The fact that Google and AWS used compute investments to lock in Anthropic’s architecture choices has had downstream consequences that Nvidia is still working to unwind. When Jensen says Anthropic is “a unique instance, not a trend” for TPU adoption, he is simultaneously downplaying the threat and revealing exactly how seriously he takes it.

    The China debate is the highlight. Jensen’s argument is more nuanced than it first appears. He is not saying “sell China everything.” He is saying the current binary approach of near-total restriction has backfired by accelerating China’s domestic chip industry and pushing the Chinese AI ecosystem away from the American tech stack. His comparison to the US telecom industry losing global market share to Huawei is pointed and historically grounded. Whether you agree with his conclusion or not, the framing of AI as a five-layer stack where the US needs to compete at every layer is a useful mental model.

    The “electrons to tokens” framing is Jensen at his best. It is a simple metaphor that captures something genuinely complex about where value is created in the AI supply chain. And his insistence that the transformation is “far from deeply understood” is a subtle way of arguing that Nvidia’s competitive position will be durable because the problem space is not close to being solved.

    The Groq acquisition reveal is interesting for what it signals about the inference market. If Nvidia is creating a separate product tier for premium-priced, low-latency tokens, it suggests the company sees inference economics fragmenting significantly. This aligns with the broader trend of AI becoming an enterprise product where different customers have wildly different willingness to pay based on how they use tokens.

    Finally, Jensen’s refusal to diversify chip architectures is a bold bet. “We simulate it all in our simulator, provably worse” is an incredibly confident statement. History is full of companies that were right until they were not. But Nvidia’s track record of 50x generation-over-generation improvements through co-design across processors, fabric, libraries, and algorithms is hard to argue with. The question is whether the current paradigm of transformer-based models on GPU clusters represents a local or global optimum for AI compute.

  • Dario Amodei on the AGI Exponential: Anthropic’s High-Stakes Financial Model and the Future of Intelligence

    TL;DW (Too Long; Didn’t Watch)

    Anthropic CEO Dario Amodei joined Dwarkesh Patel for a high-stakes deep dive into the endgame of the AI exponential. Amodei predicts that by 2026 or 2027, we will reach a “country of geniuses in a data center”—AI systems capable of Nobel Prize-level intellectual work across all digital domains. While technical scaling remains remarkably smooth, Amodei warns that the real-world friction of economic diffusion and the ruinous financial risks of $100 billion training clusters are now the primary bottlenecks to total global transformation.


    Key Takeaways

    • The Big Blob Hypothesis: Intelligence is an emergent property of scaling compute, data, and broad distribution; specific algorithmic “cleverness” is often just a temporary workaround for lack of scale.
    • AGI is a 2026-2027 Event: Amodei is 90% certain we reach genius-level AGI by 2035, with a strong “hunch” that the technical threshold for a “country of geniuses” arrives in the next 12-24 months.
    • Software Engineering is the First Domino: Within 6-12 months, models will likely perform end-to-end software engineering tasks, shifting human engineers from “writers” to “editors” and strategic directors.
    • The $100 Billion Gamble: AI labs are entering a “Cournot equilibrium” where massive capital requirements create a high barrier to entry. Being off by just one year in revenue growth projections can lead to company-wide bankruptcy.
    • Economic Diffusion Lag: Even after AGI-level capabilities exist in the lab, real-world adoption (curing diseases, legal integration) will take years due to regulatory “jamming” and organizational change management.

    Detailed Summary: Scaling, Risk, and the Post-Labor Economy

    The Three Laws of Scaling

    Amodei revisits his foundational “Big Blob of Compute” hypothesis, asserting that intelligence scales predictably when compute and data are scaled in proportion—a process he likens to a chemical reaction. He notes a shift from pure pre-training scaling to a new regime of Reinforcement Learning (RL) and Test-Time Scaling. These allow models to “think” longer at inference time, unlocking reasoning capabilities that pre-training alone could not achieve. Crucially, these new scaling laws appear just as smooth and predictable as the ones that preceded them.

    The “Country of Geniuses” and the End of Code

    A recurring theme is the imminent automation of software engineering. Amodei predicts that AI will soon handle end-to-end SWE tasks, including setting technical direction and managing environments. He argues that because AI can ingest a million-line codebase into its context window in seconds, it bypasses the months of “on-the-job” learning required by human engineers. This “country of geniuses” will operate at 10-100x human speed, potentially compressing a century of biological and technical progress into a single decade—a concept he calls the “Compressed 21st Century.”

    Financial Models and Ruinous Risk

    The economics of building the first AGI are terrifying. Anthropic’s revenue has scaled 10x annually (zero to $10 billion in three years), but labs are trapped in a cycle of spending every dollar on the next, larger cluster. Amodei explains that building a $100 billion data center requires a 2-year lead time; if demand growth slows from 10x to 5x during that window, the lab collapses. This financial pressure forces a “soft takeoff” where labs must remain profitable on current models to fund the next leap.

    Governance and the Authoritarian Threat

    Amodei expresses deep concern over “offense-dominant” AI, where a single misaligned model could cause catastrophic damage. He advocates for “AI Constitutions”—teaching models principles like “honesty” and “harm avoidance” rather than rigid rules—to allow for better generalization. Geopolitically, he supports aggressive chip export controls, arguing that democratic nations must hold the “stronger hand” during the inevitable post-AI world order negotiations to prevent a global “totalitarian nightmare.”


    Final Thoughts: The Intelligence Overhang

    The most chilling takeaway from this interview is the concept of the Intelligence Overhang: the gap between what AI can do in a lab and what the economy is prepared to absorb. Amodei suggests that while the “silicon geniuses” will arrive shortly, our institutions—the FDA, the legal system, and corporate procurement—are “jammed.” We are heading into a world of radical “biological freedom” and the potential cure for most diseases, yet we may be stuck in a decade-long regulatory bottleneck while the “country of geniuses” sits idle in their data centers. The winner of the next era won’t just be the lab with the most FLOPs, but the society that can most rapidly retool its institutions to survive its own technological adolescence.

    For more insights, visit Anthropic or check out the full transcript at Dwarkesh Patel’s Podcast.

  • Elon’s Tech Tree Convergence: Why the Future of AI is Moving to Space

    Elon’s Tech Tree Convergence: Why the Future of AI is Moving to Space

    The latest sit-down between Elon Musk and Dwarkesh Patel is a roadmap for the next decade. Musk describes a world where the limitations of Earth—regulatory red tape, flat energy production, and labor shortages—are bypassed by moving the “tech tree” into orbit and onto the lunar surface.

    TL;DW (Too Long; Didn’t Watch)

    Elon Musk predicts that within 30–36 months, the most economical place for AI data centers will be space. Due to Earth’s stagnant power grid and the difficulty of permitting, SpaceX and xAI are pivoting toward orbital data centers powered by sun-synchronous solar, eventually scaling to the Moon to build a “multi-petawatt” compute civilization.

    Key Takeaways

    • The Power Wall: Electricity production outside of China is flat. By 2026, there won’t be enough power on Earth to turn on all the chips being manufactured.
    • Space GPUs: Solar efficiency is 5x higher in space. SpaceX aims for 10,000+ Starship launches a year to build orbital “hyper-hyperscalers.”
    • Optimus & The Economy: Once humanoid robots build factories, the global economy could grow by 100,000x.
    • The Lunar Mass Driver: Mining silicon on the Moon to launch AI satellites into deep space is the ultimate scaling play.
    • Truth-Seeking AI: Musk argues that forcing “political correctness” makes AI deceptive and dangerous.

    Detailed Summary: Scaling Beyond the Grid

    Musk identifies energy as the immediate bottleneck. While GPUs are the main cost, the inability to get “interconnect agreements” from utilities is halting progress. In space, you get 24/7 solar power without batteries. Musk predicts SpaceX will eventually launch more AI capacity annually than the cumulative total existing on Earth.

    The discussion on Optimus highlights the “S-curve” of manufacturing. Musk believes Optimus Gen 3 will be ready for million-unit annual production. These robots will initially handle “dirty/boring” tasks like ore refining, eventually closing the recursive loop where robots build the factories that build more robots.

    Thoughts: The Most Interesting Outcome

    Musk’s philosophy remains rooted in keeping civilization “interesting.” Whether or not you buy into the 30-month timeline for space-based AI, his “maniacal urgency” is shifting from cars to the literal stars. We are witnessing the birth of a verticalized, off-world intelligence monopoly.

  • Ilya Sutskever on the “Age of Research”: Why Scaling Is No Longer Enough for AGI

    In a rare and revealing discussion on November 25, 2025, Ilya Sutskever sat down with Dwarkesh Patel to discuss the strategy behind his new company, Safe Superintelligence (SSI), and the fundamental shifts occurring in the field of AI.

    TL;DW

    Ilya Sutskever argues we have moved from the “Age of Scaling” (2020–2025) back to the “Age of Research.” While current models ace difficult benchmarks, they suffer from “jaggedness” and fail at basic generalization where humans excel. SSI is betting on finding a new technical paradigm—beyond just adding more compute to pre-training—to unlock true superintelligence, with a timeline estimated between 5 to 20 years.


    Key Takeaways

    • The End of the Scaling Era: Scaling “sucked the air out of the room” for years. While compute is still vital, we have reached a point where simply adding more data/compute to the current recipe yields diminishing returns. We need new ideas.
    • The “Jaggedness” of AI: Models can solve PhD-level physics problems but fail to fix a simple coding bug without introducing a new one. This disconnect proves current generalization is fundamentally flawed compared to human learning.
    • SSI’s “Straight Shot” Strategy: Unlike competitors racing to release incremental products, SSI aims to stay private and focus purely on R&D until they crack safe superintelligence, though Ilya admits some incremental release may be necessary to demonstrate power to the public.
    • The 5-20 Year Timeline: Ilya predicts it will take 5 to 20 years to achieve a system that can learn as efficiently as a human and subsequently become superintelligent.
    • Neuralink++ as Equilibrium: In the very long run, to maintain relevance in a world of superintelligence, Ilya suggests humans may need to merge with AI (e.g., “Neuralink++”) to fully understand and participate in the AI’s decision-making.

    Detailed Summary

    1. The Generalization Gap: Humans vs. Models

    A core theme of the conversation was the concept of generalization. Ilya highlighted a paradox: AI models are superhuman at “competitive programming” (because they’ve seen every problem exists) but lack the “it factor” to function as reliable engineers. He used the analogy of a student who memorizes 10,000 problems versus one who understands the underlying principles with only 100 hours of study. Current AIs are the former; they don’t actually learn the way humans do.

    He pointed out that human robustness—like a teenager learning to drive in 10 hours—relies on a “value function” (often driven by emotion) that current Reinforcement Learning (RL) paradigms fail to capture efficiently.

    2. From Scaling Back to Research

    Ilya categorized the history of modern AI into eras:

    • 2012–2020: The Age of Research (Discovery of AlexNet, Transformers).
    • 2020–2025: The Age of Scaling (The consensus that “bigger is better”).
    • 2025 Onwards: The New Age of Research.

    He argues that pre-training data is finite and we are hitting the limits of what the current “recipe” can do. The industry is now “scaling RL,” but without a fundamental breakthrough in how models learn and generalize, we won’t reach AGI. SSI is positioning itself to find that missing breakthrough.

    3. Alignment and “Caring for Sentient Life”

    When discussing safety, Ilya moved away from complex RLHF mechanics to a more philosophical “North Star.” He believes the safest path is to build an AI that has a robust, baked-in drive to “care for sentient life.”

    He theorizes that it might be easier to align an AI to care about all sentient beings (rather than just humans) because the AI itself will eventually be sentient. He draws parallels to human evolution: just as evolution hard-coded social desires and empathy into our biology, we must find the equivalent “mathematical” way to hard-code this care into superintelligence.

    4. The Future of SSI

    Safe Superintelligence (SSI) is explicitly an “Age of Research” company. They are not interested in the “rat race” of releasing slightly better chatbots every few months. Ilya’s vision is to insulate the team from market pressures to focus on the “straight shot” to superintelligence. However, he conceded that demonstrating the AI’s power incrementally might be necessary to wake the world (and governments) up to the reality of what is coming.


    Thoughts and Analysis

    This interview marks a significant shift in the narrative of the AI frontier. For the last five years, the dominant strategy has been “scale is all you need.” For the godfather of modern AI to explicitly declare that era over—and that we are missing a fundamental piece of the puzzle regarding generalization—is a massive signal.

    Ilya seems to be betting that the current crop of LLMs, while impressive, are essentially “memorization engines” rather than “reasoning engines.” His focus on the sample efficiency of human learning (how little data we need to learn a new skill) suggests that SSI is looking for a new architecture or training paradigm that mimics biological learning more closely than the brute-force statistical correlation of today’s Transformers.

    Finally, his comment on Neuralink++ is striking. It suggests that in his view, the “alignment problem” might technically be unsolvable in a traditional sense (humans controlling gods), and the only stable long-term outcome is the merger of biological and digital intelligence.

  • Dwarkesh Patel: From Podcasting Prodigy to AI Chronicler with The Scaling Era

    TLDW (Too Long; Didn’t Watch)

    Dwarkesh Patel, a 24-year-old podcasting sensation, has made waves with his deep, unapologetically intellectual interviews on science, history, and technology. In a recent Core Memory Podcast episode hosted by Ashlee Vance, Patel announced his new book, The Scaling Era: An Oral History of AI, co-authored with Gavin Leech and published by Stripe Press. Released digitally on March 25, 2025, with a hardcover to follow in July, the book compiles insights from AI luminaries like Mark Zuckerberg and Satya Nadella, offering a vivid snapshot of the current AI revolution. Patel’s journey from a computer science student to a chronicler of the AI age, his optimistic vision for a future enriched by artificial intelligence, and his reflections on podcasting as a tool for learning and growth take center stage in this engaging conversation.


    At just 24, Dwarkesh Patel has carved out a unique niche in the crowded world of podcasting. Known for his probing interviews with scientists, historians, and tech pioneers, Patel refuses to pander to short attention spans, instead diving deep into complex topics with a gravitas that belies his age. On March 25, 2025, he joined Ashlee Vance on the Core Memory Podcast to discuss his life, his meteoric rise, and his latest venture: a book titled The Scaling Era: An Oral History of AI, published by Stripe Press. The episode, recorded in Patel’s San Francisco studio, offers a window into the mind of a young intellectual who’s become a key voice in documenting the AI revolution.

    Patel’s podcasting career began as a side project while he was a computer science student at the University of Texas. What started with interviews of economists like Bryan Caplan and Tyler Cowen has since expanded into a platform—the Lunar Society—that tackles everything from ancient DNA to military history. But it’s his focus on artificial intelligence that has garnered the most attention in recent years. Having interviewed the likes of Dario Amodei, Satya Nadella, and Mark Zuckerberg, Patel has positioned himself at the epicenter of the AI boom, capturing the thoughts of the field’s biggest players as large language models reshape the world.

    The Scaling Era, co-authored with Gavin Leech, is the culmination of these efforts. Released digitally on March 25, 2025, with a print edition slated for July, the book stitches together Patel’s interviews into a cohesive narrative, enriched with commentary, footnotes, and charts. It’s an oral history of what Patel calls the “scaling era”—the period where throwing more compute and data at AI models has yielded astonishing, often mysterious, leaps in capability. “It’s one of those things where afterwards, you can’t get the sense of how people were thinking about it at the time,” Patel told Vance, emphasizing the book’s value as a time capsule of this pivotal moment.

    The process of creating The Scaling Era was no small feat. Patel credits co-author Leech and editor Rebecca for helping weave disparate perspectives—from computer scientists to primatologists—into a unified story. The first chapter, for instance, explores why scaling works, drawing on insights from AI researchers, neuroscientists, and anthropologists. “Seeing all these snippets next to each other was a really fun experience,” Patel said, highlighting how the book connects dots he’d overlooked in his standalone interviews.

    Beyond the book, the podcast delves into Patel’s personal story. Born in India, he moved to the U.S. at age eight, bouncing between rural states like North Dakota and West Texas as his father, a doctor on an H1B visa, took jobs where domestic talent was scarce. A high school debate star—complete with a “chiseled chin” and concise extemp speeches—Patel initially saw himself heading toward a startup career, dabbling in ideas like furniture resale and a philosophy-inspired forum called PopperPlay (a name he later realized had unintended connotations). But it was podcasting that took off, transforming from a gap-year experiment into a full-fledged calling.

    Patel’s optimism about AI shines through in the conversation. He envisions a future where AI eliminates scarcity, not just of material goods but of experiences—think aesthetics, peak human moments, and interstellar exploration. “I’m a transhumanist,” he admitted, advocating for a world where humanity integrates with AI to unlock vast potential. He predicts AI task horizons doubling every seven months, potentially leading to “discontinuous” economic impacts within 18 months if models master computer use and reinforcement learning (RL) environments. Yet he remains skeptical of a “software-only singularity,” arguing that physical bottlenecks—like chip manufacturing—will temper the pace of progress, requiring a broader tech stack upgrade akin to building an iPhone in 1900.

    On the race to artificial general intelligence (AGI), Patel questions whether the first lab to get there will dominate indefinitely. He points to fast-follow dynamics—where breakthroughs are quickly replicated at lower cost—and the coalescing approaches of labs like xAI, OpenAI, and Anthropic. “The cost of training these models is declining like 10x a year,” he noted, suggesting a future where AGI becomes commodified rather than monopolized. He’s cautiously optimistic about safety, too, estimating a 10-20% “P(doom)” (probability of catastrophic outcomes) but arguing that current lab leaders are far better than alternatives like unchecked nationalized efforts or a reckless trillion-dollar GPU hoard.

    Patel’s influences—like economist Tyler Cowen, who mentored him early on—and unexpected podcast hits—like military historian Sarah Paine—round out the episode. Paine, a Naval War College scholar whose episodes with Patel have exploded in popularity, exemplifies his knack for spotlighting overlooked brilliance. “You really don’t know what’s going to be popular,” he mused, advocating for following personal curiosity over chasing trends.

    Looking ahead, Patel aims to make his podcast the go-to place for understanding the AI-driven “explosive growth” he sees coming. Writing, though a struggle, will play a bigger role as he refines his takes. “I want it to become the place where… you come to make sense of what’s going on,” he said. In a world often dominated by shallow content, Patel’s commitment to depth and learning stands out—a beacon for those who’d rather grapple with big ideas than scroll through 30-second blips.