PJFP.com

Pursuit of Joy, Fulfillment, and Purpose

Tag: disaggregated inference

  • Gavin Baker on Orbital Compute, TSMC, Frontier AI Models, Anthropic’s Vertical Take Off, and the Coming Wafer Shortage

    Gavin Baker, founder and CIO of Atreides Management, returns to Patrick O’Shaughnessy’s Invest Like the Best for his sixth appearance. He calls the current AI moment the most extraordinary moment in the history of capitalism, walks through what Anthropic’s vertical takeoff in revenue actually means, lays out why orbital compute is closer than skeptics believe, dissects the TSMC bottleneck that may be the only thing standing between today’s market and a full-on AI bubble, and rates every hyperscaler on how they have positioned for a world where frontier model providers may stop selling API access altogether.

    TLDW

    Anthropic added eleven billion dollars of ARR in a single month, which is roughly the combined business of Palantir, Snowflake, and Databricks built over a decade. That is the setup. From there Gavin Baker covers the March and April selloff, the contrarian read that a closed Strait of Hormuz was actually bullish for American manufacturing competitiveness, why Anthropic and OpenAI multiples may be misleadingly cheap on an unconstrained run rate basis, why Elon Musk’s discipline on SpaceX valuation created a superpower of permanent access to capital, the practical engineering case for orbital compute as racks in space rather than Pentagon sized space stations, why TSMC’s capacity discipline is the single most important variable in whether the AI cycle becomes a bubble, what Terafab in Texas changes, why the Pareto frontier of AI models has flipped from Google dominance to Anthropic and OpenAI dominance in nine months, the shift from all you can eat AI subscriptions to usage based pricing and what that means for revenue scaling, Richard Sutton’s bitter lesson as the largest risk to the AI trade, why frontier tokens still capture an overwhelming share of economic value, the role of continual learning as the third great open question, why most new chip startups should not try to build a better GPU, why Cerebras did something different and hard, why disaggregated inference may extend GPU useful lives to ten or fifteen years and rescue the private credit industry, why being in the token path is the new venture filter, the new prisoner’s dilemma around releasing frontier models via API, an honest rating of Google, Meta, Amazon, and Microsoft, why personal safety is becoming a real AI era risk, and why he remains an AI optimist maximalist who believes this could be the next Pax Americana.

    Key Takeaways

    • Anthropic added eleven billion dollars of ARR in one month, more than the combined businesses of Palantir, Snowflake, and Databricks built across a decade. There is no precedent for this in the history of capitalism.
    • The SaaS and cloud revolution created between five and ten trillion dollars of value over twenty years. AI is replaying that compression on a timeline measured in months.
    • The March selloff was a drawdown driven by disagreement with price action, not invalidated thesis. That is the kind of drawdown an investor can lean into.
    • Deep Seek Monday in January 2025 was a similar setup. By the day of the selloff, AWS Asia GPU prices had already doubled, GPU availability had fallen, and it was obvious reasoning models would be vastly more compute hungry at inference. The market priced the opposite.
    • The Strait of Hormuz closing was actually positive for America. US natural gas (the primary input into US electricity, which feeds AI) fell twenty percent on Bloomberg while Asian and European natural gas doubled or tripled. American manufacturing competitiveness improved overnight.
    • The US is now the world’s largest producer and exporter of oil and gas. The economy is dramatically less energy intensive than in the 1970s. The shortage trauma comparison does not hold.
    • Tech as a sector traded as cheaply versus the rest of the market in early April as at any point in the last ten years, into the single most bullish moment for AI fundamentals on record.
    • Anthropic is dramatically more capital efficient than OpenAI, having burned roughly eighty percent less to reach a similar revenue scale. They have very different structural returns on invested capital.
    • Anthropic at roughly nine hundred billion for fifty billion of ARR (growing a thousand percent) is striking. Adjusted for compute constraint, the unconstrained run rate could be one hundred fifty to two hundred billion, putting the implied multiple closer to five times.
    • Claude Opus generates roughly seventy percent fewer tokens for the same question than previously, with token quantity tied to answer quality. Subscribers on flat-fee plans are getting a lobotomized model.
    • Elon Musk’s superpower is twenty years of making investors money. He never pushes valuation. SpaceX compounded low thirty percent per year for a decade because Musk treats fair pricing as a sacred covenant.
    • Capitalism will solve the watts shortage. The current bottleneck has shifted from chips and energy to zoning and political approval. Many capex decisions are paused until after the US midterms.
    • The watts shortage probably begins to alleviate in 2027 and 2028. Orbital compute solves it longer term.
    • Orbital compute is not Pentagon sized data centers in space. It is racks in space. A Blackwell rack is three thousand pounds, eight feet tall, four feet deep, three feet wide. SpaceX has shown a satellite roughly that size.
    • The satellites operate in sun synchronous orbit so solar wings (around five hundred feet per side) always face the sun and the radiator on the dark side always points to deep space.
    • Starlink V3 satellites already run at around twenty kilowatts. A Blackwell rack runs at one hundred kilowatts. SpaceX engineers express genuine confidence they have already solved cooling and radiator design at these scales.
    • Racks in space are connected with lasers traveling through vacuum, the same lasers already on every Starlink. SpaceX operates the world’s largest satellite fleet and, via xAI Colossus, the world’s largest data center on Earth.
    • Inference will move to orbit. Training will stay on Earth for a long time. Terrestrial data centers remain valuable for the rest of an investor’s career.
    • The wafer bottleneck is structural and political. TSMC is essentially Taiwan’s GDP, water, and electricity. The leaders see themselves as inheritors of Morris Chang’s sacred legacy and they do not behave like a Western public company.
    • Jensen Huang has never had a contract with TSMC. The relationship is run on handshakes and the assumption that things will be fair over time.
    • If TSMC did everything Jensen wanted, Nvidia could be selling two to three trillion dollars of GPUs in 2026 and 2027. TSMC’s discipline is the single largest factor preventing a true AI bubble.
    • Historically, foundational technologies always get a bubble. Railroads, canals, the internet. The current AI buildout is overwhelmingly funded out of operating cash flow, GPUs are running at one hundred percent utilization, and that is fundamentally different from the year 2000 fiber overbuild.
    • If one of Intel or Samsung Foundry catches up at the leading node, the other will follow, and TSMC’s discipline collapses. Watch TSMC capacity decisions to predict a bubble.
    • Terafab, the SpaceX and Tesla joint venture to build the world’s largest fab in America, has a partnership with Intel that grants access to fifty years of institutional foundry knowledge. The A teams at ASML, KLA, Lam Research, and Applied Materials will follow Elon’s reputation in hardware engineering.
    • The hiring playbook for Terafab includes building Taiwan Town, Japan Town, and Korea Town next to the fab. Recruit the engineers and import their families, their restaurants, and their staff.
    • Frontier tokens still capture an overwhelming share of all economic value created at the model layer. This is surprising and is one of the three big open questions for AI investing.
    • The Pareto frontier of intelligence versus cost has flipped. Nine months ago Google’s TPU dominated every point on the frontier. Today Anthropic and OpenAI dominate, with Grok 4.3 on the frontier and Gemini 3.1 hanging on.
    • Google’s conservative TPU V8 design (partly an attempt to reduce dependence on Broadcom and Nvidia) is the leading explanation for the loss of per token cost leadership.
    • AI pricing is shifting from all you can eat to usage based, mirroring the cellular and long distance industries. Cellular stopped being a great growth industry when it went all you can eat. AI just made the opposite move.
    • OpenAI and Anthropic together could exceed two hundred billion in ARR this year if compute keeps coming online and frontier token pricing holds.
    • The two hundred fifty dollar a month consumer AI plan is no longer enough to evaluate frontier capability. Enterprise plans with usage based billing are required because rate limits are now severe.
    • The three biggest open questions for AI investors are: violation of the bitter lesson via ASI or human ingenuity, whether frontier tokens keep commanding their premium, and when continual learning arrives.
    • Today’s continual learning is crude reinforcement learning during mid training on verifiable tasks. True continual learning means weights updating dynamically, like a human who learns the first time they touch fire.
    • Trying to build a better GPU is a losing strategy. Jensen will copy any one to three percent share design. Startups should target one percent share, do something different, and make it hard enough that Nvidia cannot fast follow.
    • Disaggregated inference (separating prefill and decode) opens new design canvases. Prefill is memory capacity bound. Decode is memory bandwidth bound. Each can be optimized independently.
    • Cerebras did something different and hard with wafer scale computing. Three generations of chips and real grit to get there.
    • Disaggregation of inference may stretch GPU useful lives to ten or fifteen years, dropping financing costs from low sevens to five or six percent, mathematically lowering the cost of the AI buildout and likely saving the private credit industry from its SaaS loan exposure.
    • Sellers of shortage outperform buyers of shortage. But owning the largest installed base of what is currently in shortage (hyperscaler CPU fleets, for example) is also a strong position.
    • Most of the economic value at the application layer of AI has been destroyed, not created. The exceptions are companies in the token path or in niches small enough that frontier labs ignore them.
    • Coding may be the shortest path to ASI. If you can write code, you can write code that does anything. Cursor, Cognition, and Anthropic correctly focused on it.
    • Jensen could probably get close to the frontier with his own Nemotron family of models whenever he wants. The fact that he chooses not to is a strategic decision about not commoditizing his customers.
    • The new prisoner’s dilemma in AI is whether frontier labs release their best model via API. If everyone agrees not to, Chinese open source falls behind. If anyone defects, the defector pulls ahead on revenue and resources, forcing everyone else to defect.
    • Google still owns the largest compute installed base. Without TPU’s prior cost advantage, this matters more. YouTube data has real value in a world of robotics. GCP is going crazy.
    • Meta deserves credit for becoming AI first internally faster than any other internet giant. Musa, their first MSL model, is impressively close to the Pareto frontier.
    • Amazon is strong because of Trainium and robotics driven retail P&L efficiency. Nova is better than it gets credit for.
    • Microsoft flinched on capex in early 2025 and lost position. Satya Nadella’s current decision to use Microsoft compute for Microsoft products rather than reselling to OpenAI is a courageous and probably correct call, even at the cost of an eight hundred dollar stock price.
    • The hyperscalers most engaged with startups are Amazon and Nvidia by a mile, followed by Google. Broadcom is the favorite ASIC partner. AMD, Microsoft, and Meta have minimal startup engagement and that will cost them as the best teams are now at startups.
    • Personal safety in an AI era requires a family or company safe word that cannot be socially engineered. Deepfake voice and video extortion at the speed of FaceTime is already feasible.
    • Ukraine is winning largely on the back of having the best battlefield AI outside America and Israel. Adversaries are starting to internalize what AI dominance means geopolitically.
    • An optimistic read is that this becomes a new Pax Americana, the way the post 1945 American nuclear monopoly was used to rebuild Germany and Japan rather than dominate.
    • AI cured a friend’s daughter’s rare disease by spinning up a research effort that identified a market drug capable of impacting her condition. That is the upside that keeps Gavin an AI optimist maximalist.

    Detailed Summary

    The most extraordinary moment in the history of capitalism

    Gavin’s framing of the current moment is unusually direct. Anthropic added eleven billion dollars of annual recurring revenue in a single month. The three highest profile SaaS companies of the last decade plus, Palantir, Snowflake, and Databricks, took a decade and tens of thousands of employees collectively to build the combined business that Anthropic added in thirty days. He has been investing through every major tech cycle and says there is no historical analog. Not the dotcom era, not the cloud transition, not mobile. This is its own thing.

    The market response, then, was peculiar. The NASDAQ sold off into the single most bullish moment for AI fundamentals on record. Tech traded at roughly its widest discount versus the rest of the market in a decade. Investors who said they wished they had bought into AI during 2022, during COVID, or during Deep Seek Monday got the same valuation setup again in early April, this time with an even clearer inflection.

    Why the Strait of Hormuz closing was secretly bullish for America

    One reason the macro fear in March may have been mispriced is that the same geopolitical event that drove the selloff was, in practice, a relative benefit to the United States. American natural gas, the input into American electricity, which is the input into American AI training and inference, fell roughly twenty percent. Asian and European natural gas prices doubled or tripled. The US emerged with sharply improved relative manufacturing competitiveness, which is exactly what the current administration cares about.

    The 1970s comparison does not hold. The US economy is dramatically less energy intensive, it is now the world’s largest producer and largest exporter of oil and gas, and there are no shortages, only price moves. That backdrop made it easier for disciplined investors to stay focused on AI fundamentals through the volatility.

    Anthropic and OpenAI valuations on an unconstrained run rate

    Anthropic at roughly nine hundred billion for fifty billion of ARR sounds rich until you adjust for the fact that the company is severely compute constrained. Gavin estimates that, unconstrained, Anthropic might be at one hundred fifty to two hundred billion in run rate revenue, putting the implied multiple closer to five times. He also points out that Claude Opus now generates roughly seventy percent fewer tokens for the same question than it used to. Token quantity correlates with answer quality, and Anthropic is rate limiting and shrinking outputs to ration capacity across its user base.

    Anthropic and OpenAI are also structurally very different. Anthropic has burned around eighty percent less cash than OpenAI to reach a comparable revenue scale. That implies very different long term returns on invested capital, though OpenAI has done a better job locking in compute and Sarah Friar is one of the most exceptional CFOs Gavin has worked with.

    Why neither lab is raising at a three trillion dollar valuation

    The answer Gavin gives is that both labs are deliberately leaving valuation on the table the way Elon has done for two decades. SpaceX compounded at low thirty percent annually for a decade because Elon never pushed price. The result is a permanent superpower of access to capital. Investors trust him because they have made money with him for twenty years. That is a moat that compounds with every round.

    Anthropic could probably raise at a one hundred percent premium to its rumored latest mark. They are choosing not to. In an uncertain world (Ukraine, Russia, Iran, Taiwan), preserving the ability to raise more capital later at fair prices is more valuable than maximizing this round.

    Watts and wafers, the two real constraints

    Capitalism is solving the watts problem. The leading PE infrastructure investors now say zoning and political approval, not chips or energy, are the gating factors. Companies are deferring big capex announcements until after the US midterms. Turbine capacity is being doubled at the manufacturers. Companies like Boom Aerospace are repurposing jet engines for grid use. Watts probably ease meaningfully in 2027 and 2028 and then orbital compute does the rest.

    Wafers are the harder problem because they live in Taiwan, run on handshakes, and depend on a corporate culture that does not respond to public market incentives. TSMC is essentially the GDP, water consumption, and electricity consumption of Taiwan. Its leadership treats the company as the legacy of Morris Chang. The Silicon Shield doctrine is real and internal.

    Orbital compute as racks in space

    The biggest mental update Gavin asks listeners to make is to stop picturing data centers in space as Pentagon sized space stations. A Blackwell rack is three thousand pounds and roughly the size of a refrigerator. SpaceX has shown a concept satellite of about that size. Solar wings extend five hundred feet to each side and the radiator extends hundreds of feet behind, both possible because the orbit is sun synchronous and the orientation is fixed relative to the sun.

    SpaceX engineers Gavin has spoken to at Starbase express genuine confidence that they have solved cooling at these power levels. They have. Starlink V3 satellites already operate at twenty kilowatts. A Blackwell rack is one hundred kilowatts. The same company operates the world’s largest satellite fleet and the world’s largest data center on Earth via xAI Colossus. The racks are connected to each other with lasers traveling through vacuum, technology already deployed in every Starlink. The naysayers, Gavin observes, are armchair skeptics and Larry Ellison’s response (he is out there landing rockets, no one else is) is the right frame.

    Terafab in Texas and the threat to TSMC’s discipline

    Terafab, the SpaceX and Tesla joint venture, intends to be the largest fab in the world. The partnership with Intel grants access to fifty years of foundry institutional knowledge, allowing Terafab to start three to five quarters behind the leading node rather than fifteen years behind. The A teams at the semicap equipment companies (ASML, KLA, Lam Research, Applied Materials) will follow Elon’s reputation in hardware engineering the same way they followed TSMC twenty years ago when Intel stumbled.

    The talent strategy is the part most observers underestimate. Recruit the best engineers globally, then import their families, their restaurants, their staff. Build Taiwan Town, Japan Town, and Korea Town next to the fab. Optimize the human experience for the people whose work matters. Intel and Samsung do not think that way.

    Bubble watch and the year 2000 comparison

    Every foundational technology in modern history has had a bubble. Railroads, canals, the internet. Carlota Perez documented why. Markets correctly identify the importance, diversity of opinion collapses, supply gets ahead of demand, the bubble crashes. The current cycle has two important differences. The buildout is overwhelmingly funded out of operating cash flow, not debt. Every GPU is running at one hundred percent utilization, while at the peak of the fiber bubble ninety nine percent of fiber was unused.

    TSMC discipline is the single largest reason a bubble has not formed. If Jensen could buy everything TSMC could theoretically make, Nvidia could sell two to three trillion dollars of GPUs in 2026 and 2027. At some point that becomes more than the market can absorb. If Intel or Samsung Foundry catches up at the leading node, the other will too. TSMC’s pricing discipline collapses and the bubble starts.

    The Pareto frontier and the loss of Google’s cost advantage

    The most important chart in AI is the Pareto frontier of model intelligence versus per token cost. Nine months ago, Google’s TPU based models dominated every point on it. OpenAI, Anthropic, and xAI sat inside the frontier. Today the frontier is dominated by Anthropic and OpenAI, with Grok 4.3 on the frontier and Gemini 3.1 hanging on by subsidization more than economics. The most likely cause is Google’s conservative TPU V8 design, an attempt to reduce dependence on Broadcom and Nvidia that sacrificed per token economics.

    The bitter lesson, frontier tokens, and continual learning

    Three open questions dominate AI investing. The first is whether Richard Sutton’s bitter lesson (more compute beats human algorithmic cleverness) gets violated by ASI itself optimizing for efficiency. Closer observers of AI are more skeptical of a violation. Gavin thinks ASI’s first move will be to make itself more efficient and more resourced, which is technically a temporary violation.

    The second is whether frontier tokens keep capturing the overwhelming share of economic value at the model layer. Today they do, surprisingly. Gemini 3.1 Pro was mindblowing nine months ago and is intolerable today. The third is when continual learning arrives. Today’s models need a million fire touches to learn what a human learns from one. True continual learning would mean dynamic weight updates in real time and would produce a fast takeoff.

    From all you can eat to usage based AI pricing

    AI is shifting from flat fee plans to usage based pricing. The historical analogy is cellular and long distance. Both stopped being great growth industries when they went all you can eat. AI just made the opposite move. The consequence is that flat fee subscribers, even on premium consumer plans, get a rate limited and token throttled version of the frontier model. Enterprise plans with usage based billing are now required to evaluate true capability. Gavin thinks the combination of new compute coming online and usage based pricing is what gets OpenAI and Anthropic past two hundred billion in combined ARR this year.

    Chip startups, prefill decode disaggregation, and Cerebras

    Trying to build a better GPU is the wrong move. The four scaled players (Nvidia, AMD, Trainium, TPU) have copy capability for any one to three percent share design that looks attractive. The good news for startups is that disaggregated inference (separating prefill and decode) opens a richer design canvas. Prefill is memory capacity bound. Decode is memory bandwidth bound. Each can be optimized independently. Andrew Fox’s analogy is a British naval ship of the eighteenth century. Prefill is loading the cannon. Decode is firing it.

    Cerebras is the model. Wafer scale computing is genuinely different and genuinely hard. It took three generations of chips to get right. Andrew Feldman and his team had the grit to keep going through chip one being a failure. The design has a high ratio of on chip compute and memory relative to shoreline IO, which is why Cerebras is now experimenting with putting an optical wafer on top of the compute wafer to solve scale out.

    GPU useful lives and the rescue of private credit

    One of the strongest claims in the conversation is that disaggregated inference will stretch GPU useful lives to ten or fifteen years. The skeptical narrative (GPUs are obsolete in two years, companies are cooking their depreciation books) is wrong. You can put a Cerebras system or Groq LPU in front of older Hopper or Ampere parts, use them only for prefill, and run them until they physically melt. Private credit, which is in pain from SaaS loans and which underwrote GPU loans on three to four year lives, may be saved by this.

    If GPU financing rates can come down from low sevens to five or six percent, the mathematics of the AI buildout improves materially. That is a structural tailwind that compounds for years.

    The application layer, the token path, and a new prisoner’s dilemma

    Trillions of dollars of value have been destroyed at the application layer, not created. Cursor and Cognition are the rare scaled exceptions, and they got there by focusing on coding very early. As Amjad Masad noted, coding is plausibly the shortest path to ASI because a coding agent can write itself into any new domain. Jamin Ball’s frame is that the new venture filter is whether the company is in the token path. Data Bricks is. Most application layer startups are not.

    Jensen could probably get close to the frontier with Nemotron whenever he wants, and the strategic question of whether to do that is a new prisoner’s dilemma. If every frontier lab agrees not to release best models via API, Chinese open source falls steadily behind. If anyone defects, the defector gains revenue and resources, and everyone else has to defect. The same dynamic exists between TSMC, Intel, and Samsung. If Nvidia or AMD ever truly used an alternative foundry, that foundry would catch up rapidly.

    Rating the hyperscalers

    Google has the largest compute installed base, the YouTube data that matters in a robotics world, and a search business that prints. Their loss of TPU cost leadership is the surprise of the year. If Google IO in five days does not produce a leapfrog model, the Nvidia centric narrative gets even stronger.

    Meta deserves real credit. Zuckerberg made Meta AI first internally faster than any other internet giant, paid up for the talent contracts when no one else would, and shipped Musa as a first model from MSL that is close to the Pareto frontier. Amazon is well positioned on Trainium, robotics in retail, and a Nova model line that is better than it gets credit for. Microsoft flinched on capex in early 2025 and lost position. Satya Nadella’s current decision to use Microsoft compute for Copilot rather than reselling to OpenAI is courageous and probably correct, even at the cost of stock price.

    The most interesting cross hyperscaler metric is startup engagement. Nvidia and Amazon engage deeply with startups. Google is next. Broadcom is the favored ASIC partner. AMD, Microsoft, and Meta have minimal startup engagement, which Gavin believes will cost them as the best teams now sit at startups.

    Personal safety, geopolitics, and the Pax Americana case

    The closing section turns darker. Personal safety in an AI era requires a family or company safe word that cannot be socially engineered. Deepfake voice and video extortion via something that looks exactly like your child calling on FaceTime is already feasible. Political violence against AI leaders is a real concern. Geopolitically, Ukraine is winning largely because it has the best battlefield AI outside America and Israel. How adversaries respond to that asymmetry is the next great variable.

    Gavin’s optimistic frame is the Pax Americana. After 1945 the US had a nuclear monopoly and could have controlled the world. Instead it rebuilt Germany and Japan, both of which became the most reliable American allies for the next eighty years. If AI dominance plays out similarly, this is a generationally positive story rather than a destabilizing one. The personal anecdote that closes the conversation is a friend whose daughter was diagnosed with a rare genetic condition. He spun up agents, identified a drug already on the market that addresses her mutation, and her life is immeasurably different because of AI. That is the upside.

    Thoughts

    The Anthropic eleven billion in a month framing is the kind of stat that resets priors. The right way to interpret it is not as a one off but as a measure of how fast value can compound when the underlying technology improves on a curve steeper than the ability of the rest of the economy to absorb it. The skeptical question is whether that ARR is durable or whether it is heavily tied to a customer base of other AI companies that are themselves on a single venture funded year of runway. The bullish answer is that frontier coding, frontier research, and frontier enterprise tasks are not going to stop being valuable, and Anthropic is the best at all three. Both can be true. The number is still extraordinary.

    The argument that TSMC discipline is the only thing preventing a bubble is the analytically tightest part of the conversation. The implied trade is to watch TSMC capacity additions like a hawk and to be more, not less, cautious if Intel Foundry or Samsung Foundry ever announce real share at the leading node. The Terafab thesis is more speculative but more interesting. If Elon’s talent recruiting playbook works and the Intel partnership gives Terafab a real seat at the table within five years, the geometry of the global semiconductor industry shifts in a way that is bullish for American manufacturing, bullish for power and water infrastructure in Texas, and ambiguous for TSMC itself.

    The Pareto frontier discussion deserves more attention than it usually gets. Pricing leadership in AI is not a vanity metric. It determines who can subsidize free tier usage, who can absorb compute shortages, who can ship cheaper enterprise plans, and ultimately whose model becomes the default for any given workload. Google losing per token leadership in nine months is one of the most under analyzed events in the sector and it explains a lot about why Anthropic and OpenAI are growing the way they are. If Google IO does not produce a leapfrog model, the implied verdict on TPU V8 design choices gets a lot harsher.

    The application layer destruction point is worth sitting with. Founders building on top of frontier models are competing in a world where the model itself moves faster than any moat they can build, where the model lab can absorb their niche if it gets interesting, and where the only protection is either deep token path integration or a niche so small the lab does not bother. That is a much harsher venture environment than the early SaaS era. The compensating opportunity is that one human can now run a hundred agents, so the ceiling on what a small team can build is correspondingly higher. The bet is that productivity per founder rises faster than competitive pressure from the labs. We will find out.

    The orbital compute pitch is the section that will polarize listeners. The naive read is that this is science fiction. The closer read is that every component (sun synchronous orbit, laser interconnect, twenty kilowatt satellite buses, ten thousand satellite manufacturing cadence, full rocket reusability) already exists. The remaining engineering problems are repair, maintenance, and radiator scale, all of which are real but tractable on a five to ten year horizon. The strategic implication is that the political and zoning ceiling on terrestrial data centers becomes less binding if orbital compute is a credible alternative for inference workloads. The investor implication is that being short the watts and cooling complex on a five year horizon is a real trade, not a meme.

    Watch the full conversation here.

  • Jensen Huang on Nvidia’s Future: Physical AI, the Inference Explosion, Agentic Computing, and Why AI Doomers Are Wrong

    Jensen Huang sat down with the All-In Podcast crew at GTC 2026 for one of the most wide-ranging and candid conversations he’s had in years. From the Groq acquisition to $50 trillion physical AI markets, from defending Nvidia’s pricing to gently calling out Anthropic’s communications missteps, Huang covered everything. Here’s a complete breakdown of everything said — and what it means.

    ⚡ TL;DW

    • Nvidia has evolved from a GPU company into a full-stack AI factory company, and its TAM has expanded by 33–50% just from new rack configurations.
    • Inference demand is exploding — Huang says compute will scale 1 million times, and analysts who model 7–20% growth “don’t understand the scale and breadth of AI.”
    • The Groq acquisition positions Nvidia to run the right workload on the right chip — GPU, LPU, CPU, switch, all orchestrated under Dynamo, the AI factory OS.
    • Physical AI (robotics, autonomous vehicles, industrial automation) is Nvidia’s play at a $50 trillion market — and it’s already a ~$10 billion/year business growing exponentially.
    • OpenClaw (Claude’s open-source agentic framework) is, in Jensen’s view, the new operating system for modern computing.
    • Jensen pushed back hard on AI doomerism — and diplomatically but clearly called out Anthropic’s communications as too extreme.
    • Robots are 3–5 years away from being “all over the place.” Jensen hopes for more than one robot per human on Earth.
    • Dario Amodei’s $1 trillion AI revenue forecast by 2030? Jensen says he’s being too conservative.
    • His advice to young people: become deeply expert at using AI. English majors may end up winning.

    🔑 Key Takeaways

    1. Nvidia Is No Longer a Chip Company

    Jensen Huang made clear that Nvidia’s identity has fundamentally shifted. The company is now an AI factory company — building not just GPUs but the entire computing stack: GPUs, CPUs, networking switches, storage processors (BlueField), and now LPUs via the Groq acquisition. The operating system tying it all together is called Dynamo, named after the Siemens machine that powered the last industrial revolution by turning water into electricity. Huang’s point: Dynamo is doing the same thing for AI — turning raw compute into intelligence at industrial scale.

    2. The Inference Explosion Is Real and Massive

    A year ago, Huang predicted inference would scale enormously. He’s now doubling down: from generative AI to reasoning models, compute requirements grew roughly 100x. From reasoning to agentic AI, another 100x. That’s 10,000x in two years — and Huang says we haven’t even started scaling yet. He believes the ultimate trajectory is 1 million times more compute than where we started. Analysts who project 20–30% revenue growth for Nvidia fundamentally don’t understand what’s coming.

    3. Disaggregated Inference Is the New Architecture

    The technical centerpiece of GTC 2026 was disaggregated inference — the idea that the AI processing pipeline is so complex (prefill, decode, working memory, long-term memory, tool use, multi-agent coordination) that it should run across heterogeneous chips, not just a single GPU rack. Nvidia’s Vera Rubin system is built for this: multiple rack types handling different workloads. Jensen says Nvidia’s TAM grew by 33–50% just from adding those four new rack types to what was previously a one-rack company.

    4. The $50 Billion Factory Produces the Cheapest Tokens

    Critics argue that Nvidia’s inference factories cost $40–50B versus competitors at $25–30B. Huang’s rebuttal is clean: don’t equate the price of the factory with the cost of the tokens. A $50B Nvidia factory producing 10x the throughput of a $30B alternative means Nvidia’s tokens are actually cheaper. When land, power, shell, storage, networking, and cooling are already fixed costs, the delta between GPU options is a small fraction of total spend — but the performance difference is enormous.

    5. OpenClaw Is the New OS for Modern Computing

    Jensen spent serious time on Claude’s open-source agentic framework (referred to throughout as “OpenClaw”). His view: it’s not just a product announcement — it’s a computing paradigm shift. OpenClaw has a memory system (short-term scratch, long-term file system), skills/tools, resource management, scheduling, cron jobs, multi-agent spawning, and external I/O. These are the four foundational elements of an operating system. His conclusion: for the first time, we have a personal AI computer — and it’s open source, running everywhere.

    6. Agents Mean Every Engineer Gets 100 Helpers

    Jensen’s internal benchmark at Nvidia: if a $500K/year engineer isn’t spending at least $250K worth of tokens annually, something is wrong. He compared it to a chip designer refusing to use CAD tools and working only in pencil. His vision: every engineer will have 100 agents working alongside them. The nature of programming shifts from writing code to writing ideas, architectures, specifications, and evaluation criteria — and then guiding agents toward outcomes.

    7. Physical AI Is a $50 Trillion Opportunity

    This is the biggest framing in the talk. Physical AI — robotics, autonomous vehicles, industrial automation, agriculture, healthcare instruments — represents the technology industry’s first real shot at a $50 trillion market that has been “largely void of technology until now.” Nvidia started this journey 10 years ago, it’s now inflecting, and it’s already approaching $10 billion/year as a standalone business. Huang expects this to grow exponentially.

    8. Robots Are 3–5 Years Away from Ubiquity

    Huang was asked about the “lost decade” of robotics — Google buying and selling Boston Dynamics, years of underwhelming progress. His take: America got into robotics too soon, got exhausted, and quit about five years before the enabling technology (AI “brains”) appeared. Now the brain is here. From a “high-functioning existence proof” (what we have now) to “reasonable products,” technology historically takes 2–3 cycles — meaning 3 to 5 years. He also flagged China’s formidable position in robotics hardware: motors, rare earth elements, magnets, micro-electronics. The world’s robotics industry will depend heavily on China’s supply chain.

    9. Jensen Thinks Dario Amodei Is Too Conservative

    Dario Amodei publicly predicted that AI model and agent companies will generate hundreds of billions in revenue by 2027–28 and reach $1 trillion by 2030. Jensen’s response: “I think he’s being very conservative. Way better than that.” His reasoning? Dario hasn’t fully accounted for the fact that every enterprise software company will become a reseller of AI tokens — a logarithmic expansion of go-to-market that will dwarf what any AI lab can sell directly.

    10. The AI Moat Is Deep Specialization

    When asked what the real competitive moat is at the application layer, Jensen said: deep specialization. General models will handle general intelligence. But every industry has domain expertise that needs to be captured in specialized sub-agents, trained on proprietary data. The entrepreneur who knows their vertical better than anyone else, connects their agent to customers first, and builds that flywheel — that’s the moat. He framed it as an inversion of traditional software: instead of building horizontal platforms and customizing at the edges, AI enables you to go vertical-first from day one.

    11. Jensen’s Gentle but Clear Critique of Anthropic’s Communications

    Asked what advice he’d give Anthropic following the Department of Defense controversy that created a PR crisis, Jensen praised Anthropic’s technology and their focus on safety — then offered a measured but pointed critique: warning people is good, scaring people is less good. He argued that AI leaders need to be more circumspect, more humble, more moderate. Making extreme, catastrophic predictions without evidence can damage public trust in a technology that is “too important.” His implicit warning: look what happened to nuclear energy. A 17% public approval rating for AI is the beginning of that same problem.

    12. China Policy: Back to Market, With Conditions

    Nvidia had a 95% market share in China — and lost it entirely due to export controls, falling to 0%. Jensen confirmed that Nvidia has received approved licenses from Secretary Lutnik to sell back into China, has received purchase orders from Chinese companies, and is actively ramping up its supply chain to ship. His broader point: the risk isn’t selling chips to China — the real risk is America becoming so afraid of AI that its own industries don’t adopt it while the rest of the world surges ahead.

    13. Taiwan, Supply Chain, and Geopolitical Risk

    Jensen laid out a three-part strategy for de-risking around Taiwan: (1) Re-industrialize the US as fast as possible — he said Arizona, Texas, and California manufacturing is accelerating with Taiwan’s help as a strategic partner. (2) Diversify the supply chain to South Korea, Japan, and Europe. (3) Demonstrate restraint — don’t press unnecessarily while building resilience. He also noted that Taiwan’s partnership has been genuine and deserves recognition and generosity in return.

    14. Data Centers in Space

    Not science fiction — Nvidia already has CUDA running in satellites doing AI imaging processing in orbit. The near-term thesis: it’s more efficient to process satellite imagery in space than beam raw data back to Earth. The longer-term architecture for space-based data centers is being explored, with radiation hardening already solved. The main challenge is cooling — in the vacuum of space, you can only use radiation cooling, which requires very large surface areas.

    15. Healthcare: Near the ChatGPT Moment for Digital Biology

    Jensen believes digital biology is approaching its own ChatGPT inflection point — the moment where representing genes, proteins, cells, and chemicals becomes as natural as language modeling. He flagged companies like Open Evidence and Hippocratic AI as examples of where agentic healthcare is already working. His vision: every hospital instrument — CT scanners, ultrasound devices, surgical robots — will become agentic, with “OpenClaw in a safe version” running inside each one.

    16. Open Source and Closed Source Will Both Win

    Jensen pushed back on the idea that open source vs. proprietary is an either/or question. It’s both, necessarily. Proprietary models (OpenAI, Anthropic, Gemini) will continue to serve the general horizontal layer — and consumers love having options with distinct personalities. But industries need open models they can specialize, fine-tune, and control. The open model ecosystem, including Chinese models, is “near the frontier” and growing fast. His framework: connect to the best available model today via a router, and use that time to cost-reduce and fine-tune your specialized version.

    17. Advice for Young People: Master AI, Go Deep on Science

    Jensen’s advice for students deciding what to study: deep science, deep math, and strong language skills — because language is the programming language of AI. He made a striking claim: the English major might end up being the most successful professional in the AI era. His one non-negotiable: whatever you study, become deeply expert at using AI tools. And he used radiologists as proof that AI doesn’t destroy jobs — when AI did 100% of the computer vision work in radiology, demand for radiologists went up, not down, because the total number of scans possible exploded.

    📋 Detailed Summary

    The Groq Acquisition and Disaggregated Inference

    The conversation opened with the Groq acquisition — a deal Chamath jokingly said made him “insufferable” during the six-week close. Jensen explained the strategic logic: as Nvidia evolved from running large language models to running full agentic systems, the compute problem became radically more complex. Agentic workloads involve working memory, long-term memory, tool use, inter-agent communication, and diverse model types (autoregressive, diffusion, large, small). No single chip type handles all of this optimally.

    The solution is disaggregated inference — routing different parts of the processing pipeline to the most efficient hardware. Groq’s LPU chips are particularly suited to certain inference tasks. Nvidia’s Vera Rubin system now encompasses five rack types where it used to be one: GPU compute, networking processors, storage processors (BlueField), CPUs, and now LPUs. Jensen’s TAM math: the addition of those four rack types grew Nvidia’s addressable market in any given data center by 33–50% overnight.

    The operating system managing all of this is Dynamo, which Jensen introduced 2.5 years ago — a deliberate reference to the Siemens dynamo machine that powered the first industrial revolution. Dynamo orchestrates workloads across this heterogeneous compute landscape, optimizing for cost, speed, and efficiency.

    Decision-Making at the World’s Most Valuable Company

    Asked how he allocates attention and makes strategic calls at a $350B+ revenue company, Jensen gave a surprisingly simple framework: pursue things that are insanely hard, that have never been done before, and that tap into Nvidia’s specific superpowers. If something is easy, competitors will flood in. If it’s hard and unique, the pain and suffering of building it becomes a moat in itself. He explicitly said he enjoys the pain — and that there’s no great invention that came easily on the first try.

    Physical AI and the Three Computers

    Jensen framed Nvidia’s physical AI strategy around three distinct computers:

    1. The Training Computer — for developing and creating AI models.
    2. The Simulation Computer (Omniverse) — for evaluating AI systems inside physics-accurate virtual environments (required for robotics and autonomous vehicles that can’t be tested purely in the real world).
    3. The Edge Computer — deployed in cars, robots, factory floors, teddy bears, and telecom base stations. Jensen flagged that the $2 trillion global telecom industry is being transformed into an extension of AI infrastructure — turning radio base stations into AI edge devices.

    Physical AI is, by Jensen’s estimate, the technology industry’s first real crack at the $50 trillion industrial economy. He started the investment 10 years ago. It’s now approaching $10 billion annually and growing exponentially.

    OpenClaw as the New Operating System

    Jensen’s analysis of OpenClaw (Anthropic’s open-source agentic framework, referred to as “Claude Code” / “Open Claude” throughout) was one of the most intellectually interesting sections of the interview. He traced three cultural inflection points:

    1. ChatGPT — put generative AI into the popular consciousness by wrapping the technology in a usable interface.
    2. Reasoning models (o1, o3) — shifted AI from answering questions to answering them with grounded, verifiable reasoning, driving economic model inflection at OpenAI.
    3. OpenClaw — introduced the concept of agentic computing to the general population. But more importantly, it defined a new computing architecture: memory (short and long-term), skills, resource scheduling, IO, external communication, and agent spawning. These are the four elements of an operating system. OpenClaw is, in Jensen’s view, the blueprint for what a personal AI computer looks like — open source, running everywhere.

    He also flagged that Nvidia contributed security governance work to OpenClaw alongside Peter Steinberger — ensuring agents with access to sensitive information, code execution, and external communication can be properly governed with appropriate policy constraints.

    The Agentic Future and Token Economics

    Jensen’s internal benchmark for token spending at Nvidia was striking: a $500K/year engineer who isn’t spending $250K/year in tokens is underperforming. He framed this as no different from a chip designer refusing to use CAD software. The implication for enterprise economics is profound: the cost basis of AI in a company isn’t an IT line item — it’s a multiplier on every knowledge worker’s output.

    He also addressed Andrej Karpathy’s “autoresearch” concept — the idea of AI systems that autonomously run research experiments. A guest described completing, in 30 minutes on a desktop, a genomics analysis that would normally constitute a seven-year PhD thesis. Jensen’s response: this isn’t a fluke. It’s the beginning of a fundamental shift in what “doing science” means.

    His forecast on compute scaling: generative to reasoning = 100x. Reasoning to agentic = 100x. Total in two years = 10,000x. And the end state isn’t even close yet — he believes the long-run trajectory is 1 million times current compute levels.

    AI’s PR Crisis and Anthropic’s Comms Mistakes

    This segment was diplomatically delivered but substantively sharp. Jensen opened by genuinely praising Anthropic — their technology, their safety focus, their culture of excellence. Then he drew a distinction: warning people about AI capabilities is good and important. Scaring people with extreme, catastrophic predictions for which there’s no evidence is less good, and potentially very damaging.

    He pointed to the nuclear analogy: public fear of nuclear energy, driven partly by technology leaders’ own alarming statements, effectively killed the US nuclear industry. America now has zero new fission reactors while China builds a hundred. AI’s 17% public approval rating in the US is the beginning of the same dynamic. Jensen said the greatest national security risk from AI isn’t what other countries do with it — it’s the US being so afraid of it that American industries fail to adopt it while the rest of the world surges ahead.

    His prescription for AI leaders: be more circumspect, more humble, more moderate. Acknowledge that we can’t completely predict the future. Avoid statements that are extreme and unsupported by evidence. Our words matter in a way they didn’t used to — technology leaders are now central to the national security and economic policy conversation.

    China Policy: Return to Market

    One of the more concrete news items in the interview: Nvidia is returning to the Chinese market. Jensen confirmed they had a 95% market share in China — and fell to 0% due to export controls. They’ve now received approved licenses from Secretary Lutnik, Chinese companies have issued purchase orders, and Nvidia is ramping its supply chain to ship.

    His framework for the right AI export policy outcome: the American tech stack — from chips to computing systems to platforms — should be used by 90% of the world as the foundation on which other countries build their own AI. The alternative — an AI industry that ends up like solar panels, rare earth minerals, motors, and telecom infrastructure (all dominated by China) — is a national security catastrophe.

    Self-Driving and Competitive Positioning

    Jensen laid out Nvidia’s strategy in autonomous vehicles: they don’t want to build self-driving cars — they want to enable every car company to build them. Nvidia supplies all three computers: training, simulation, and the in-car edge computer. Their autonomous driving AI system, called “Al Pomayo,” introduced reasoning capabilities into autonomous vehicles — decomposing complex scenarios into simpler ones the system knows how to navigate.

    On competition from customers (Google TPU, Amazon Inferentia, etc.): Jensen isn’t worried. His argument is that 40% of Nvidia’s business comes from customers who don’t just want chips — they need the full AI factory stack. CUDA isn’t just a chip instruction set; it’s a system. Companies that have tried to build their own silicon have found that chips without the full stack don’t solve the problem. Meanwhile, Nvidia is gaining market share, including pulling in Anthropic and Meta as Nvidia customers, and AWS just announced a million-chip order.

    Robotics: 3–5 Years to Everywhere

    Jensen’s robotics take was both bullish and grounded. America invented modern robotics, got too early, got exhausted, and quit just before the AI brain appeared that would make it work. That brain is here now. From the current “existence proof” stage to “reasonable products,” he sees 3–5 years. His aspiration: more than one robot per human on Earth. The use cases he described range from factory floor automation to virtual presence (using your home robot as an avatar while traveling), to lunar and Martian factories run entirely by robots with materials beamed back to Earth at near-zero energy cost.

    China’s position in robotics is formidable and can’t be wished away: they lead in micro-electronics, motors, rare earth elements, and magnets — all foundational to building robot hardware. The world’s robotics industry, including the US, will depend heavily on China’s supply chain for hardware components even if American software and AI lead.

    Revenue Forecasts: Dario Is Too Conservative

    When the hosts described Dario Amodei’s forecast of hundreds of billions in AI model/agent revenue by 2027–28 and $1 trillion by 2030, Jensen said simply: “Way better than that.” His reason: Dario hasn’t fully factored in that every enterprise software company will become a value-added reseller of AI tokens — OpenAI’s, Anthropic’s, whoever’s. The go-to-market expansion that comes from every SAP, Salesforce, and ServiceNow reselling AI is logarithmic, not linear.

    Healthcare: Near the Inflection Point

    Jensen named three layers of Nvidia’s healthcare involvement: (1) AI biology/physics — using AI to represent and predict biological behavior for drug discovery; (2) AI agents — agentic systems for diagnosis assistance, first-visit intake, and clinical decision support (he named Open Evidence and Hippocratic AI as leading examples); (3) Physical AI for healthcare — robotic surgery, AI-enabled instruments, and the vision of every hospital device (CT, ultrasound, surgical tools) becoming agentic. He sees digital biology as approaching its ChatGPT moment — the point where representing genes, proteins, and cells computationally becomes as natural and powerful as language modeling.

    Career Advice: Go Deep, Use AI

    Jensen closed with career guidance. His core advice: study deep science, deep math, and language — because language is now the programming language of AI. He made the counterintuitive claim that English majors may end up being the most successful professionals in the AI era because the ability to specify, guide, and evaluate AI outputs is an artform — and it’s not trivial. The person who knows how to give AI enough guidance without over-prescribing, who can recognize a great AI output from a mediocre one, and who can orchestrate teams of agents toward outcomes — that’s the most valuable skill.

    He used the radiologist story as his closing proof point: when computer vision was integrated into radiology, demand for radiologists went up, not down. The number of scans exploded, hospitals made more money, and more patients got diagnosed faster. AI didn’t replace radiologists — it made them bionic and made the whole system bigger. He expects the same pattern everywhere: every job will be transformed, some tasks will be eliminated, but the total pie grows dramatically.

    💭 Thoughts

    Jensen Huang is doing something rare among tech CEOs: he’s genuinely trying to build the mental model people need to understand what’s happening — not just sell products. The disaggregated inference argument, the three-computer framework, the OS analogy for OpenClaw, the token economics benchmark — these aren’t talking points. They’re conceptual tools for thinking clearly about a landscape most people are still squinting at.

    The most underappreciated part of the interview is the AI PR section. Jensen is essentially sounding an alarm without panicking: if America’s technology leaders keep scaring the public with AI doomerism, we will repeat the nuclear mistake. We’ll regulate ourselves into irrelevance while China builds the infrastructure we refused to build. The 17% approval number he cited should frighten every AI optimist in the room. Fear of a technology, once embedded culturally, is very hard to dislodge.

    The Anthropic critique was surgical. He didn’t name the specific controversy, didn’t pile on, and praised their technology extensively. But the message was clear: extreme safety warnings, even well-intentioned ones, carry real costs in the public square. That’s a genuinely hard tension for safety-focused AI companies, and there’s no clean answer — but Huang’s instinct that humility and circumspection serve better than catastrophism seems directionally correct.

    The physical AI thesis deserves more attention than it gets. Everyone is focused on the software intelligence race — OpenAI vs. Anthropic vs. Gemini. But Jensen is pointing at a $50 trillion industrial economy that AI has barely touched. Robotics, autonomous vehicles, agricultural automation, smart hospital instruments — this is where the real mass of economic value is locked. And Nvidia’s ten-year head start on the enabling infrastructure for physical AI may turn out to be more durable than any software moat.

    Finally: the robot optimism is infectious and probably correct. The world is genuinely short millions of workers. The enabling technology — AI brains good enough to drive perception, reasoning, and action in unstructured physical environments — just arrived. The hardware supply chain is largely intact. And the economic incentive to automate is stronger than it’s ever been. Three to five years feels aggressive. But so did “ChatGPT will change everything” in 2021.