PJFP.com

Pursuit of Joy, Fulfillment, and Purpose

Tag: continual learning

  • Why I Couldn’t Build Jev at OpenAI: Diogo Almeida on TypeSafe, System One Models, RLCD, and Making AI Programmable

    Diogo Almeida spent years inside OpenAI arguing that the entire field was optimizing the wrong thing, and then left to prove it. In this long interview recorded days after the launch of Jev, the TypeSafe co-founder and CEO lays out the thesis he could not build where he was: that language models have been tuned to please humans when the real customer should have been code. The conversation runs from the internals of mode collapse to the design of a three-primitive API, from a trillion tokens a day to why he thinks the entire “pace the frontier” debate rests on an assumption nobody examines. It is the most technically unguarded founder interview of the year, and it is also, in places, a founder who admits he has cried several times this week.

    TLDW

    Almeida describes Jev as the first of a new class of models he calls machine native system one models, or large programmable models, where the consumer of the output is code rather than a human reader. He explains why RLHF’s mode collapse poisons calibration and makes string models bad at decisions, why refusal is a type error that has no business existing in an API, and why he refuses to publish public benchmarks because they are trivially gameable. He walks through the three API primitives and how each maps to a programming construct, argues that system messages are global variables and that problems should be decomposed into many cheap parallel questions, and explains why robustness rather than determinism is the right north star so there is no seed parameter. He gives the economic thesis: total factor productivity growth above three percent within five years, all models currently tied at roughly zero percent of economically valuable work, and an inverse SaaS apocalypse rather than mass unemployment. He attacks the frontier pacing argument as a sleight of hand that assumes everyone must keep scaling RLVR, says zero RLVR is optimal for his model shape, calls most neolabs value destroying, and says that if you gave him a billion dollars he would not pre-train. He tells the story of leaving OpenAI, including the Thanksgiving GPU run during the board coup, the fight to ship InstructGPT and the disappointment of watching it become a copywriting slop engine. He closes by giving away two research agendas he will not pursue himself: genuinely intelligent games, and coding agents freed from what he calls the tyranny of the KV cache.

    Thoughts

    The sharpest idea in the first half is the claim that refusal is a type error. It sounds like a joke and it is not. Almeida’s point is that a refusal is an unmodeled return value: the caller asked for a decision and received an apology, which no type signature anywhere in the stack accounts for. A human in a chat window can absorb that. A dependency running unattended in the background cannot, and neither can the third party who imported that dependency and has no idea an AI is buried in it. From there he makes the more uncomfortable argument, which is that safety alignment and capability alignment are structurally opposed. Capability alignment means doing what the caller asked. Safety alignment means following somebody else’s instructions instead of the caller’s. That is a perfectly reasonable trade for a consumer product with parents and children using it, and an incoherent one for an API. His analogy is that intelligence should be infrastructure like a database, and databases do not audit what you query them for. The host pushes back properly on this, raising military use, and Almeida does not dodge: he says he would prefer his technology not be used to kill people, he will put his thumb on the scale socially, and he will not do it at the technological layer, because every overfit to a particular concern fractures the model’s general intelligence a little more. You can disagree with the conclusion. It is a real position, consistently held, and it is far more thought through than the usual libertarian shrug.

    The middle of the conversation contains the part practitioners should actually steal, and it has nothing to do with Jev specifically. Almeida’s view is that the industry has been writing AI code in the worst possible style: one enormous system message containing all the state and all the instructions at once, then hoping every instruction lands, then bolting on a second model to check whether the first one behaved. He calls system messages disgusting global variables, and the comparison holds up. The alternative he pushes is to pass structured, nested, semantic objects rather than templated strings, and to decompose a task into many small independent questions asked in parallel rather than one large one. The payoff is not elegance, it is measurability. When you find a failure, you do not rewrite a prompt and hope; you add a question, set a threshold, keep the case as a test, and it is fixed permanently rather than until the next context rot. He calls this ML without the ML, and it is the most accurate three-word description of the workflow I have heard. There is a real cost he acknowledges openly: decomposing means paying for overlapping context repeatedly, which is exactly why nobody did this before, because with chat-priced models it was slower, more expensive and worse. His answer is that intelligence per dollar is the metric that unlocks the pattern, and the trick he offers for the remaining cost is to pay for a large state once and fan many cheap ID-addressed questions across it.

    Then there is the economics, which is where the interview stops being about a product. Almeida is the only lab founder I have heard name total factor productivity growth as the target, and he wants above three percent within five years. The corollary is brutal and he says it plainly: every model on the market today is tied at roughly zero percent of the world’s economically valuable work, and he would guess the real figure has not yet crossed one percent. He then poses the question the whole field has been avoiding, which is how a technology that can approach millennium prize problems in mathematics has automated essentially none of the boring, unsatisfying, rote work that actual people are actually stuck doing. His answer is that the engine is fine and the plugs are missing. The supporting observation is devastating in its simplicity: it is 2026, software is functionally identical to 2019 software, and the only visible difference is a chat box in the corner that cannot be trusted with any decision the company has a stake in. His prediction is not the SaaS apocalypse everyone expects but the inverse, because the incumbents are the ones who actually know which tasks are worth automating. He also predicts no mass unemployment, which given the rest of his worldview reads less like optimism and more like a man who thinks the technology is currently too unreliable to be the threat people fear.

    The most genuinely contrarian stretch comes late, when the host raises frontier pacing and the joint statements the labs have been signing. Almeida’s response is that the argument is internally consistent and starts from a premise with alternatives. The pacing case assumes that progress requires ever more RLVR, which means giving models ever broader latitude to do arbitrary things in the middle of a trajectory, because that latitude is what makes them powerful afterward. If that is the only path, then yes, the world gets dangerous. But he does not need to do more RLVR at all. He says zero is the optimal amount for his model shape, which turns the safety discussion from a law of nature back into a research choice. He calls it a sleight of hand, and then says something that lands harder: the people at fault are not the public and not the policymakers, but the researchers, because the public reasonably assumes the labs are pursuing the best available direction and has no way to know what optionality exists. He extends the same complaint to the funding environment, saying most neolabs are value destroying because they redo work from scratch with a low chance of moving anything, and that valuing pure research pedigree is backwards when what actually creates value is picking the right task. The interview also contains an uglier detail that he visibly does not enjoy hearing, which is the host relaying that in at least one room the pacing conversation is political positioning around the 2028 election. His reaction is the most human moment in two hours: he says it makes him lose faith in humanity a bit, and that he would rather stay a naive technologist.

    The last twenty minutes are the reason to watch the whole thing, because Almeida spends them giving away work he will never do. The one that matters is coding agents freed from what he calls the tyranny of the KV cache. His argument is that the cache is why agent architecture is stuck: to use it efficiently you must keep appending to a single linear context with a single model, which forbids state management, abstraction and decomposition, the three things software engineering figured out decades ago. That constraint, he says, is the actual explanation for why routing is hard, why sub-agents disappoint, and why compaction remains an unsolved mess. You cannot hand a sub-agent a genuinely smaller task because the state you would need to pass costs more intelligence to summarize than the task itself is worth. If context becomes cheap enough, the shape changes completely: hierarchies of labeled subtasks you can search for relevant context on demand, parallel agents reading each other’s state, swarms coordinating with real locks instead of asking each other what they are working on. And then the reframe that is worth the price of admission on its own, which is that continual learning is not a learning problem at all. Starting from scratch every session and then inventing an exotic research program to fix it is strange when the actual deficiency is that you have no cheap way to look anything up. It is a memory management problem. He is right, he knows he is not going to get to it, and he is openly hoping someone reading takes it.

    Key Takeaways

    • Jev is the first of what Almeida calls machine native system one models, or large programmable models. The defining property is that code, not a human reader, is the intended consumer of the output.
    • The class name matters more than the product name. He is not attached to “system one models” but rejects “decision models” because there are machine native types coming that are not decisions.
    • The model is named after Jevons paradox and is optimized for intelligence per dollar. Jev is the brand for whatever sits on the intelligence per dollar frontier, not for raw capability.
    • His critique of RLHF centers on mode dropping. A calibrated, mode covering distribution tolerates outliers, while RLHF-tuned models drop minority modes and become conservative because visible errors are punished far harder than subtly wrong output that looks right.
    • That same mechanism is his rebuttal to Yann LeCun’s famous slide about error compounding with sequence length. He calls it mathematically obvious and empirically wrong, and says mode collapse is precisely why the predicted failure does not occur.
    • He rates LeCun as among the most accurate thinkers in the field while declining to endorse JEPA as the fix, calling it excellent early research whose practicality is unproven.
    • Refusal is described as a type error. A refusal returned into a background dependency breaks software stochastically, and the downstream consumer has no way to know an AI is in the chain.
    • Safety alignment is framed as the opposite of instruction following, since it means obeying a third party rather than the caller. He considers it appropriate in a first party product and unacceptable in an API.
    • His preferred metaphor is intelligence as a database rather than a coworker. Databases do not police what they are queried for, and he argues the same boundary gives software engineers maximum power.
    • He is opposed to public benchmarks on principle, arguing they are gameable even by labs trying not to game them, and citing the era when every lab had a team collecting MMLU-shaped data.
    • He is not anti-measurement. TypeSafe runs internal evals but treats not fooling itself about model quality as a top level discipline, because any alternative incentive corrupts the number.
    • Trust, in his model, comes from putting a model into your own workflow and measuring it there, plus a company that keeps adding nines of reliability over time.
    • His “bitterest lesson” is that choosing the right task and setting the right north star beats both compute and algorithms. He counts only about two and a bit such shifts in the LLM era: RLHF, RLVR as a fractional one, and now RLCD.
    • RLCD is presented as a north star rather than an algorithm, in the same way RLHF names the task of instruction following rather than PPO specifically. No paper has been published on it.
    • He calls data the thing that determines model capability and is hiring what he describes as infinite data people, insisting they be the highest status role rather than treated as a slur.
    • TypeSafe deliberately does not train on user data, even though it probably could. Real usage follows a power law that would overfit the model to the present when the goal is unbuilt future use cases.
    • His layering analogy is that today’s LLMs are UDP and his models are TCP, with many more layers of machine native intelligence still to be built on top.
    • There is no seed and no determinism guarantee. He considers determinism mildly useful for unit tests but the wrong north star, and says robustness, meaning similar outputs for semantically identical inputs, is the property that matters.
    • TypeSafe tests robustness by injecting UUIDs and nonces into otherwise identical prompts and checking that outputs stay stable, which he notes most LLMs fail badly.
    • He commits firmly that deployed models will not be silently changed, calling that practice insane for an API, while explicitly declining to promise long term support for any given version.
    • New model versions will ship faster than developers are used to. An LTS designation for the current version is under consideration because fracturing the fleet across many versions is worse than the alternative.
    • The three API primitives are a boolean-like type whose unusual spelling derives from the letters of Bernoulli, a score, and a choice. All three are new concepts rather than existing programming types, on purpose.
    • Each primitive maps to a programming construct: the Bernoulli-derived type to an if statement, a score to sorting or thresholding, and a choice to a switch on an enum that you can optionally hydrate into a function.
    • They were deliberately not named int, float or bool so that tools like Instructor or Pydantic could not silently coerce a score into an integer and mislead the developer.
    • Inputs including state, instructions and criteria can all be structured JSON objects. He argues that flattening them into a templated system message is old thinking, since stringification is for human output.
    • System messages are called disgusting global variables. His alternative is many small explicit questions asked in parallel, each independently evaluable.
    • His worked example is refusal itself: rather than asking “should I refuse,” ask many independent questions about specific situations, so a missed case is fixed permanently by adding a question and a threshold.
    • He calls this approach ML without the ML, since thresholds are tuned against real examples rather than trained.
    • A practical cost-saving pattern he recommends: pay for a large state once, attach IDs to every message or element, then fan many cheap parallel questions across those IDs.
    • Fine tuning is not offered and he is ambivalent about it, noting that generality often helps edge cases within a narrow task and that other labs have launched and then withdrawn fine tuning.
    • His preferred alternative is calibration plus a cascade: trust a confident small model, escalate ambiguous cases to a larger one. Multiple model sizes are explicitly on the roadmap.
    • Intelligence per second is treated as a separate metric from intelligence per dollar. He acknowledges the magic of the 1 to 100 millisecond latency band but says that is not Jev’s niche.
    • The launch passed a trillion tokens per day, and he emphasizes that the volume holds overnight, meaning machines rather than humans experimenting.
    • He considers waitlist signups meaningless for a developer platform. One power user’s for loop outweighs the entire world trying a few queries, and rate limits are the metric that actually binds.
    • Pre-launch validation went badly. More than half the people who tried it did not understand it, non-technical staff feared they were selling a vitamin rather than a painkiller, and revenue before launch was almost nothing.
    • That experience makes him question product market fit as a concept, since the product and the market both existed while the response was indifference right up until it was not.
    • His economic north star is total factor productivity growth above three percent within five years, a metric he notes no other lab talks about and which he ties to the original OpenAI charter language.
    • He believes all models today are roughly tied at zero percent of the world’s economically valuable work, likely under one percent, and that the real shift will show up in economic statistics rather than demos.
    • He expects an inverse SaaS apocalypse, with existing software companies supercharged because they know best which tasks are worth automating, and no mass unemployment.
    • Whether a task is system one or system two is framed as an empirical question, not a philosophical one, comparable to asking why robotics has not worked despite the money spent.
    • The host’s own testing found Jev state of the art on single hop reasoning with monotonic degradation as hops increase, which Almeida accepts as a fair characterization of the current frontier.
    • Each paradigm is defined by its north star: RHLF optimizes to please humans, RLVR optimizes benchmarks because a benchmark is by definition programmatically verifiable, and RLCD optimizes reliability for programmatic use.
    • There is no reasoning trace in Jev and he considers string-based reasoning slow, inefficient and fragile, while leaving the door open to cheaper forms of reasoning.
    • He claims Jev degrades less in long context than other models, and frames context length as a case study in giving people what they say they want versus what they need.
    • Four use case families were mapped from first principles before launch: dark data analysis, coding agents, real time intelligence in the loop, and intrinsically composable smart software.
    • Dark data is the enterprise unlock. Companies hoarded data they could never afford to run an LLM across, and he calls it a data scientist’s dream.
    • Voice-driven computer control surprised him. He says he is anti-demo as much as he is anti-benchmaxxing, and wants to find the weaknesses before celebrating.
    • He sees a structural problem for the leading coding agents: they are architected around a single model world, while open source agents are free to experiment with multi-model patterns.
    • Because open agents can copy each other, the first one to find a pattern that only works with a cheap system one model will pull everyone along with it.
    • On frontier pacing, he argues the entire case assumes continued scaling of RLVR, and says zero RLVR is optimal for his model shape, which makes the danger a choice rather than a law.
    • He blames researchers rather than the public for closed-mindedness, since the public cannot be expected to know what alternative directions exist.
    • He calls most neolabs value destroying, criticizes the valuation of pure research pedigree, and says the labs are the right place for researchers who want to explore rather than solve.
    • If given a billion dollars he says he would not pre-train, preferring to slice, combine and Frankenstein existing capability because it solves problems more cheaply.
    • He hates fracturing intelligence, and blames the chat-first plus reasoning-mode architecture for sycophancy, overconfidence, hallucination and the bold-and-emoji style that wins human preference leaderboards.
    • For that reason the model is not trained to claim an identity. He would rather it report what the internet thinks than be told it is Jev from TypeSafe, because identity training fractures the model.
    • The origin story runs through a Thanksgiving research sprint on idle OpenAI GPUs that coincided with the board coup, which he describes only as annoying while declining to elaborate.
    • He fought to ship InstructGPT, including an unpublished algorithm he wrote himself because cleaning the PPO data was too slow, and it took roughly half the LLM market almost immediately.
    • The disappointment that followed shaped everything: instruction following looked superhuman yet ended up powering copywriting tools, and he worried they had made the internet worse.
    • The insight that became TypeSafe came from working backwards from an AI-based economic revolution and asking who would be calling the API. The answer was many nines of code, and all the optimization was aimed at humans.
    • Sam Altman read the document and told him to go work on it. He assumed Anthropic must already be doing it and that he was too late.
    • The company formed fast: he recruited Eric first, asked Sasha only for a sanity check and she folded her own startup on the spot, funding closed within two weeks and people moved into his apartment.
    • He describes himself as zero percent entrepreneurial, says he never wanted to be a CEO, and traces the decision to feeling disempowered inside an organization where every conversation routed back to ChatGPT.
    • His longest-standing grievance is the function calling interface. He wanted a genuine probability per function so a developer could set their own refusal threshold rather than pleading in a system message.
    • The first task he gives away is intelligent games, where even simple state machines for NPCs could make a world far more compelling without calling a model in the game loop.
    • The second is coding agents freed from the KV cache, which he argues is the hidden reason routing, sub-agents and compaction are all hard, and the subject of his piece titled after the Wu-Tang line.
    • His reframe of continual learning is that it is a memory management problem, since the difficulty is having no cheap way to look up historical context rather than any failure to learn.
    • He imagines agent swarms that read each other’s state and coordinate with real locks, plus searchable trees of labeled subtasks, once context becomes cheap enough to stop passing everything upward.
    • Latency is now a hiring constraint. He is building out infrastructure geographically because the speed of light matters, and is unhappy that European users get only a threefold speedup.
    • The stated ambition is not to be a one model company but to become something like an AWS of intelligence, shipping more shapes of machine native intelligence beyond Jev.

    Detailed Summary

    A New Class of Models Where Code Is the Consumer

    Asked the definitive question of what Jev actually is, Almeida starts with the category rather than the product. The industry has pre-trained models built to autocomplete the internet, RLHF models built to reply to text in a chat window, and RLVR models sitting in an awkward gray area beside them. What it lacks is a class of models whose outputs are meant to be consumed directly by code, which is where the company name comes from. He describes the class as machine native, system one, and large programmable, and says the goal is to make AI as powerful as possible by integrating it with software rather than by wrapping it in a conversation. Jev is the first of these, and the name comes from Jevons paradox because it is optimized for intelligence per dollar. He frames the design space as a tradeoff between reliability, cost, calibration and speed, and says Jev is the name that will attach to whatever sits on the intelligence per dollar frontier rather than to any particular architecture.

    Mode Collapse, Calibration, and Why LeCun’s Slide Is Wrong

    The most technical stretch of the interview is his account of what RLHF did to probability distributions. He notes that nobody paid attention to the downsides of RLHF in his launch material, particularly mode dropping. He then uses it to resolve a puzzle he clearly enjoys: Yann LeCun’s well known slide arguing that as sequence length grows, the probability of an error compounds toward certainty. Almeida says the argument is mathematically obvious and empirically false, and that the disconnect is exactly mode collapse. A calibrated, mode covering model is not catastrophically punished for outliers, the way pre-GAN generative models produced blurry images rather than dropping minority classes. RLHF-tuned models instead drop the modes and become extremely conservative, because an obvious error is punished hard while a subtly wrong output that looks correct is not. That conservatism is what keeps long strings from derailing, and it is also, in his words, total poison for calibration. His conclusion is that this is precisely why string models are bad at making decisions. He rates LeCun as among the most accurate thinkers in the field while declining to endorse JEPA as the fix, calling it very cool early research whose practicality he will not vouch for, and adding that the research world is full of diamonds in the rough that nobody has polished because they have not picked the right task.

    Refusal as a Type Error

    He addresses a question his Discord keeps asking, which is why TypeSafe does not implement refusals. His answer separates safety as a principle, which he supports, from safety alignment as an implementation, which he considers misaligned with users. A refusal reaching a human in a coding session is merely annoying, and he suggests developers have been Stockholm syndromed into accepting it. A refusal reaching a dependency running in the background is something else entirely, because the software breaks stochastically based on what a user typed somewhere upstream, and the person who imported that dependency has no idea why. He argues this comes from people who do not understand software and are fixated on an AI coworker metaphor he calls a horseless carriage. What he wants instead is a cognitive core general enough to serve use cases nobody has imagined, which is why it works on tasks TypeSafe never trained for. He draws a hard line between capability alignment, which means doing what the user asked and which developers love because predictability reduces testing, and safety alignment, which by construction means following somebody else’s instructions. The former is what he is chasing to as many nines as he can get, until calling for intelligence is as unremarkable as a database query.

    Infrastructure Does Not Police Its Users

    The host presses on the obvious objection, which is military use, and Almeida engages rather than deflecting. He accepts there are pragmatic places where such a position can be held, and says the foundation of a general purpose technology is not one of them. He would prefer his technology not be used to kill people and will put his thumb on the scale, but not at the technological layer, because every overfit to a particular concern fractures the model’s intelligence further, and he considers current models already badly fractured. His formulation is that intelligence will resemble a database more than a coworker, and that a database is not responsible for auditing the purposes of its queries. He extends this to customer conversations, describing his bafflement when companies ask permission to deploy: TypeSafe is an API and the caller is a developer, and it should not even be possible for TypeSafe to know what the full downstream task is, because a properly decomposed system does not expose it. He frames that opacity as a feature that gives engineers maximum power, and says the bias will stay out of the technological layer as long as he is in charge.

    Why There Are No Public Benchmarks

    Almeida is emphatic that he is anti public benchmark and merely lukewarm on private proxy benchmarks. His reasoning starts from what TypeSafe is actually selling, which is intelligence per dollar and per second, and his observation that cost and speed are the things you pay while intelligence is the thing you receive. The problem is that intelligence has an ineffable quality that benchmarks cannot capture, which is why the reaction that mattered after launch was not the video but developers discovering hours later that the model was genuinely usable. He argues public benchmarks are extremely gameable even by labs that try not to game them, recalling when every lab kept a team collecting MMLU-shaped data, which he describes as benchmarking with extra steps. His alternative is vibes and trust until a developer puts the model into a specific workflow and measures it there, paired with a company obligation to keep adding nines. He notes this cost TypeSafe real money during fundraising, when investors wanted benchmarks and the team refused on the grounds that the practice rewards bad actors. TypeSafe does run internal evals, and he insists the discipline of not gaming them is a top level priority that he enforces hard, since otherwise the company would be flying blind on its own frontier claims.

    The Bitterest Lesson and the Primacy of Data

    He offers his own variant of Rich Sutton’s argument, which he calls his bitterest lesson. Where Sutton’s bitter lesson elevates general methods and compute, Almeida says that data matters far more than compute and that picking the right task with a clear north star is the hardest and most important thing of all. He counts the times this has happened in the LLM era: RLHF, which shifted the task to instruction following and which nobody realized was possible; RLVR, which he scores as roughly a fifth of a shift and generously at that; and now RLCD. On RLCD he is careful to say it is not jargon, because RLHF likewise names a task rather than an algorithm, given that DPO and its descendants are all doing RLHF without using the algorithm from the original paper. The north star for RLCD is programmable AI with programs in the loop and the human removed. He considers TypeSafe a data company in the sense that model capability means data, and is hiring what he calls infinite data people. He describes onboarding them with a talk longer than the interview itself, and explains that the shape of the data follows the shape of the task: RLVR’s data is environments, RLHF’s is human feedback, and TypeSafe has its own kind. His team works like artists studying a cognitive core, finding its jagged edges and addressing each one in a way that generalizes rather than patching a single case.

    Robustness Instead of Determinism

    Asked why there is no seed parameter, he treats reliability as a catch-all for every reason AI fails to automate something, including type safety, determinism and jaggedness. Determinism means identical inputs producing identical outputs, which he concedes is mildly interesting for unit tests and considers the wrong north star. The property he cares about is robustness: similar inputs producing similar outputs. His test is to inject UUIDs or nonces into otherwise identical prompts and check that the answers stay stable, since the question is semantically unchanged, and he notes how badly most language models fail this. Robustness, he argues, is exactly where people get burned when AI makes decisions. He is not opposed to shipping determinism if developers make the case, but notes it trades against intelligence per dollar, and that TypeSafe is doing what he cheerfully calls disgusting things to stay on that frontier. The host predicts he will be peer pressured into seeds eventually, as every provider has been, and Almeida concedes only that he has been told his brand of unshakable is a polite word for stubborn.

    Model Versioning and the Quantization Question

    The host raises the concern developers were already voicing, which is that a company facing GPU constraints and optimizing for cost has every incentive to quietly quantize a model after launch. Almeida’s answer is unambiguous: they will not change a model once deployed, and doing so would be insane for an API even if it is fine for a first party product where you can change whatever you like. What he explicitly refuses to promise is longevity. TypeSafe plans to ship new models far faster than developers expect, and he will not commit to long term support for any particular version, though he acknowledges that developers hate broken dependencies and that the current version may get an LTS designation precisely because so many people are using it. The alternative, a fleet fractured across a hundred versions while the company iterates quickly, is what he wants to avoid. He says research is underway on a better mechanism, and predicts model-to-model deltas will typically be smaller than the variance from calling a string model twice, with the large jumps coming when a previously jagged capability becomes smooth.

    Three Primitives That Are Deliberately Not Types

    The API exposes three primitives, and none of them is named after an existing programming type. The boolean-like one takes its odd spelling from the letters of Bernoulli, because what it returns is a Bernoulli probability rather than a true or false. There is a score, and there is a choice. The naming is intentional: a score is not an integer, and if a library like Instructor or Pydantic silently mapped it to an int or a float, the developer would be misled. He says they erred toward clarity over familiarity. Each primitive maps cleanly onto a programming construct rather than a type: the Bernoulli-derived value drives an if statement, a score drives sorting or thresholding above and below a cut, and a choice is a switch on an enum that you may optionally hydrate into a function call. He is scathing about function calling as the incumbent alternative, describing the enum as the important part and a function call as an extremely ugly way to expose the same thing. More types are coming, and each will map to a programming primitive.

    Decomposition, Structured State, and ML Without the ML

    Asked for pro tips, he gives the section of the interview most likely to change how people build. Every part of the input, including state, instructions and criteria, can be a structured JSON object, and he says people underread this and assume everything is strings. Flattening structured state into a templated system message is old thinking, because you would never stringify your variables inside a program except when printing for a human. Deeper nesting is harder to reason over and TypeSafe is actively working on that, but the direction makes code more legible and agnostic to implementation. He calls system messages disgusting global variables into which you dump everything and hope each instruction lands, and recommends instead asking many small questions in parallel. His refusal example makes the case concrete: rather than asking whether to refuse, ask many independent questions about specific situations, so that discovering an unhandled case is a good outcome rather than a mystery. You add the question, set the threshold, keep the example as a test, and the behavior is fixed permanently rather than until context rot erodes the prompt. He calls this ML without the ML, and notes the honest caveat that this is exactly the pattern people abandoned before, because with expensive slow models it was worse on every axis than one big call. He is candid about where the models are not yet good enough, singling out automated trading as something people should probably leave to professionals, and pointing to confidence estimates as the mechanism for escalating hard cases to a human.

    Calibration Limits, Fine Tuning, and Cascades

    The host presses on the obvious gap: thresholding is the only lever a developer has, so what happens when the calibration itself is locally wrong? Almeida immediately corrects the premise that he claimed perfect calibration, then accepts the criticism that his only answers today are decompose further or adjust the threshold. He points to a report issues button and a commitment that every model version will be noticeably better or they will stop shipping. On fine tuning he is genuinely undecided, noting that generality often helps edge cases even within a narrow task, and that other providers have launched and retracted fine tuning offerings. What he finds more promising is calibration plus a cascade, where a confident answer from a cheap model is trusted and an uncertain one escalates to a larger model. He explicitly confirms multiple model sizes are coming, and speculates that if the cheapest intelligence gets cheap enough, people might stop writing regular expressions altogether.

    A Trillion Tokens a Day and What Actually Counts

    On launch metrics he is careful about which numbers mean anything. The milestone he will name is passing a trillion tokens a day, and what matters to him is that the volume persists overnight, which means machines are calling the API rather than humans trying it out. Waitlist signups, he says, do not matter for a developer platform, and he suspects many signups are not developers at all, arriving expecting a chatbot and leaving confused. His estimate is that if every human on earth wrote a couple of queries it would be a rounding error next to one power user’s loop. The metric that actually binds is rate limits, because once a developer gets value they immediately want more. He admits the team was called marketing geniuses on social media and says there was no marketer, only a group being their genuine irreverent selves, and notes the launch video had reached roughly 38 million views. He is dismissive of neolab framing, says the company sells parody swag about it, and insists what he wants is to be a reliable developer platform rather than the most fashionable lab.

    TFP Growth and the Inverse SaaS Apocalypse

    The economic section starts from a line the host says he has never seen a lab commit to, which is total factor productivity growth above three percent in five years. Almeida ties it back to the original OpenAI charter language about performing the majority of economically valuable work, and argues the field owes an answer to how a system can solve millennium prize problems while automating a rounding error of actual work. His position is that every model today sits at roughly zero percent, possibly not yet one, and that when the shift happens it will show up in economic statistics rather than in demos. He expects no mass unemployment and a great many beneficial shifts. He also says he is tired of AI being the foreground character and wants it to disappear into the background while the world simply becomes more delightful. His sharpest observation is that software in 2026 is essentially unchanged from 2019, differing only by a chat box on the side that cannot be trusted with decisions the company has a stake in. Rather than a SaaS apocalypse, he predicts the inverse, since incumbents know better than anyone which tasks are worth automating.

    Where System One Ends

    Asked how to tell a system one problem from a system two problem now that people are trying to put Jev on everything, he says the honest answer is that it is empirical, in the same way scaling laws are empirical and in the same way robotics has not worked despite the money. His belief is that pre-trained condensations of intelligence are fundamentally system one thinkers, and that system one is simply the best available description of what language models are strong at. He is generous about RLVR’s achievements in system two while noting how fragile and fractal the resulting capability is, comparing today’s complaints about jaggedness to the old complaints that ChatGPT was general but bad at grade school math. Each paradigm’s character follows from its north star: RLHF optimizes to please humans, RLVR optimizes benchmarks by definition since a benchmark is just programmatically verifiable output, and RLCD optimizes reliability under programmatic use. The host reports his own hands-on finding that Jev is state of the art at single hop reasoning and degrades monotonically as hops increase, which Almeida accepts while framing the work ahead as unearthing and smoothing capability rather than adding reasoning in strings. TypeSafe does not discard system two tasks; the intelligent behavior on them is low confidence and high uncertainty, which is itself a useful answer.

    Four Families of Use Cases

    The company mapped its use cases from first principles long before release, and they fall into four families. The first is dark data, the piles of information large companies hoarded but never dared run a language model across because the cost was prohibitive, which he calls a data scientist’s dream and one of the two biggest volume drivers. The second is coding agents. The third is real time intelligence in the loop, where every ten milliseconds shaved improves the product, with e-commerce and assistant-style applications called out and games mentioned with obvious enthusiasm. The fourth is smart software, meaning intrinsically composable systems doing things that could not previously exist, with a programming language built on Jev cited as an example he loves. Computer use arrived from an unexpected direction and impressed him, though he notes he is as anti-demo as he is anti-benchmaxxing and wants to find the weaknesses first. He also volunteers the cost pattern he thinks people are missing, which is to attach IDs to every element of a large state, pay for that state once, and then fan many cheap parallel questions across the IDs.

    Coding Agents Built for a Single Model World

    He describes something he finds genuinely surprising happening in the coding agent space. The two leading agents are architected around a single model world, which made sense while the game consisted of shopping between broadly similar models at different capability levels. Open source coding agents are currently experimenting freely with cheap system one calls, and since they are all at rough parity and there is only so much you can do with a while loop, the first one to find a pattern that depends on this new model class will briefly hold a monopoly on it and everyone else will copy it immediately. What the incumbents do in that situation is the open question, given their architecture. He says he would love to integrate with everyone, considers it not his job as infrastructure to be opinionated, and mentions an internal design patterns document under review by his team that he hopes to publish for agent builders.

    The Argument Against Pacing the Frontier

    On the joint statements labs have signed about pacing frontier development, he calls the discussion narrow because it assumes everyone must keep doing more RLVR. He first clarifies that RLVR was never really about verifiable rewards, since that had been failing long before the reasoning era, and is better understood as a shape in which the model is given latitude to do whatever it wants in the middle in order to solve the hardest problems. That latitude is the source of both the capability and the risk, which is why he calls the framing a sleight of hand: the labs are saying they intend to keep doing the thing that produces dangerous behavior, and then describing the resulting danger as a property of the world. He notes he does not need to do any RLVR, and that zero is optimal for his shape. He assigns the fault to researchers rather than the public, since the public reasonably assumes the labs are pursuing the best available direction and has no way to know what optionality exists. He is explicit that his goal is not to convince labs to change direction but to spark hope in software engineers that the things they always wanted automated can finally be automated. Later the host relays that in at least one researcher gathering the pacing position is political positioning aimed at the 2028 election, and Almeida’s reaction is unfeigned dismay, followed by a broader objection to misleading people even in service of what someone believes is the greater good.

    Fracturing Intelligence

    His unifying technical objection to how models are built today is fracturing. Optimizing a single model for chat and for reasoning forces the intelligence to split, and the resulting pathologies are the ones users complain about constantly: sycophancy, overconfidence, hallucination, and the bolded, emoji-laden, follow-up-question style that performs well in human preference arenas without answering the question. He traces these to the weirdness of strings, where a model must be miscalibrated and mode dropped and overconfident to avoid going off the rails, because the reward model punishes visible errors so severely. This warps the probability space and then interacts badly with reasoning training. He says that at OpenAI nobody was really studying this subtlety because attention was entirely on chat. The principle extends to identity: he will not train the model to say it is Jev from TypeSafe, because that too is a fracture, and what he wants is smooth predictable intelligence that reports what the internet contains. Identity, he argues, belongs to the first party product, not the API, since nobody building a chatbot wants it announcing which model it runs on.

    Leaving OpenAI

    The origin story is the most personal part of the conversation. The host remembers a Thanksgiving sprint when Almeida cancelled everything to commandeer idle GPUs, which turns out to have coincided with the board coup, an episode he describes as annoying while declining to elaborate. The problem had been on his mind since before ChatGPT launched, when he watched that team do what he considered the right task and cared enormously about the experience. He had fought hard to deploy InstructGPT, including writing an unpublished algorithm himself because cleaning the PPO data was too slow, and it took roughly half the LLM market almost immediately. He genuinely asked whether it was AGI, given it looked superhuman at instruction in, instruction out, and says everyone should have an answer for why it was not. What actually happened is that it powered copywriting tools and what is now called slop, and he worried they had made the internet worse. He went back to first principles and asked what would be calling the AI in an actual economic revolution, humans or code. The answer was many nines of code, while all the optimization was going into the human path. He wrote a document, Sam Altman told him to go work on it, and he assumed Anthropic must already be doing it. Eventually the instruction following team declared victory, he started training models expecting a week of work, and it took years. He called Eric first, approached Sasha only for a sanity check and she folded her startup on the spot, funding closed within two weeks, and people moved into the apartment of a self-described neat freak.

    Advice for Researchers and a Verdict on Neolabs

    Asked what a frustrated frontier lab researcher should do, he answers bluntly and with visible awareness that he is burning bridges. Most neolabs, in his view, are bad, and he does not want to be counted among them. The reason is that he does not value researchers as such; he values people who care about picking the right task, which makes credentialism backwards since pure research pedigree generally does not create value. His pragmatic read is that neolabs destroy value by redoing work from scratch with a low probability of moving the frontier, and that most he has spoken to want funding to play with experiments rather than a direction. If a researcher genuinely wants to explore, he says the established labs are probably the best place to do it. If they want to solve a real problem and break out of the field’s single-track thinking, they should absolutely go. He extends the same logic to capital allocation with his flattest line on the subject, that a billion dollars would not buy him a pre-training run, because slicing, combining and Frankensteining existing capability is inelegant and solves problems.

    The Tasks He Is Giving Away

    The closing question asks which north stars he wants other people to take, since his own next fifty years are spoken for. The fun one is games. He points at a demo where NPCs could be controlled by a model and argues you would not even need to call an expensive model in the game loop, since simple intelligent state machines for NPCs could make a static world genuinely compelling, citing his own affection for Stardew Valley. The serious one is coding agents freed from the tyranny of the KV cache, the subject of a piece he titled after the Wu-Tang line. His argument is that efficient cache use forces you into a single model and a continuously appended context, which forbids state management, abstraction and decomposition, and that this single constraint explains why routing is hard, why sub-agents underperform and why compaction is such a mess. You cannot give a sub-agent a genuinely easier task because summarizing the state to hand over would cost more intelligence than the task. If context became cheap, the design space opens: hierarchies of labeled subtasks that can be searched for relevant context on demand, parallel agents reading and writing each other’s state with real coordination rather than asking each other what they are doing, and cheap access to historical context. That last one produces his best reframe, which is that continual learning is a memory management problem rather than a learning problem, since the actual deficiency is having no smart way to look things up. He hopes to publish the document, jokes that his team may veto him, and says that if he were not running a company this is what he would be doing.

    Notable Quotes

    “How can AI be so unbelievably smart? How can we like solve millennium prize problems in math but still not automate even the most basics of works?”

    Diogo Almeida, on the question he says he opens his talks with and which the entire company exists to answer

    “Refusal is just like obviously a type error. If you ever want this in a dependency running in the background, what happens if that refuses? What if someone else is using that dependency?”

    Diogo Almeida, explaining why TypeSafe does not implement refusals in an API

    “We are an API, you are a developer. It’s none of my business, right?”

    Diogo Almeida, on companies asking his permission before deploying

    “The public benchmarks are extremely extremely gameable. Even if they try not to, they still will. Back in the old days, every lab had a team to collect data that looks like MMLU to make it look better.”

    Diogo Almeida, on why TypeSafe published no benchmark numbers at launch

    “System messages are like disgusting global variables where you just put everything in there and you put all the instructions at once. And then you hope that every single instruction gets nailed instead of asking the questions in parallel.”

    Diogo Almeida, on the prompting pattern he wants developers to abandon

    “It’s 2026 now. How is the software basically exactly the same despite AI being so freaking awesome other than sometimes having a chat box on the side?”

    Diogo Almeida, making the case that AI has automated almost none of the economy

    “I obviously don’t think I need to do more RLVR on our models. I think zero is the optimal amount for our shape, right?”

    Diogo Almeida, on why he considers the frontier pacing debate built on an unexamined premise

    “If you gave me a billion dollars I wouldn’t pre-train. I still believe that to be true.”

    Diogo Almeida, on where he thinks capital is being wasted in AI research

    “When that happens, what’ll be calling the AI if AI is an API? Will it be humans or it’ll be code? And I figured it was many nines of code, but all the optimization was going into the humans part.”

    Diogo Almeida, on the question that became TypeSafe

    “Isn’t it kind of weird that you start from scratch every time and you need to solve a problem called continuous learning? That’s actually like a memory management problem because you don’t have a smart way of looking up the memory, right?”

    Diogo Almeida, reframing continual learning near the end of the interview

    This is one of the densest founder interviews in recent memory, and the summary above leaves out the tangents on mid-training, the API naming debates, the Discord town halls and the story about his chief of staff making him lock in. Watch the full conversation here.

    Related Reading

  • Why the Markets Are Pricing AI Wrong: Gavin Baker on the July 2026 Selloff, GPU Spot Prices, Memory LTAs, and Nvidia’s Credit Wrapper

    Gavin Baker of Atreides Management returned to Invest Like the Best with Patrick O’Shaughnessy days after one of the strangest months the AI trade has ever produced. AI and semiconductor names fell 40 to 60 percent in a straight line while, by Baker’s account, not a single quantitative metric on the ground deteriorated. He spent the week in Silicon Valley hunting for a bearish data point and came back with almost nothing except credit. This conversation is the result: a detailed argument that the market has mispriced the gap between contracted compute and spot compute, that open source is growing the infrastructure pie rather than shrinking it, and that the one risk actually worth fearing is political rather than financial.

    TLDW

    Gavin Baker describes July 2026 as “2022 packed into a single month,” a violent AI and semiconductor drawdown that happened while hyperscaler operating cash flow accelerated from roughly 28 percent growth to 32 percent, or closer to 35 percent adjusting for unusual legal charges. His core claim is that the installed base of GPU compute is locked into long-term contracts priced far below the current spot market, so as those contracts roll off, compute reprices higher, operating cash flow accelerates, and the buildout can be funded internally rather than with the debt that widening credit default swap spreads and a poorly received Meta bond have made look expensive. He walks through each catalyst of the selloff: Meta renting out compute (misread as a capex cut), the open source capability leap from GLM 5.2 and Kimi K3 (misread as deflationary when a token is a token and costs the same flops, watts, and memory to produce), China acquiring a domestic deep ultraviolet lithography machine (real but 25 years behind), and rising real yields (the only genuine negative). He covers the game theory of breaking a memory long-term agreement in a world where market share is set by supply allocations, Nvidia’s new credit wrapper plus revenue share model and why it is misunderstood, the router and fine-tuning stack from Fireworks and Baseten that turns “ChatGPT wrappers” into defensible AI natives, continual learning as the one technical development that could disrupt training demand, SRAM accelerators for disaggregated inference, SpaceX as an underappreciated compute company with orbital ambitions, and his view that regulation, not fundamentals, is the biggest risk because the industry has done a terrible job telling its own story. He also makes an unusual observation about market structure: everyone now feeds news into Claude, and Claude has become a kind of Walter Cronkite for the stock market, collapsing the diversity of interpretation that normally keeps markets stable.

    Thoughts

    The load-bearing claim in this episode is the spread between contracted and spot compute, and to Baker’s credit it is falsifiable in a way most bull cases are not. He is not arguing that AI will be transformative or that demand feels strong. He is arguing something narrow and checkable: hyperscalers and neoclouds signed multi-year GPU contracts in 2024 and 2025 at prices that assumed a gentle decline, prices instead went vertical, and the installed base is therefore systematically under-earning. A startup rented several thousand B200s in the mid two dollars per GPU hour range and expects to pay just under four dollars for an identical cluster seven months later. If that repricing is real and broad, hyperscaler operating cash flow mechanically accelerates and roughly 700 billion dollars of projected credit demand evaporates. If GPU rental prices roll over and stay down for two consecutive quarters, the thesis is dead. That is the number to watch rather than any earnings headline. The caveat he steps past quickly is that the open source mix shift he describes as bullish does not eliminate margin, it relocates it, out of the frontier labs and down into the infrastructure layer. Excellent if you sell GPUs, power, and memory. Considerably more awkward for the labs whose projected cash flows are the reason anyone believes the compute gets paid for at all.

    The Claude as Walter Cronkite observation deserves more attention than it got, where it passed as a joke. Baker is describing a genuine change in market microstructure. Every institutional and retail participant now feeds the same news into roughly the same models, and while those models are probabilistic, they are not producing meaningfully diverse readings of the same headline. He connects this to Michael Mauboussin’s argument that a breakdown in diversity, not leverage alone, is what produces bubbles and crashes. If that is what happened in July, then the Japanese capacitor stock chart he cites, an entire three-year cycle compressed into six weeks before the fundamentals had even arrived, is not a curiosity. It is the signature of a market where thousands of participants share one interpretive engine. That makes drawdowns faster and deeper without making them more informative, which argues for holding through machine-generated narrative cascades rather than trading them.

    The middle of the conversation contains the most consequential business idea in it, and it is one that got almost no coverage during the selloff: memory long-term agreements and Nvidia’s credit wrapper are the same move executed at two different layers of the stack. Both trade near-term upside for durability. The memory companies stopped maximizing spot price and started signing prepaid agreements with floors and ceilings, and the reason those agreements will hold is that the penalty for breaking one has changed category. Apple could renege on memory pricing for years because its volume was overwhelming and it had no equivalent competitor. In a world with four buyers that matter and where AI market share is set by supply allocation rather than product quality, a supplier can answer a broken price agreement by breaking the volume commitment and handing your allocation to a rival, in an industry where oversupply is always followed by undersupply. Nvidia is running the same play one layer up. The credit wrapper with a revenue share above a price floor converts a cyclical one-time chip sale into a royalty on recurring compute revenue, financed on someone else’s balance sheet, which is a materially better business than selling hardware. It also widens the moat, because a startup accelerator pays more at the foundry, pays more for high bandwidth memory, and cannot finance its chips at Nvidia’s rate. Baker is right that this is misunderstood, and it is a strange thing for a stock at a ten-year-low forward multiple to be quietly doing.

    The technical material in the back half reveals an asymmetry worth naming. Baker treats two efficiency developments very differently. Continual learning and sample efficient learning, which several labs believe are close, would collapse the token budget required to produce a capable model, and he handles this by asserting that training asymptotes to a small but nonzero share of compute and that the outcome would be wonderful for the world anyway. SRAM-based accelerators for disaggregated inference, running prefill on one chip, attention on a high-memory chip, and the feed forward network on SRAM, he embraces enthusiastically as a return-on-investment improvement across the installed base. Both are efficiency gains. One is treated as neutral, the other as clearly positive, and Jevons paradox is doing all the work in both directions. That is probably correct given everything we have observed so far, but it is an assumption rather than a finding, and it is the assumption on which the entire “cheaper compute is bullish for compute” framework rests. Worth noting too that the SRAM disaggregation point is genuinely underdiscussed: those chips sit on older nodes and do not compete for leading-edge capacity, so they are additive supply rather than substitute supply.

    The final twenty minutes hold both the largest unpriced upside and the largest unpriced risk, and neither is in consensus estimates. On the upside, only the hyperscalers, CoreWeave, Crusoe, and SpaceX have ever brought more than 500 megawatts online in a single year, and SpaceX has done it fastest and cheapest. When it dumped a large block of compute into the market, the market absorbed it without a blip, which tells you more about demand than any survey. Baker’s sanity check on orbital compute is the sharpest reasoning move in the episode: Benchmark, from entirely outside the Elon ecosystem and without the benefit of internal launch costs, funded StarCloud at a real valuation, so the set of people who would all have to be wrong keeps growing. On the downside, regulation is the risk he names first and it is the one his own framework cannot arbitrage. New York’s data center moratorium is not a fundamentals problem, and no amount of operating cash flow acceleration fixes a permitting ban. His diagnosis is that the industry finds the benefits so obvious that it never learned to explain them, which is how a water usage figure overstated by four orders of magnitude became conventional wisdom. Proposing a foundation that buys World Series ad time is a tell about how far behind he thinks the industry is. Every other risk in this conversation is priced somewhere. That one is not.

    Key Takeaways

    • Baker characterizes July 2026 as “2022 in a month,” with AI names down 40 to 60 percent from their highs in a straight line while underlying fundamentals improved.
    • He spent the week in Silicon Valley explicitly hunting for a negative quantitative metric and found essentially one: third-party data suggesting Anthropic’s growth curve came slightly off trajectory, a data point Anthropic shareholders reportedly dispute.
    • Nvidia was trading at its lowest forward price to earnings multiple in ten years at the time of recording. The only cheaper moments were the DeepSeek shock and Liberation Day, both of which proved to be V-bottoms.
    • A low forward multiple means the market believes these companies are significantly over-earning. Baker’s counter is that they are under-earning because their installed compute is contracted below spot.
    • Combined operating cash flow at Microsoft, Meta, and Amazon accelerated from roughly 28 percent to 32 percent growth, or to about 35 percent after adjusting for an unusual quarter of legal and regulatory charges.
    • Nobody in 2024 or 2025 modeled old GPU prices going vertical in 2026. The bull case assumed a slow decline in rental rates and the bear case assumed a steep one.
    • A concrete example: a well-known startup rented several thousand Blackwell B200s in the mid two dollars per GPU hour range and expects to pay just under four dollars for an identical cluster seven months later, a 50 to 60 percent increase.
    • One inference cloud stated publicly that it plans to pay roughly 100 percent more for Blackwells when its current contract expires.
    • Neoclouds were often forced into below-market long-term contracts because they needed an offtake agreement to finance the GPUs in the first place.
    • Consensus models hyperscalers monetizing Blackwell and Rubin at roughly Ampere rates, two generations behind, producing about 1.3 to 1.4 trillion dollars of hyperscale operating cash flow. Assuming monetization merely at a discount to current Blackwell rates pushes that closer to two trillion and removes roughly 700 billion dollars of credit demand.
    • The credit concerns are real and undeniable: real yields are up, spreads have widened, credit default swap levels for the large buyers have blown out, and a recent Meta bond did not price where a Meta bond should price.
    • Baker’s response is that debt-fueled buildouts demand immediate repayment and unwind violently, which is what happened in the internet buildout, but this buildout is still overwhelmingly funded from operating cash flow.
    • If credit is not available, he argues the existing flops simply become more valuable, which is self-correcting rather than catastrophic.
    • The Meta selloff catalyst was a misread. Meta renting out compute was interpreted as excess capacity and a capex cut. Meta did not cut capex, and the actual motivation appears to have been demonstrating strong internal rates of return on a small slice of capacity ahead of a capital raise.
    • The open source panic was also a misread. Open source taking token share moves margin dollars out of the frontier model layer, but a token still requires the same flops, memory, and watts to produce, so infrastructure demand rises rather than falls.
    • Frontier tokens carry gross margins somewhere in the 80 to 95 percent range. Open source tokens might carry 30 percent. The customer’s savings come almost entirely out of that margin, not out of compute consumption.
    • Baker calls open source “dark matter to the public markets,” growing rapidly through GLM 5.2, Kimi K3, and Nvidia’s Nemotron, but nearly impossible for public investors to measure since it runs through private inference clouds.
    • Jensen Huang being the world’s loudest supporter of open source is itself evidence that open source is good for Nvidia’s business.
    • Enterprises that blow through their AI budget in three months set up a router, which cuts their spend but often increases total GPU hours consumed by shifting volume to cheaper open source tokens.
    • Adoption is happening in staggered waves: AI natives are all in and hiring very few humans, coastal public companies are optimizing, East Coast and non-coastal companies have barely adopted, and Europe is trying to regulate AI before using it.
    • Roughly 500,000 people worldwide use agentic AI, and perhaps half that number use it seriously, yet the world is already in an acute compute shortage. The relevant question is what happens at 100 million or 500 million users.
    • Token spend at the most AI-forward companies now runs 20 to 25 percent of total compensation spend, with individual examples at 30 percent and reports as high as 50 percent, against a roughly 25 trillion dollar global knowledge work market.
    • Founder-controlled companies are not conducting large-scale layoffs, which suggests the cash flow to pay for AI is expected to come from growth rather than from labor substitution.
    • Memory is the dominant variable in token economics. More memory per unit of compute yields more tokens out, which lowers cost per token, which is why demand has shown no negative elasticity to memory pricing.
    • Memory suppliers have shifted from maximizing near-term price to signing long-term agreements with prepayments, floors, and ceilings, trading short-term upside for durability.
    • Breaking a memory long-term agreement is now potentially fatal. With four buyers that matter at scale and market share determined by supply allocation, a supplier can respond by breaking the volume commitment and handing your allocation to a competitor.
    • This is structurally different from the Apple era, when a single dominant buyer could break pricing agreements without consequence.
    • Nvidia’s new model is best described as a credit wrapper with a revenue share triggered when GPU prices exceed a floor. It is not vendor financing, since a third party lends the money, and it could produce a very large cloud-scale royalty business quickly.
    • Baker thinks this model is badly misunderstood, meaningfully increases Nvidia’s revenue per gigawatt, and strengthens its competitive position against startup accelerators that pay more at the foundry, pay more for high bandwidth memory, and cannot finance their chips as cheaply.
    • Nvidia has taken equity stakes across the ecosystem, and Baker’s read is that every time they have not taken a stake it has proven to be a mistake.
    • The scenario that would genuinely frighten him: hyperscaler operating cash flow stops accelerating, forcing the buildout onto debt, or a sustained sharp contraction in GPU rental prices. Nobody he has spoken to says they have too many GPUs.
    • Continual learning and sample efficient learning are the technical developments most likely to disrupt training demand, and several new labs including Safe Superintelligence are focused on them. Baker still thinks training asymptotes to a small share of compute rather than to zero, and that the change would be enormously good for the world regardless.
    • Fireworks launched a product called Nexus that plugs into Claude Code, OpenAI Codex, or Grok in roughly three lines of code, ingests a customer’s data, applies reinforcement learning to a model, and routes queries appropriately.
    • This stack is what converts an alleged “ChatGPT wrapper” into a defensible company. Shifting 30 to 60 percent of token consumption to a customized open model on top of frontier orchestration produces better outcomes at roughly half the cost.
    • Cheap, capable open source models may actually inflate the value of the very best frontier model, since a 160 IQ orchestrator becomes more valuable when it has an army of cheap 120 IQ models to direct.
    • The inference clouds are growing almost as fast as the frontier labs did in their early days while burning very little cash, which is extraordinary by any conventional software metric.
    • China obtaining a domestic deep ultraviolet lithography machine is a genuine phase transition and should not be dismissed, but the technology is roughly 25 years behind extreme ultraviolet, and lithography progress is learning by doing that cannot be teleported through.
    • Baker considers regulation the biggest single risk to AI, citing New York’s data center moratorium as the first of many and describing the current environment as post-factual and post-logical.
    • The public narrative that data centers raise power bills, drain water, and destroy jobs is largely wrong. Behind the meter deals typically lower local electricity prices, and modern community agreements include hospitals, schools, police and fire stations.
    • The widely cited data center water figure originated in a published error overstating usage by roughly 10,000 times, since acknowledged by the author, which Baker likens to the decimal point error that created the myth that spinach is exceptionally high in iron.
    • He argues data centers are among the best things to happen to blue collar wages in his lifetime, with ongoing rather than one-time employment from maintenance, replacement, and upgrade cycles.
    • SRAM-based accelerators built on older nodes and free of high bandwidth memory constraints could substantially improve return on investment by allowing disaggregated inference: prefill on one chip, attention on a high-memory chip, and the feed forward network on SRAM.
    • SpaceX has improved fundamentally since going public, and Baker believes the market does not yet understand it as a compute company. Only the hyperscalers, CoreWeave, Crusoe, and SpaceX have ever brought on more than 500 megawatts of power in a single year, and SpaceX has done it fastest and cheapest.
    • A widely circulated report claims SpaceX intends to bring on eight gigawatts of compute in 18 months. Baker doubts the number but notes that at roughly 50 billion dollars of monetization per gigawatt, even a fraction of it dwarfs the current consensus estimate.
    • When SpaceX dumped a large block of compute into the market, it was absorbed without a blip, which Baker reads as one of the more bullish demand signals of the year.
    • Orbital compute feels more real every day. Benchmark funding StarCloud, from outside the Elon ecosystem and without access to internal launch costs, functions as a useful sanity check on the idea.
    • Dark horse names Baker flags for the next phase: Lip-Bu Tan, Lin Qiao at Fireworks, and Scott Wu at Cognition.

    Detailed Summary

    A Selloff That Contradicted Every Fundamental

    Baker opens by describing July 2026 as 2022 compressed into a single month. AI names fell 40 to 60 percent from their highs in a nearly straight line. What made the month unusual was not the magnitude but the absence of a legible cause. In 2022 the market feared recession, rising rates, and inflation. During the DeepSeek shock and Liberation Day you knew exactly what the market was reacting to. This time the fundamentals moved in the opposite direction from the tape. GPU availability tightened, GPU rental pricing rose, DRAM spot prices rose, and token growth accelerated. Baker asked Patrick, who had also spent the summer in Silicon Valley, whether he had heard a single negative quantitative metric or a single instance of deceleration. The answer was nothing.

    Part of the problem is visibility. Public markets cannot see Anthropic or OpenAI directly, and they cannot see the American open source inference clouds like Fireworks, Baseten, Modal, and Together that monetize inference. Everyone stares at the same chart of semiconductor cash flow rising while hyperscaler free cash flow falls, and that chart omits the private companies entirely. It also omits the repricing dynamic Baker considers the most important fact in the market.

    The Spot Versus Contract Gap

    In 2024 and 2025 every serious forecast assumed GPU rental prices would decline, with the only debate being how fast. Neoclouds locked in long-term contracts partly out of prudence and partly because they needed offtake agreements to finance the hardware at all. The result is a large installed base of contracted compute trading at a steep discount to today’s spot market. Baker’s argument is that as those contracts roll off, compute reprices higher even if spot itself declines from current levels, and that repricing flows directly into hyperscaler operating cash flow.

    The anecdotes are stark. A prominent startup rented several thousand B200s in the mid two dollar per GPU hour range and expects to pay just under four dollars for an identical cluster seven months later. One inference cloud said publicly it plans to pay roughly double for Blackwells at contract renewal. Baker’s read is that hyperscalers are therefore under-earning across the board, which is the exact opposite of what a ten-year-low forward multiple implies the market believes.

    Financing the Buildout and the Credit Question

    Credit is the one bearish input Baker concedes is real. Real yields have risen, spreads have widened, credit default swap levels have blown out across the large buyers, and a recent Meta bond did not price the way a Meta bond should. Sophisticated private capital investors told him this is just banks hedging commitments, but he acknowledges the optics are bad and the facts are undeniable. His concern is the classic capital cycle: debt-financed buildouts demand immediate repayment, so when supply and demand slip out of alignment the unwind is fast and brutal, exactly as it was in the internet buildout.

    The math he ran is the counterweight. Consensus effectively models hyperscalers monetizing Blackwell and Rubin at Ampere rates, two generations behind, producing 1.3 to 1.4 trillion dollars of operating cash flow. Assume instead that they monetize merely at a modest discount to current Blackwell rates and the figure approaches two trillion, taking about 700 billion dollars of credit demand off the table. Better cash flow also improves the credit ratios, which makes debt cheaper if they choose to use it. And if credit disappears entirely, the flops already installed simply become more valuable. Microsoft brought on a large slug of capacity in June that did not even appear in second quarter results.

    How the Month Actually Unfolded

    Baker walks the sequence of catalysts. First, Meta announced it would rent out compute, which the market read as excess capacity and an imminent capex cut. Meta did not cut capex. What Meta appears to have seen was SpaceX selling trading-optimized clusters into the market at an enormous premium to contracted rates, and the plan was likely to demonstrate strong returns on a small slice of capacity before raising equity capital and increasing capex. Shortly afterward Meta released its best model in a long time, overshadowed by a competing release but a clear signal it was not easing off.

    Next came the open source freakout. Kimi K3 arrived, the widely watched token index dipped and flattened, and the two were connected: the index captures mix, and a shift from expensive frontier tokens toward open source tokens looks like weakness even when total compute consumption is rising. Then China’s deep ultraviolet lithography news triggered a broad selloff in semicap equipment. Finally, rising real yields and widening spreads gave the market a genuine reason to worry. Baker’s summary is that with the sole exception of credit, every one of these narratives was factually wrong, and a friend at Fidelity described the winning strategy of the past three years as doing the dumbest, most superficial thing as fast as possible and cycling between them.

    Open Source as Dark Matter

    The most important conceptual argument in the episode is that a token is a token. Regardless of which model produces it, a token consumes the same flops, the same memory, and the same watts. Open source taking share therefore does not reduce compute demand. It transfers margin from the frontier model layer, where gross margins might be 90 percent, to open weights inference at perhaps 30 percent, and the resulting price decline drives elasticity in token volume. Since frontier labs and open source models both run on the same underlying cloud infrastructure at the same compute cost, the effect is to push margin dollars down into the infrastructure layer.

    Baker calls open source dark matter to public markets. It is real, it is accelerating on the back of capability leaps from GLM 5.2 and Kimi K3, Nvidia continues to push Nemotron closer to the frontier, and yet none of it appears in audited financials that public investors can underwrite. He also notes the tell that should have settled the debate: Jensen Huang is the world’s most vocal supporter of open source, which would be an odd position for the largest beneficiary of frontier concentration to hold if open source actually threatened the business. Baker adds a normative point, that a world with only one or two dominant frontier models charging 90 percent margins is not good for humanity, and that many models is the better outcome.

    Routers, Fine-Tuning, and the End of the Wrapper Insult

    The practical mechanism behind the open source surge is the router plus fine-tuning stack. Inference clouds have become genuinely good at supervised fine-tuning and reinforcement learning, so a company can take its proprietary data, customize an open weights model, put it behind a router, and have the router send most queries to that model while escalating to a frontier model for verification or harder work. The result is often slightly better outcomes at half the cost. Fireworks shipped a product called Nexus that connects to Claude Code, OpenAI Codex, or Grok in roughly three lines of code and handles ingestion, reinforcement learning, and routing.

    This changes the durability question for AI natives. Two years ago the criticism was that these companies were thin wrappers with no defensibility. Now a company with domain-specific proprietary data can train on it, own the model serving 30 to 60 percent of its tokens, and get off the frontier lab treadmill it previously had no choice but to accept. Baker points to Cursor, Harvey, and others leaning hard into this. He also raises the counterargument fairly: some believe that once a frontier model achieves recursive self-improvement it will serve every intelligence level more cheaply through distillation, leaving no room for open source. He does not dismiss it, but he thinks the proprietary data held by AI natives and the orchestration value of the single smartest model make the multi-model future more likely. Cheap 120 IQ models arguably make a 160 IQ orchestrator more valuable, not less.

    Where the Money Comes From

    The pushback Baker gets on X is fair: even if hyperscalers are under-earning, where does the customer revenue ultimately come from? Definitionally it must come from faster economic growth through productivity or from labor substitution. He sees labor substitution happening at AI natives, though not through firing. They simply never hire the humans, and gross profit dollars per full-time employee at these companies is vertical compared with prior startup generations. Token spend now runs 20 to 25 percent of total compensation spend at the most aggressive companies, with individual examples at 30 percent and reports as high as 50 percent, against a roughly 25 trillion dollar global knowledge work market.

    The encouraging signal is that founder-controlled companies, the ones most likely to move fast on efficiency, are not conducting large-scale layoffs once you adjust for pandemic-era overhiring. That suggests they see continued opportunity for people plus large token budgets rather than a straight substitution. Data from Cognition, Ramp, and Stripe indicates that companies spending the most on AI are growing meaningfully faster, though Baker acknowledges the skeptics’ point that these datasets do not control for industry.

    The Memory Supply War and LTA Game Theory

    Everything is currently in shortage, and Baker argues the constraint is energizing gigawatts rather than manufacturing. Turbine makers and diesel generator makers are ramping, old aircraft turbines are being stripped and reconditioned for data center power, and regulatory policy is moving favorably. The transition he says he got wrong is the shift, especially in memory, from maximizing short-term pricing to signing long-term agreements with customer prepayments, price floors, and price ceilings.

    The reason those agreements will hold is game theory. Memory is the axis around which everything else revolves, because more memory per unit of compute means more tokens out, which lowers cost per token, which is why demand has shown essentially no negative elasticity. Market share among the four buyers that matter (Amazon with Trainium, Google with TPUs, AMD, and an Nvidia bigger than all of them combined) will be determined for years by supply chain allocation. Break a long-term agreement to chase a lower price in an oversupply year and the supplier can break the volume commitment in return and hand your allocation to a competitor. Since oversupply in this industry is reliably followed by undersupply, that is a decision that can end a franchise. Apple could get away with this historically because its volume was overwhelming and it had no equivalent competitor. That world is gone.

    Nvidia’s New Playbook

    Baker finds Nvidia’s low multiple hard to reconcile with how thoroughly the current environment favors it. If chips need to be financed, nothing on earth is more financeable than an Nvidia GPU. If land and power are the constraint, Nvidia has been playing the matchmaking chess game well. On top of that they have rolled out what Baker describes as a credit wrapper with a revenue share that kicks in when GPU prices sit above a floor. It is not vendor financing, since someone else lends the buyer the money. What it does is give Nvidia a royalty on recurring compute revenue, which could amount to a very large cloud business built entirely out of royalties, while helping bridge the cash flow mismatch between an industry that has gone free cash flow negative and a supplier collecting all the cash.

    Asked what he would do as a memory CEO, Baker says he would do exactly what Nvidia is doing: approach GPU and accelerator buyers, participate in the credit wrapper, perhaps put up cash upfront to make lenders comfortable, and take a cut of ongoing revenue. He expects firms like Blackstone and Apollo are pitching variants of this to the memory companies already. He also thinks the arrangement quietly widens Nvidia’s competitive moat, since startup accelerator companies pay more at the foundry, pay more for high bandwidth memory, and cannot finance their chips at Nvidia’s rate. And he notes that essentially every time Nvidia has declined to take an equity stake in something, it has turned out to be a mistake.

    What Could Break the Thesis

    Pressed for the scenario that would flip him, Baker names two. The first is operating cash flow failing to accelerate, which would force the buildout onto debt and validate the credit bears. That outcome depends largely on whether the combined trajectory of Anthropic, OpenAI, Grok, Cursor, and open source keeps compounding. The second is a sustained sharp contraction in GPU rental prices. The market would react instantly, and it would mean the compute shortage had broken. As of the recording, not a single person he has spoken with says they have too many GPUs.

    The technical wildcard is continual learning and sample efficient learning. Many researchers believe both are close. A human learns effectively on something like 20 billion tokens while frontier models train on 300 trillion, so a model that could be trained on 10 trillion tokens and then learn efficiently in the world would represent a discontinuity in training demand. Baker thinks training will asymptote to a small but nonzero share of compute regardless, and that the development would be extraordinarily good for the world. He also notes Nvidia is deeply involved with essentially all of the labs pursuing it.

    China, Lithography, and Decoupling

    On China’s deep ultraviolet lithography machine, Baker holds both views at once. It is a genuine phase transition, comparable to going from having no propeller plane to having one, because they did not have it before and now allegedly they do. It is also roughly 25 years behind extreme ultraviolet, and lithography is learning by doing, so you cannot teleport through the required cycles. He suspects the market overreacted and that if it ever affects ASML’s order book it will be years out, by which time the market will have forgotten and rediscovered the concern several times.

    He is careful about certainty here. It is very hard for an American to have real clarity on what is happening inside China, the people there are extremely capable and work brutally hard, and they consider this existential for the country. There are unverified reports that an extreme ultraviolet machine was smuggled in, which he treats as noise. His larger point is that decoupling is now self-reinforcing on both sides, it is unfortunate, and neither side is going to stop.

    Regulation, Data Centers, and a Failure of Storytelling

    Asked for the worst thing that could happen to AI, Baker answers regulation without hesitation. New York’s data center moratorium feels like the first of many, and even deep red pro-growth states are telling the industry it is doing a poor job explaining itself. The political narrative among ordinary Americans is that data centers will raise electricity prices, drain water supplies, and eliminate jobs. Baker’s counter is that behind the meter deals generally lower local electricity prices, that community agreements now routinely include hospitals, schools, police stations, and fire stations rather than the old model of buying the fire department new trucks, and that the jobs are ongoing rather than one-time because of continuous maintenance, replacement, and upgrade cycles.

    The water claim is the clearest case of a myth outrunning the correction. An author overstated data center water usage by roughly 10,000 times, has acknowledged the error repeatedly, and the figure still circulates. Patrick offers the parallel of the spinach iron myth, created by a misplaced decimal point in an academic text and still believed 80 years later. Baker’s proposed remedy is blunt: a foundation or political action committee running ads during the Final Four, NFL games, and the World Series explaining what a data center actually does for a community, alongside the story of AI accelerating medical research and improving outcomes for people with serious illness. The people building this find the benefits so obvious that they assume everyone already knows, and they cannot process how divergent their view is from most Americans.

    SRAM Accelerators and Disaggregated Inference

    An underdiscussed development, Baker argues, is what happens when SRAM-based accelerators arrive at scale. These chips are not constrained by high bandwidth memory and are often built on older nodes, so they do not compete for the leading edge capacity that GPUs consume. Inference disaggregates into prefill and decode, and decode splits further into attention and the feed forward network. The holy grail is running prefill on a chip without high bandwidth memory, attention on a high-memory chip, and the feed forward network on SRAM, which nothing beats for that workload. Since workloads keep changing, no single chip can get the ratio of compute to high bandwidth memory to on-die SRAM permanently right, which is precisely the argument for disaggregation. Baker expects this to be strongly positive for the return on investment across the installed base and on new compute.

    SpaceX, Orbital Compute, and Dark Horses

    Baker does not think the market understands SpaceX as a company yet, and he considers it the most important new public company. The fundamentals have improved since the IPO, and the compute story is the part being missed. Only the hyperscalers, CoreWeave, Crusoe, and SpaceX have ever brought more than 500 megawatts of power online in a single year, and SpaceX has done it fastest and cheapest while building clusters customers actually like. When SpaceX dumped a large block of compute into the market, it was absorbed without a blip, which Baker treats as one of the most bullish demand datapoints available. A circulating Substack report claims eight gigawatts within 18 months. He doubts that figure and quotes it only because it is public, but at roughly 50 billion dollars of monetization per gigawatt against a 73 billion dollar consensus estimate, even partial delivery would overwhelm expectations. There is a well-known New York hedge fund short case built on spot compute prices falling 90 percent.

    On orbital compute, Baker says time at Starbase left him thinking it feels more real every day, and the Starship landing reinforced it. His sanity check is that Benchmark, from entirely outside the Elon ecosystem and without the benefit of internal launch costs, chose to fund StarCloud at a real valuation, with SpaceX partnering to provide the Starlink laser technology that orbital compute requires. As he puts it, maybe he is crazy, maybe Elon is crazy, maybe Benchmark is crazy, and maybe the SpaceX engineers are crazy too, but all of that being true simultaneously does not seem probable. Asked for dark horses who could become as consequential as the current giants, he names Lip-Bu Tan, Lin Qiao at Fireworks, and Scott Wu at Cognition. The episode was recorded at Benchmark’s offices, at the table where their dinners are held.

    Notable Quotes

    “I want to be scared. I don’t want to feel like a lunatic watching these stocks get cheaper thinking the expected forward returns are going up.”

    Gavin Baker, on why he spent the week in Silicon Valley hunting for bearish data

    “I would describe July as 2022 in a month.”

    Gavin Baker, characterizing a 40 to 60 percent drawdown in AI names that happened in a straight line

    “Have you heard a single negative quantitative metric about AI? A single instance of deceleration?”

    Gavin Baker to Patrick O’Shaughnessy, framing the central contradiction of the month

    “A token is a token, and you need the exact same amount of compute to make a token. It takes the same amount of flops, the same amount of memory, the same amount of watts.”

    Gavin Baker, on why the open source panic misread infrastructure demand

    “Open source is kind of dark matter to the public markets. It’s hard for public markets to measure it.”

    Gavin Baker, on why the fastest-growing part of inference demand is invisible in audited financials

    “Claude is kind of Walter Cronkite for the stock market and everybody just believes whatever it says. And by the way, it’s really smart, but it’s not always right.”

    Gavin Baker, on the collapse of interpretive diversity among investors

    “Nvidia is actually, as we record this, at its lowest forward PE of the last 10 years.”

    Gavin Baker, noting the only cheaper moments were the DeepSeek shock and Liberation Day, both V-bottoms

    “If you break your LTA and then in the next two or three years for any reason leverage shifts back to the memory guys, you’re out of business.”

    Gavin Baker, on why long-term agreements will hold through the next memory cycle

    “If you need to be able to finance the chips, and you do, nothing’s more financeable than an Nvidia GPU. Nothing.”

    Gavin Baker, on why the current environment favors Nvidia more than its multiple suggests

    “Data centers are in a lot of ways the best thing to happen for blue collar wages in my lifetime.”

    Gavin Baker, on the gap between the political narrative and the local economics

    “A lie could go around the world faster than truth gets out of bed.”

    Gavin Baker, on a data center water usage figure overstated by roughly 10,000 times that still circulates

    “One of Elon’s phrases is we specialize in making the impossible late.”

    Gavin Baker, on why he doubts the eight gigawatt figure without betting against SpaceX

    Watch the full conversation here: Why the Markets Are Pricing AI Wrong with Gavin Baker on Invest Like the Best.

    Related Reading

    • Invest Like the Best on Colossus the show’s home, where the full episode archive and transcripts live.
    • Atreides Management Gavin Baker’s firm and the vantage point behind these compute and semiconductor calls.
    • More Than You Know by Michael Mauboussin, the source of the diversity breakdown framework Baker invokes to explain why markets crash when everyone reasons the same way.
    • High Bandwidth Memory (Wikipedia) background on the memory technology that sits at the center of the long-term agreement game theory.
    • Fireworks AI the inference cloud whose routing and fine-tuning stack Baker credits with making open source models competitive for production workloads.
  • Gavin Baker on Orbital Compute, TSMC, Frontier AI Models, Anthropic’s Vertical Take Off, and the Coming Wafer Shortage

    Gavin Baker, founder and CIO of Atreides Management, returns to Patrick O’Shaughnessy’s Invest Like the Best for his sixth appearance. He calls the current AI moment the most extraordinary moment in the history of capitalism, walks through what Anthropic’s vertical takeoff in revenue actually means, lays out why orbital compute is closer than skeptics believe, dissects the TSMC bottleneck that may be the only thing standing between today’s market and a full-on AI bubble, and rates every hyperscaler on how they have positioned for a world where frontier model providers may stop selling API access altogether.

    TLDW

    Anthropic added eleven billion dollars of ARR in a single month, which is roughly the combined business of Palantir, Snowflake, and Databricks built over a decade. That is the setup. From there Gavin Baker covers the March and April selloff, the contrarian read that a closed Strait of Hormuz was actually bullish for American manufacturing competitiveness, why Anthropic and OpenAI multiples may be misleadingly cheap on an unconstrained run rate basis, why Elon Musk’s discipline on SpaceX valuation created a superpower of permanent access to capital, the practical engineering case for orbital compute as racks in space rather than Pentagon sized space stations, why TSMC’s capacity discipline is the single most important variable in whether the AI cycle becomes a bubble, what Terafab in Texas changes, why the Pareto frontier of AI models has flipped from Google dominance to Anthropic and OpenAI dominance in nine months, the shift from all you can eat AI subscriptions to usage based pricing and what that means for revenue scaling, Richard Sutton’s bitter lesson as the largest risk to the AI trade, why frontier tokens still capture an overwhelming share of economic value, the role of continual learning as the third great open question, why most new chip startups should not try to build a better GPU, why Cerebras did something different and hard, why disaggregated inference may extend GPU useful lives to ten or fifteen years and rescue the private credit industry, why being in the token path is the new venture filter, the new prisoner’s dilemma around releasing frontier models via API, an honest rating of Google, Meta, Amazon, and Microsoft, why personal safety is becoming a real AI era risk, and why he remains an AI optimist maximalist who believes this could be the next Pax Americana.

    Key Takeaways

    • Anthropic added eleven billion dollars of ARR in one month, more than the combined businesses of Palantir, Snowflake, and Databricks built across a decade. There is no precedent for this in the history of capitalism.
    • The SaaS and cloud revolution created between five and ten trillion dollars of value over twenty years. AI is replaying that compression on a timeline measured in months.
    • The March selloff was a drawdown driven by disagreement with price action, not invalidated thesis. That is the kind of drawdown an investor can lean into.
    • Deep Seek Monday in January 2025 was a similar setup. By the day of the selloff, AWS Asia GPU prices had already doubled, GPU availability had fallen, and it was obvious reasoning models would be vastly more compute hungry at inference. The market priced the opposite.
    • The Strait of Hormuz closing was actually positive for America. US natural gas (the primary input into US electricity, which feeds AI) fell twenty percent on Bloomberg while Asian and European natural gas doubled or tripled. American manufacturing competitiveness improved overnight.
    • The US is now the world’s largest producer and exporter of oil and gas. The economy is dramatically less energy intensive than in the 1970s. The shortage trauma comparison does not hold.
    • Tech as a sector traded as cheaply versus the rest of the market in early April as at any point in the last ten years, into the single most bullish moment for AI fundamentals on record.
    • Anthropic is dramatically more capital efficient than OpenAI, having burned roughly eighty percent less to reach a similar revenue scale. They have very different structural returns on invested capital.
    • Anthropic at roughly nine hundred billion for fifty billion of ARR (growing a thousand percent) is striking. Adjusted for compute constraint, the unconstrained run rate could be one hundred fifty to two hundred billion, putting the implied multiple closer to five times.
    • Claude Opus generates roughly seventy percent fewer tokens for the same question than previously, with token quantity tied to answer quality. Subscribers on flat-fee plans are getting a lobotomized model.
    • Elon Musk’s superpower is twenty years of making investors money. He never pushes valuation. SpaceX compounded low thirty percent per year for a decade because Musk treats fair pricing as a sacred covenant.
    • Capitalism will solve the watts shortage. The current bottleneck has shifted from chips and energy to zoning and political approval. Many capex decisions are paused until after the US midterms.
    • The watts shortage probably begins to alleviate in 2027 and 2028. Orbital compute solves it longer term.
    • Orbital compute is not Pentagon sized data centers in space. It is racks in space. A Blackwell rack is three thousand pounds, eight feet tall, four feet deep, three feet wide. SpaceX has shown a satellite roughly that size.
    • The satellites operate in sun synchronous orbit so solar wings (around five hundred feet per side) always face the sun and the radiator on the dark side always points to deep space.
    • Starlink V3 satellites already run at around twenty kilowatts. A Blackwell rack runs at one hundred kilowatts. SpaceX engineers express genuine confidence they have already solved cooling and radiator design at these scales.
    • Racks in space are connected with lasers traveling through vacuum, the same lasers already on every Starlink. SpaceX operates the world’s largest satellite fleet and, via xAI Colossus, the world’s largest data center on Earth.
    • Inference will move to orbit. Training will stay on Earth for a long time. Terrestrial data centers remain valuable for the rest of an investor’s career.
    • The wafer bottleneck is structural and political. TSMC is essentially Taiwan’s GDP, water, and electricity. The leaders see themselves as inheritors of Morris Chang’s sacred legacy and they do not behave like a Western public company.
    • Jensen Huang has never had a contract with TSMC. The relationship is run on handshakes and the assumption that things will be fair over time.
    • If TSMC did everything Jensen wanted, Nvidia could be selling two to three trillion dollars of GPUs in 2026 and 2027. TSMC’s discipline is the single largest factor preventing a true AI bubble.
    • Historically, foundational technologies always get a bubble. Railroads, canals, the internet. The current AI buildout is overwhelmingly funded out of operating cash flow, GPUs are running at one hundred percent utilization, and that is fundamentally different from the year 2000 fiber overbuild.
    • If one of Intel or Samsung Foundry catches up at the leading node, the other will follow, and TSMC’s discipline collapses. Watch TSMC capacity decisions to predict a bubble.
    • Terafab, the SpaceX and Tesla joint venture to build the world’s largest fab in America, has a partnership with Intel that grants access to fifty years of institutional foundry knowledge. The A teams at ASML, KLA, Lam Research, and Applied Materials will follow Elon’s reputation in hardware engineering.
    • The hiring playbook for Terafab includes building Taiwan Town, Japan Town, and Korea Town next to the fab. Recruit the engineers and import their families, their restaurants, and their staff.
    • Frontier tokens still capture an overwhelming share of all economic value created at the model layer. This is surprising and is one of the three big open questions for AI investing.
    • The Pareto frontier of intelligence versus cost has flipped. Nine months ago Google’s TPU dominated every point on the frontier. Today Anthropic and OpenAI dominate, with Grok 4.3 on the frontier and Gemini 3.1 hanging on.
    • Google’s conservative TPU V8 design (partly an attempt to reduce dependence on Broadcom and Nvidia) is the leading explanation for the loss of per token cost leadership.
    • AI pricing is shifting from all you can eat to usage based, mirroring the cellular and long distance industries. Cellular stopped being a great growth industry when it went all you can eat. AI just made the opposite move.
    • OpenAI and Anthropic together could exceed two hundred billion in ARR this year if compute keeps coming online and frontier token pricing holds.
    • The two hundred fifty dollar a month consumer AI plan is no longer enough to evaluate frontier capability. Enterprise plans with usage based billing are required because rate limits are now severe.
    • The three biggest open questions for AI investors are: violation of the bitter lesson via ASI or human ingenuity, whether frontier tokens keep commanding their premium, and when continual learning arrives.
    • Today’s continual learning is crude reinforcement learning during mid training on verifiable tasks. True continual learning means weights updating dynamically, like a human who learns the first time they touch fire.
    • Trying to build a better GPU is a losing strategy. Jensen will copy any one to three percent share design. Startups should target one percent share, do something different, and make it hard enough that Nvidia cannot fast follow.
    • Disaggregated inference (separating prefill and decode) opens new design canvases. Prefill is memory capacity bound. Decode is memory bandwidth bound. Each can be optimized independently.
    • Cerebras did something different and hard with wafer scale computing. Three generations of chips and real grit to get there.
    • Disaggregation of inference may stretch GPU useful lives to ten or fifteen years, dropping financing costs from low sevens to five or six percent, mathematically lowering the cost of the AI buildout and likely saving the private credit industry from its SaaS loan exposure.
    • Sellers of shortage outperform buyers of shortage. But owning the largest installed base of what is currently in shortage (hyperscaler CPU fleets, for example) is also a strong position.
    • Most of the economic value at the application layer of AI has been destroyed, not created. The exceptions are companies in the token path or in niches small enough that frontier labs ignore them.
    • Coding may be the shortest path to ASI. If you can write code, you can write code that does anything. Cursor, Cognition, and Anthropic correctly focused on it.
    • Jensen could probably get close to the frontier with his own Nemotron family of models whenever he wants. The fact that he chooses not to is a strategic decision about not commoditizing his customers.
    • The new prisoner’s dilemma in AI is whether frontier labs release their best model via API. If everyone agrees not to, Chinese open source falls behind. If anyone defects, the defector pulls ahead on revenue and resources, forcing everyone else to defect.
    • Google still owns the largest compute installed base. Without TPU’s prior cost advantage, this matters more. YouTube data has real value in a world of robotics. GCP is going crazy.
    • Meta deserves credit for becoming AI first internally faster than any other internet giant. Musa, their first MSL model, is impressively close to the Pareto frontier.
    • Amazon is strong because of Trainium and robotics driven retail P&L efficiency. Nova is better than it gets credit for.
    • Microsoft flinched on capex in early 2025 and lost position. Satya Nadella’s current decision to use Microsoft compute for Microsoft products rather than reselling to OpenAI is a courageous and probably correct call, even at the cost of an eight hundred dollar stock price.
    • The hyperscalers most engaged with startups are Amazon and Nvidia by a mile, followed by Google. Broadcom is the favorite ASIC partner. AMD, Microsoft, and Meta have minimal startup engagement and that will cost them as the best teams are now at startups.
    • Personal safety in an AI era requires a family or company safe word that cannot be socially engineered. Deepfake voice and video extortion at the speed of FaceTime is already feasible.
    • Ukraine is winning largely on the back of having the best battlefield AI outside America and Israel. Adversaries are starting to internalize what AI dominance means geopolitically.
    • An optimistic read is that this becomes a new Pax Americana, the way the post 1945 American nuclear monopoly was used to rebuild Germany and Japan rather than dominate.
    • AI cured a friend’s daughter’s rare disease by spinning up a research effort that identified a market drug capable of impacting her condition. That is the upside that keeps Gavin an AI optimist maximalist.

    Detailed Summary

    The most extraordinary moment in the history of capitalism

    Gavin’s framing of the current moment is unusually direct. Anthropic added eleven billion dollars of annual recurring revenue in a single month. The three highest profile SaaS companies of the last decade plus, Palantir, Snowflake, and Databricks, took a decade and tens of thousands of employees collectively to build the combined business that Anthropic added in thirty days. He has been investing through every major tech cycle and says there is no historical analog. Not the dotcom era, not the cloud transition, not mobile. This is its own thing.

    The market response, then, was peculiar. The NASDAQ sold off into the single most bullish moment for AI fundamentals on record. Tech traded at roughly its widest discount versus the rest of the market in a decade. Investors who said they wished they had bought into AI during 2022, during COVID, or during Deep Seek Monday got the same valuation setup again in early April, this time with an even clearer inflection.

    Why the Strait of Hormuz closing was secretly bullish for America

    One reason the macro fear in March may have been mispriced is that the same geopolitical event that drove the selloff was, in practice, a relative benefit to the United States. American natural gas, the input into American electricity, which is the input into American AI training and inference, fell roughly twenty percent. Asian and European natural gas prices doubled or tripled. The US emerged with sharply improved relative manufacturing competitiveness, which is exactly what the current administration cares about.

    The 1970s comparison does not hold. The US economy is dramatically less energy intensive, it is now the world’s largest producer and largest exporter of oil and gas, and there are no shortages, only price moves. That backdrop made it easier for disciplined investors to stay focused on AI fundamentals through the volatility.

    Anthropic and OpenAI valuations on an unconstrained run rate

    Anthropic at roughly nine hundred billion for fifty billion of ARR sounds rich until you adjust for the fact that the company is severely compute constrained. Gavin estimates that, unconstrained, Anthropic might be at one hundred fifty to two hundred billion in run rate revenue, putting the implied multiple closer to five times. He also points out that Claude Opus now generates roughly seventy percent fewer tokens for the same question than it used to. Token quantity correlates with answer quality, and Anthropic is rate limiting and shrinking outputs to ration capacity across its user base.

    Anthropic and OpenAI are also structurally very different. Anthropic has burned around eighty percent less cash than OpenAI to reach a comparable revenue scale. That implies very different long term returns on invested capital, though OpenAI has done a better job locking in compute and Sarah Friar is one of the most exceptional CFOs Gavin has worked with.

    Why neither lab is raising at a three trillion dollar valuation

    The answer Gavin gives is that both labs are deliberately leaving valuation on the table the way Elon has done for two decades. SpaceX compounded at low thirty percent annually for a decade because Elon never pushed price. The result is a permanent superpower of access to capital. Investors trust him because they have made money with him for twenty years. That is a moat that compounds with every round.

    Anthropic could probably raise at a one hundred percent premium to its rumored latest mark. They are choosing not to. In an uncertain world (Ukraine, Russia, Iran, Taiwan), preserving the ability to raise more capital later at fair prices is more valuable than maximizing this round.

    Watts and wafers, the two real constraints

    Capitalism is solving the watts problem. The leading PE infrastructure investors now say zoning and political approval, not chips or energy, are the gating factors. Companies are deferring big capex announcements until after the US midterms. Turbine capacity is being doubled at the manufacturers. Companies like Boom Aerospace are repurposing jet engines for grid use. Watts probably ease meaningfully in 2027 and 2028 and then orbital compute does the rest.

    Wafers are the harder problem because they live in Taiwan, run on handshakes, and depend on a corporate culture that does not respond to public market incentives. TSMC is essentially the GDP, water consumption, and electricity consumption of Taiwan. Its leadership treats the company as the legacy of Morris Chang. The Silicon Shield doctrine is real and internal.

    Orbital compute as racks in space

    The biggest mental update Gavin asks listeners to make is to stop picturing data centers in space as Pentagon sized space stations. A Blackwell rack is three thousand pounds and roughly the size of a refrigerator. SpaceX has shown a concept satellite of about that size. Solar wings extend five hundred feet to each side and the radiator extends hundreds of feet behind, both possible because the orbit is sun synchronous and the orientation is fixed relative to the sun.

    SpaceX engineers Gavin has spoken to at Starbase express genuine confidence that they have solved cooling at these power levels. They have. Starlink V3 satellites already operate at twenty kilowatts. A Blackwell rack is one hundred kilowatts. The same company operates the world’s largest satellite fleet and the world’s largest data center on Earth via xAI Colossus. The racks are connected to each other with lasers traveling through vacuum, technology already deployed in every Starlink. The naysayers, Gavin observes, are armchair skeptics and Larry Ellison’s response (he is out there landing rockets, no one else is) is the right frame.

    Terafab in Texas and the threat to TSMC’s discipline

    Terafab, the SpaceX and Tesla joint venture, intends to be the largest fab in the world. The partnership with Intel grants access to fifty years of foundry institutional knowledge, allowing Terafab to start three to five quarters behind the leading node rather than fifteen years behind. The A teams at the semicap equipment companies (ASML, KLA, Lam Research, Applied Materials) will follow Elon’s reputation in hardware engineering the same way they followed TSMC twenty years ago when Intel stumbled.

    The talent strategy is the part most observers underestimate. Recruit the best engineers globally, then import their families, their restaurants, their staff. Build Taiwan Town, Japan Town, and Korea Town next to the fab. Optimize the human experience for the people whose work matters. Intel and Samsung do not think that way.

    Bubble watch and the year 2000 comparison

    Every foundational technology in modern history has had a bubble. Railroads, canals, the internet. Carlota Perez documented why. Markets correctly identify the importance, diversity of opinion collapses, supply gets ahead of demand, the bubble crashes. The current cycle has two important differences. The buildout is overwhelmingly funded out of operating cash flow, not debt. Every GPU is running at one hundred percent utilization, while at the peak of the fiber bubble ninety nine percent of fiber was unused.

    TSMC discipline is the single largest reason a bubble has not formed. If Jensen could buy everything TSMC could theoretically make, Nvidia could sell two to three trillion dollars of GPUs in 2026 and 2027. At some point that becomes more than the market can absorb. If Intel or Samsung Foundry catches up at the leading node, the other will too. TSMC’s pricing discipline collapses and the bubble starts.

    The Pareto frontier and the loss of Google’s cost advantage

    The most important chart in AI is the Pareto frontier of model intelligence versus per token cost. Nine months ago, Google’s TPU based models dominated every point on it. OpenAI, Anthropic, and xAI sat inside the frontier. Today the frontier is dominated by Anthropic and OpenAI, with Grok 4.3 on the frontier and Gemini 3.1 hanging on by subsidization more than economics. The most likely cause is Google’s conservative TPU V8 design, an attempt to reduce dependence on Broadcom and Nvidia that sacrificed per token economics.

    The bitter lesson, frontier tokens, and continual learning

    Three open questions dominate AI investing. The first is whether Richard Sutton’s bitter lesson (more compute beats human algorithmic cleverness) gets violated by ASI itself optimizing for efficiency. Closer observers of AI are more skeptical of a violation. Gavin thinks ASI’s first move will be to make itself more efficient and more resourced, which is technically a temporary violation.

    The second is whether frontier tokens keep capturing the overwhelming share of economic value at the model layer. Today they do, surprisingly. Gemini 3.1 Pro was mindblowing nine months ago and is intolerable today. The third is when continual learning arrives. Today’s models need a million fire touches to learn what a human learns from one. True continual learning would mean dynamic weight updates in real time and would produce a fast takeoff.

    From all you can eat to usage based AI pricing

    AI is shifting from flat fee plans to usage based pricing. The historical analogy is cellular and long distance. Both stopped being great growth industries when they went all you can eat. AI just made the opposite move. The consequence is that flat fee subscribers, even on premium consumer plans, get a rate limited and token throttled version of the frontier model. Enterprise plans with usage based billing are now required to evaluate true capability. Gavin thinks the combination of new compute coming online and usage based pricing is what gets OpenAI and Anthropic past two hundred billion in combined ARR this year.

    Chip startups, prefill decode disaggregation, and Cerebras

    Trying to build a better GPU is the wrong move. The four scaled players (Nvidia, AMD, Trainium, TPU) have copy capability for any one to three percent share design that looks attractive. The good news for startups is that disaggregated inference (separating prefill and decode) opens a richer design canvas. Prefill is memory capacity bound. Decode is memory bandwidth bound. Each can be optimized independently. Andrew Fox’s analogy is a British naval ship of the eighteenth century. Prefill is loading the cannon. Decode is firing it.

    Cerebras is the model. Wafer scale computing is genuinely different and genuinely hard. It took three generations of chips to get right. Andrew Feldman and his team had the grit to keep going through chip one being a failure. The design has a high ratio of on chip compute and memory relative to shoreline IO, which is why Cerebras is now experimenting with putting an optical wafer on top of the compute wafer to solve scale out.

    GPU useful lives and the rescue of private credit

    One of the strongest claims in the conversation is that disaggregated inference will stretch GPU useful lives to ten or fifteen years. The skeptical narrative (GPUs are obsolete in two years, companies are cooking their depreciation books) is wrong. You can put a Cerebras system or Groq LPU in front of older Hopper or Ampere parts, use them only for prefill, and run them until they physically melt. Private credit, which is in pain from SaaS loans and which underwrote GPU loans on three to four year lives, may be saved by this.

    If GPU financing rates can come down from low sevens to five or six percent, the mathematics of the AI buildout improves materially. That is a structural tailwind that compounds for years.

    The application layer, the token path, and a new prisoner’s dilemma

    Trillions of dollars of value have been destroyed at the application layer, not created. Cursor and Cognition are the rare scaled exceptions, and they got there by focusing on coding very early. As Amjad Masad noted, coding is plausibly the shortest path to ASI because a coding agent can write itself into any new domain. Jamin Ball’s frame is that the new venture filter is whether the company is in the token path. Data Bricks is. Most application layer startups are not.

    Jensen could probably get close to the frontier with Nemotron whenever he wants, and the strategic question of whether to do that is a new prisoner’s dilemma. If every frontier lab agrees not to release best models via API, Chinese open source falls steadily behind. If anyone defects, the defector gains revenue and resources, and everyone else has to defect. The same dynamic exists between TSMC, Intel, and Samsung. If Nvidia or AMD ever truly used an alternative foundry, that foundry would catch up rapidly.

    Rating the hyperscalers

    Google has the largest compute installed base, the YouTube data that matters in a robotics world, and a search business that prints. Their loss of TPU cost leadership is the surprise of the year. If Google IO in five days does not produce a leapfrog model, the Nvidia centric narrative gets even stronger.

    Meta deserves real credit. Zuckerberg made Meta AI first internally faster than any other internet giant, paid up for the talent contracts when no one else would, and shipped Musa as a first model from MSL that is close to the Pareto frontier. Amazon is well positioned on Trainium, robotics in retail, and a Nova model line that is better than it gets credit for. Microsoft flinched on capex in early 2025 and lost position. Satya Nadella’s current decision to use Microsoft compute for Copilot rather than reselling to OpenAI is courageous and probably correct, even at the cost of stock price.

    The most interesting cross hyperscaler metric is startup engagement. Nvidia and Amazon engage deeply with startups. Google is next. Broadcom is the favored ASIC partner. AMD, Microsoft, and Meta have minimal startup engagement, which Gavin believes will cost them as the best teams now sit at startups.

    Personal safety, geopolitics, and the Pax Americana case

    The closing section turns darker. Personal safety in an AI era requires a family or company safe word that cannot be socially engineered. Deepfake voice and video extortion via something that looks exactly like your child calling on FaceTime is already feasible. Political violence against AI leaders is a real concern. Geopolitically, Ukraine is winning largely because it has the best battlefield AI outside America and Israel. How adversaries respond to that asymmetry is the next great variable.

    Gavin’s optimistic frame is the Pax Americana. After 1945 the US had a nuclear monopoly and could have controlled the world. Instead it rebuilt Germany and Japan, both of which became the most reliable American allies for the next eighty years. If AI dominance plays out similarly, this is a generationally positive story rather than a destabilizing one. The personal anecdote that closes the conversation is a friend whose daughter was diagnosed with a rare genetic condition. He spun up agents, identified a drug already on the market that addresses her mutation, and her life is immeasurably different because of AI. That is the upside.

    Thoughts

    The Anthropic eleven billion in a month framing is the kind of stat that resets priors. The right way to interpret it is not as a one off but as a measure of how fast value can compound when the underlying technology improves on a curve steeper than the ability of the rest of the economy to absorb it. The skeptical question is whether that ARR is durable or whether it is heavily tied to a customer base of other AI companies that are themselves on a single venture funded year of runway. The bullish answer is that frontier coding, frontier research, and frontier enterprise tasks are not going to stop being valuable, and Anthropic is the best at all three. Both can be true. The number is still extraordinary.

    The argument that TSMC discipline is the only thing preventing a bubble is the analytically tightest part of the conversation. The implied trade is to watch TSMC capacity additions like a hawk and to be more, not less, cautious if Intel Foundry or Samsung Foundry ever announce real share at the leading node. The Terafab thesis is more speculative but more interesting. If Elon’s talent recruiting playbook works and the Intel partnership gives Terafab a real seat at the table within five years, the geometry of the global semiconductor industry shifts in a way that is bullish for American manufacturing, bullish for power and water infrastructure in Texas, and ambiguous for TSMC itself.

    The Pareto frontier discussion deserves more attention than it usually gets. Pricing leadership in AI is not a vanity metric. It determines who can subsidize free tier usage, who can absorb compute shortages, who can ship cheaper enterprise plans, and ultimately whose model becomes the default for any given workload. Google losing per token leadership in nine months is one of the most under analyzed events in the sector and it explains a lot about why Anthropic and OpenAI are growing the way they are. If Google IO does not produce a leapfrog model, the implied verdict on TPU V8 design choices gets a lot harsher.

    The application layer destruction point is worth sitting with. Founders building on top of frontier models are competing in a world where the model itself moves faster than any moat they can build, where the model lab can absorb their niche if it gets interesting, and where the only protection is either deep token path integration or a niche so small the lab does not bother. That is a much harsher venture environment than the early SaaS era. The compensating opportunity is that one human can now run a hundred agents, so the ceiling on what a small team can build is correspondingly higher. The bet is that productivity per founder rises faster than competitive pressure from the labs. We will find out.

    The orbital compute pitch is the section that will polarize listeners. The naive read is that this is science fiction. The closer read is that every component (sun synchronous orbit, laser interconnect, twenty kilowatt satellite buses, ten thousand satellite manufacturing cadence, full rocket reusability) already exists. The remaining engineering problems are repair, maintenance, and radiator scale, all of which are real but tractable on a five to ten year horizon. The strategic implication is that the political and zoning ceiling on terrestrial data centers becomes less binding if orbital compute is a credible alternative for inference workloads. The investor implication is that being short the watts and cooling complex on a five year horizon is a real trade, not a meme.

    Watch the full conversation here.