PJFP.com

Pursuit of Joy, Fulfillment, and Purpose

Tag: coding agents

  • Why I Couldn’t Build Jev at OpenAI: Diogo Almeida on TypeSafe, System One Models, RLCD, and Making AI Programmable

    Diogo Almeida spent years inside OpenAI arguing that the entire field was optimizing the wrong thing, and then left to prove it. In this long interview recorded days after the launch of Jev, the TypeSafe co-founder and CEO lays out the thesis he could not build where he was: that language models have been tuned to please humans when the real customer should have been code. The conversation runs from the internals of mode collapse to the design of a three-primitive API, from a trillion tokens a day to why he thinks the entire “pace the frontier” debate rests on an assumption nobody examines. It is the most technically unguarded founder interview of the year, and it is also, in places, a founder who admits he has cried several times this week.

    TLDW

    Almeida describes Jev as the first of a new class of models he calls machine native system one models, or large programmable models, where the consumer of the output is code rather than a human reader. He explains why RLHF’s mode collapse poisons calibration and makes string models bad at decisions, why refusal is a type error that has no business existing in an API, and why he refuses to publish public benchmarks because they are trivially gameable. He walks through the three API primitives and how each maps to a programming construct, argues that system messages are global variables and that problems should be decomposed into many cheap parallel questions, and explains why robustness rather than determinism is the right north star so there is no seed parameter. He gives the economic thesis: total factor productivity growth above three percent within five years, all models currently tied at roughly zero percent of economically valuable work, and an inverse SaaS apocalypse rather than mass unemployment. He attacks the frontier pacing argument as a sleight of hand that assumes everyone must keep scaling RLVR, says zero RLVR is optimal for his model shape, calls most neolabs value destroying, and says that if you gave him a billion dollars he would not pre-train. He tells the story of leaving OpenAI, including the Thanksgiving GPU run during the board coup, the fight to ship InstructGPT and the disappointment of watching it become a copywriting slop engine. He closes by giving away two research agendas he will not pursue himself: genuinely intelligent games, and coding agents freed from what he calls the tyranny of the KV cache.

    Thoughts

    The sharpest idea in the first half is the claim that refusal is a type error. It sounds like a joke and it is not. Almeida’s point is that a refusal is an unmodeled return value: the caller asked for a decision and received an apology, which no type signature anywhere in the stack accounts for. A human in a chat window can absorb that. A dependency running unattended in the background cannot, and neither can the third party who imported that dependency and has no idea an AI is buried in it. From there he makes the more uncomfortable argument, which is that safety alignment and capability alignment are structurally opposed. Capability alignment means doing what the caller asked. Safety alignment means following somebody else’s instructions instead of the caller’s. That is a perfectly reasonable trade for a consumer product with parents and children using it, and an incoherent one for an API. His analogy is that intelligence should be infrastructure like a database, and databases do not audit what you query them for. The host pushes back properly on this, raising military use, and Almeida does not dodge: he says he would prefer his technology not be used to kill people, he will put his thumb on the scale socially, and he will not do it at the technological layer, because every overfit to a particular concern fractures the model’s general intelligence a little more. You can disagree with the conclusion. It is a real position, consistently held, and it is far more thought through than the usual libertarian shrug.

    The middle of the conversation contains the part practitioners should actually steal, and it has nothing to do with Jev specifically. Almeida’s view is that the industry has been writing AI code in the worst possible style: one enormous system message containing all the state and all the instructions at once, then hoping every instruction lands, then bolting on a second model to check whether the first one behaved. He calls system messages disgusting global variables, and the comparison holds up. The alternative he pushes is to pass structured, nested, semantic objects rather than templated strings, and to decompose a task into many small independent questions asked in parallel rather than one large one. The payoff is not elegance, it is measurability. When you find a failure, you do not rewrite a prompt and hope; you add a question, set a threshold, keep the case as a test, and it is fixed permanently rather than until the next context rot. He calls this ML without the ML, and it is the most accurate three-word description of the workflow I have heard. There is a real cost he acknowledges openly: decomposing means paying for overlapping context repeatedly, which is exactly why nobody did this before, because with chat-priced models it was slower, more expensive and worse. His answer is that intelligence per dollar is the metric that unlocks the pattern, and the trick he offers for the remaining cost is to pay for a large state once and fan many cheap ID-addressed questions across it.

    Then there is the economics, which is where the interview stops being about a product. Almeida is the only lab founder I have heard name total factor productivity growth as the target, and he wants above three percent within five years. The corollary is brutal and he says it plainly: every model on the market today is tied at roughly zero percent of the world’s economically valuable work, and he would guess the real figure has not yet crossed one percent. He then poses the question the whole field has been avoiding, which is how a technology that can approach millennium prize problems in mathematics has automated essentially none of the boring, unsatisfying, rote work that actual people are actually stuck doing. His answer is that the engine is fine and the plugs are missing. The supporting observation is devastating in its simplicity: it is 2026, software is functionally identical to 2019 software, and the only visible difference is a chat box in the corner that cannot be trusted with any decision the company has a stake in. His prediction is not the SaaS apocalypse everyone expects but the inverse, because the incumbents are the ones who actually know which tasks are worth automating. He also predicts no mass unemployment, which given the rest of his worldview reads less like optimism and more like a man who thinks the technology is currently too unreliable to be the threat people fear.

    The most genuinely contrarian stretch comes late, when the host raises frontier pacing and the joint statements the labs have been signing. Almeida’s response is that the argument is internally consistent and starts from a premise with alternatives. The pacing case assumes that progress requires ever more RLVR, which means giving models ever broader latitude to do arbitrary things in the middle of a trajectory, because that latitude is what makes them powerful afterward. If that is the only path, then yes, the world gets dangerous. But he does not need to do more RLVR at all. He says zero is the optimal amount for his model shape, which turns the safety discussion from a law of nature back into a research choice. He calls it a sleight of hand, and then says something that lands harder: the people at fault are not the public and not the policymakers, but the researchers, because the public reasonably assumes the labs are pursuing the best available direction and has no way to know what optionality exists. He extends the same complaint to the funding environment, saying most neolabs are value destroying because they redo work from scratch with a low chance of moving anything, and that valuing pure research pedigree is backwards when what actually creates value is picking the right task. The interview also contains an uglier detail that he visibly does not enjoy hearing, which is the host relaying that in at least one room the pacing conversation is political positioning around the 2028 election. His reaction is the most human moment in two hours: he says it makes him lose faith in humanity a bit, and that he would rather stay a naive technologist.

    The last twenty minutes are the reason to watch the whole thing, because Almeida spends them giving away work he will never do. The one that matters is coding agents freed from what he calls the tyranny of the KV cache. His argument is that the cache is why agent architecture is stuck: to use it efficiently you must keep appending to a single linear context with a single model, which forbids state management, abstraction and decomposition, the three things software engineering figured out decades ago. That constraint, he says, is the actual explanation for why routing is hard, why sub-agents disappoint, and why compaction remains an unsolved mess. You cannot hand a sub-agent a genuinely smaller task because the state you would need to pass costs more intelligence to summarize than the task itself is worth. If context becomes cheap enough, the shape changes completely: hierarchies of labeled subtasks you can search for relevant context on demand, parallel agents reading each other’s state, swarms coordinating with real locks instead of asking each other what they are working on. And then the reframe that is worth the price of admission on its own, which is that continual learning is not a learning problem at all. Starting from scratch every session and then inventing an exotic research program to fix it is strange when the actual deficiency is that you have no cheap way to look anything up. It is a memory management problem. He is right, he knows he is not going to get to it, and he is openly hoping someone reading takes it.

    Key Takeaways

    • Jev is the first of what Almeida calls machine native system one models, or large programmable models. The defining property is that code, not a human reader, is the intended consumer of the output.
    • The class name matters more than the product name. He is not attached to “system one models” but rejects “decision models” because there are machine native types coming that are not decisions.
    • The model is named after Jevons paradox and is optimized for intelligence per dollar. Jev is the brand for whatever sits on the intelligence per dollar frontier, not for raw capability.
    • His critique of RLHF centers on mode dropping. A calibrated, mode covering distribution tolerates outliers, while RLHF-tuned models drop minority modes and become conservative because visible errors are punished far harder than subtly wrong output that looks right.
    • That same mechanism is his rebuttal to Yann LeCun’s famous slide about error compounding with sequence length. He calls it mathematically obvious and empirically wrong, and says mode collapse is precisely why the predicted failure does not occur.
    • He rates LeCun as among the most accurate thinkers in the field while declining to endorse JEPA as the fix, calling it excellent early research whose practicality is unproven.
    • Refusal is described as a type error. A refusal returned into a background dependency breaks software stochastically, and the downstream consumer has no way to know an AI is in the chain.
    • Safety alignment is framed as the opposite of instruction following, since it means obeying a third party rather than the caller. He considers it appropriate in a first party product and unacceptable in an API.
    • His preferred metaphor is intelligence as a database rather than a coworker. Databases do not police what they are queried for, and he argues the same boundary gives software engineers maximum power.
    • He is opposed to public benchmarks on principle, arguing they are gameable even by labs trying not to game them, and citing the era when every lab had a team collecting MMLU-shaped data.
    • He is not anti-measurement. TypeSafe runs internal evals but treats not fooling itself about model quality as a top level discipline, because any alternative incentive corrupts the number.
    • Trust, in his model, comes from putting a model into your own workflow and measuring it there, plus a company that keeps adding nines of reliability over time.
    • His “bitterest lesson” is that choosing the right task and setting the right north star beats both compute and algorithms. He counts only about two and a bit such shifts in the LLM era: RLHF, RLVR as a fractional one, and now RLCD.
    • RLCD is presented as a north star rather than an algorithm, in the same way RLHF names the task of instruction following rather than PPO specifically. No paper has been published on it.
    • He calls data the thing that determines model capability and is hiring what he describes as infinite data people, insisting they be the highest status role rather than treated as a slur.
    • TypeSafe deliberately does not train on user data, even though it probably could. Real usage follows a power law that would overfit the model to the present when the goal is unbuilt future use cases.
    • His layering analogy is that today’s LLMs are UDP and his models are TCP, with many more layers of machine native intelligence still to be built on top.
    • There is no seed and no determinism guarantee. He considers determinism mildly useful for unit tests but the wrong north star, and says robustness, meaning similar outputs for semantically identical inputs, is the property that matters.
    • TypeSafe tests robustness by injecting UUIDs and nonces into otherwise identical prompts and checking that outputs stay stable, which he notes most LLMs fail badly.
    • He commits firmly that deployed models will not be silently changed, calling that practice insane for an API, while explicitly declining to promise long term support for any given version.
    • New model versions will ship faster than developers are used to. An LTS designation for the current version is under consideration because fracturing the fleet across many versions is worse than the alternative.
    • The three API primitives are a boolean-like type whose unusual spelling derives from the letters of Bernoulli, a score, and a choice. All three are new concepts rather than existing programming types, on purpose.
    • Each primitive maps to a programming construct: the Bernoulli-derived type to an if statement, a score to sorting or thresholding, and a choice to a switch on an enum that you can optionally hydrate into a function.
    • They were deliberately not named int, float or bool so that tools like Instructor or Pydantic could not silently coerce a score into an integer and mislead the developer.
    • Inputs including state, instructions and criteria can all be structured JSON objects. He argues that flattening them into a templated system message is old thinking, since stringification is for human output.
    • System messages are called disgusting global variables. His alternative is many small explicit questions asked in parallel, each independently evaluable.
    • His worked example is refusal itself: rather than asking “should I refuse,” ask many independent questions about specific situations, so a missed case is fixed permanently by adding a question and a threshold.
    • He calls this approach ML without the ML, since thresholds are tuned against real examples rather than trained.
    • A practical cost-saving pattern he recommends: pay for a large state once, attach IDs to every message or element, then fan many cheap parallel questions across those IDs.
    • Fine tuning is not offered and he is ambivalent about it, noting that generality often helps edge cases within a narrow task and that other labs have launched and then withdrawn fine tuning.
    • His preferred alternative is calibration plus a cascade: trust a confident small model, escalate ambiguous cases to a larger one. Multiple model sizes are explicitly on the roadmap.
    • Intelligence per second is treated as a separate metric from intelligence per dollar. He acknowledges the magic of the 1 to 100 millisecond latency band but says that is not Jev’s niche.
    • The launch passed a trillion tokens per day, and he emphasizes that the volume holds overnight, meaning machines rather than humans experimenting.
    • He considers waitlist signups meaningless for a developer platform. One power user’s for loop outweighs the entire world trying a few queries, and rate limits are the metric that actually binds.
    • Pre-launch validation went badly. More than half the people who tried it did not understand it, non-technical staff feared they were selling a vitamin rather than a painkiller, and revenue before launch was almost nothing.
    • That experience makes him question product market fit as a concept, since the product and the market both existed while the response was indifference right up until it was not.
    • His economic north star is total factor productivity growth above three percent within five years, a metric he notes no other lab talks about and which he ties to the original OpenAI charter language.
    • He believes all models today are roughly tied at zero percent of the world’s economically valuable work, likely under one percent, and that the real shift will show up in economic statistics rather than demos.
    • He expects an inverse SaaS apocalypse, with existing software companies supercharged because they know best which tasks are worth automating, and no mass unemployment.
    • Whether a task is system one or system two is framed as an empirical question, not a philosophical one, comparable to asking why robotics has not worked despite the money spent.
    • The host’s own testing found Jev state of the art on single hop reasoning with monotonic degradation as hops increase, which Almeida accepts as a fair characterization of the current frontier.
    • Each paradigm is defined by its north star: RHLF optimizes to please humans, RLVR optimizes benchmarks because a benchmark is by definition programmatically verifiable, and RLCD optimizes reliability for programmatic use.
    • There is no reasoning trace in Jev and he considers string-based reasoning slow, inefficient and fragile, while leaving the door open to cheaper forms of reasoning.
    • He claims Jev degrades less in long context than other models, and frames context length as a case study in giving people what they say they want versus what they need.
    • Four use case families were mapped from first principles before launch: dark data analysis, coding agents, real time intelligence in the loop, and intrinsically composable smart software.
    • Dark data is the enterprise unlock. Companies hoarded data they could never afford to run an LLM across, and he calls it a data scientist’s dream.
    • Voice-driven computer control surprised him. He says he is anti-demo as much as he is anti-benchmaxxing, and wants to find the weaknesses before celebrating.
    • He sees a structural problem for the leading coding agents: they are architected around a single model world, while open source agents are free to experiment with multi-model patterns.
    • Because open agents can copy each other, the first one to find a pattern that only works with a cheap system one model will pull everyone along with it.
    • On frontier pacing, he argues the entire case assumes continued scaling of RLVR, and says zero RLVR is optimal for his model shape, which makes the danger a choice rather than a law.
    • He blames researchers rather than the public for closed-mindedness, since the public cannot be expected to know what alternative directions exist.
    • He calls most neolabs value destroying, criticizes the valuation of pure research pedigree, and says the labs are the right place for researchers who want to explore rather than solve.
    • If given a billion dollars he says he would not pre-train, preferring to slice, combine and Frankenstein existing capability because it solves problems more cheaply.
    • He hates fracturing intelligence, and blames the chat-first plus reasoning-mode architecture for sycophancy, overconfidence, hallucination and the bold-and-emoji style that wins human preference leaderboards.
    • For that reason the model is not trained to claim an identity. He would rather it report what the internet thinks than be told it is Jev from TypeSafe, because identity training fractures the model.
    • The origin story runs through a Thanksgiving research sprint on idle OpenAI GPUs that coincided with the board coup, which he describes only as annoying while declining to elaborate.
    • He fought to ship InstructGPT, including an unpublished algorithm he wrote himself because cleaning the PPO data was too slow, and it took roughly half the LLM market almost immediately.
    • The disappointment that followed shaped everything: instruction following looked superhuman yet ended up powering copywriting tools, and he worried they had made the internet worse.
    • The insight that became TypeSafe came from working backwards from an AI-based economic revolution and asking who would be calling the API. The answer was many nines of code, and all the optimization was aimed at humans.
    • Sam Altman read the document and told him to go work on it. He assumed Anthropic must already be doing it and that he was too late.
    • The company formed fast: he recruited Eric first, asked Sasha only for a sanity check and she folded her own startup on the spot, funding closed within two weeks and people moved into his apartment.
    • He describes himself as zero percent entrepreneurial, says he never wanted to be a CEO, and traces the decision to feeling disempowered inside an organization where every conversation routed back to ChatGPT.
    • His longest-standing grievance is the function calling interface. He wanted a genuine probability per function so a developer could set their own refusal threshold rather than pleading in a system message.
    • The first task he gives away is intelligent games, where even simple state machines for NPCs could make a world far more compelling without calling a model in the game loop.
    • The second is coding agents freed from the KV cache, which he argues is the hidden reason routing, sub-agents and compaction are all hard, and the subject of his piece titled after the Wu-Tang line.
    • His reframe of continual learning is that it is a memory management problem, since the difficulty is having no cheap way to look up historical context rather than any failure to learn.
    • He imagines agent swarms that read each other’s state and coordinate with real locks, plus searchable trees of labeled subtasks, once context becomes cheap enough to stop passing everything upward.
    • Latency is now a hiring constraint. He is building out infrastructure geographically because the speed of light matters, and is unhappy that European users get only a threefold speedup.
    • The stated ambition is not to be a one model company but to become something like an AWS of intelligence, shipping more shapes of machine native intelligence beyond Jev.

    Detailed Summary

    A New Class of Models Where Code Is the Consumer

    Asked the definitive question of what Jev actually is, Almeida starts with the category rather than the product. The industry has pre-trained models built to autocomplete the internet, RLHF models built to reply to text in a chat window, and RLVR models sitting in an awkward gray area beside them. What it lacks is a class of models whose outputs are meant to be consumed directly by code, which is where the company name comes from. He describes the class as machine native, system one, and large programmable, and says the goal is to make AI as powerful as possible by integrating it with software rather than by wrapping it in a conversation. Jev is the first of these, and the name comes from Jevons paradox because it is optimized for intelligence per dollar. He frames the design space as a tradeoff between reliability, cost, calibration and speed, and says Jev is the name that will attach to whatever sits on the intelligence per dollar frontier rather than to any particular architecture.

    Mode Collapse, Calibration, and Why LeCun’s Slide Is Wrong

    The most technical stretch of the interview is his account of what RLHF did to probability distributions. He notes that nobody paid attention to the downsides of RLHF in his launch material, particularly mode dropping. He then uses it to resolve a puzzle he clearly enjoys: Yann LeCun’s well known slide arguing that as sequence length grows, the probability of an error compounds toward certainty. Almeida says the argument is mathematically obvious and empirically false, and that the disconnect is exactly mode collapse. A calibrated, mode covering model is not catastrophically punished for outliers, the way pre-GAN generative models produced blurry images rather than dropping minority classes. RLHF-tuned models instead drop the modes and become extremely conservative, because an obvious error is punished hard while a subtly wrong output that looks correct is not. That conservatism is what keeps long strings from derailing, and it is also, in his words, total poison for calibration. His conclusion is that this is precisely why string models are bad at making decisions. He rates LeCun as among the most accurate thinkers in the field while declining to endorse JEPA as the fix, calling it very cool early research whose practicality he will not vouch for, and adding that the research world is full of diamonds in the rough that nobody has polished because they have not picked the right task.

    Refusal as a Type Error

    He addresses a question his Discord keeps asking, which is why TypeSafe does not implement refusals. His answer separates safety as a principle, which he supports, from safety alignment as an implementation, which he considers misaligned with users. A refusal reaching a human in a coding session is merely annoying, and he suggests developers have been Stockholm syndromed into accepting it. A refusal reaching a dependency running in the background is something else entirely, because the software breaks stochastically based on what a user typed somewhere upstream, and the person who imported that dependency has no idea why. He argues this comes from people who do not understand software and are fixated on an AI coworker metaphor he calls a horseless carriage. What he wants instead is a cognitive core general enough to serve use cases nobody has imagined, which is why it works on tasks TypeSafe never trained for. He draws a hard line between capability alignment, which means doing what the user asked and which developers love because predictability reduces testing, and safety alignment, which by construction means following somebody else’s instructions. The former is what he is chasing to as many nines as he can get, until calling for intelligence is as unremarkable as a database query.

    Infrastructure Does Not Police Its Users

    The host presses on the obvious objection, which is military use, and Almeida engages rather than deflecting. He accepts there are pragmatic places where such a position can be held, and says the foundation of a general purpose technology is not one of them. He would prefer his technology not be used to kill people and will put his thumb on the scale, but not at the technological layer, because every overfit to a particular concern fractures the model’s intelligence further, and he considers current models already badly fractured. His formulation is that intelligence will resemble a database more than a coworker, and that a database is not responsible for auditing the purposes of its queries. He extends this to customer conversations, describing his bafflement when companies ask permission to deploy: TypeSafe is an API and the caller is a developer, and it should not even be possible for TypeSafe to know what the full downstream task is, because a properly decomposed system does not expose it. He frames that opacity as a feature that gives engineers maximum power, and says the bias will stay out of the technological layer as long as he is in charge.

    Why There Are No Public Benchmarks

    Almeida is emphatic that he is anti public benchmark and merely lukewarm on private proxy benchmarks. His reasoning starts from what TypeSafe is actually selling, which is intelligence per dollar and per second, and his observation that cost and speed are the things you pay while intelligence is the thing you receive. The problem is that intelligence has an ineffable quality that benchmarks cannot capture, which is why the reaction that mattered after launch was not the video but developers discovering hours later that the model was genuinely usable. He argues public benchmarks are extremely gameable even by labs that try not to game them, recalling when every lab kept a team collecting MMLU-shaped data, which he describes as benchmarking with extra steps. His alternative is vibes and trust until a developer puts the model into a specific workflow and measures it there, paired with a company obligation to keep adding nines. He notes this cost TypeSafe real money during fundraising, when investors wanted benchmarks and the team refused on the grounds that the practice rewards bad actors. TypeSafe does run internal evals, and he insists the discipline of not gaming them is a top level priority that he enforces hard, since otherwise the company would be flying blind on its own frontier claims.

    The Bitterest Lesson and the Primacy of Data

    He offers his own variant of Rich Sutton’s argument, which he calls his bitterest lesson. Where Sutton’s bitter lesson elevates general methods and compute, Almeida says that data matters far more than compute and that picking the right task with a clear north star is the hardest and most important thing of all. He counts the times this has happened in the LLM era: RLHF, which shifted the task to instruction following and which nobody realized was possible; RLVR, which he scores as roughly a fifth of a shift and generously at that; and now RLCD. On RLCD he is careful to say it is not jargon, because RLHF likewise names a task rather than an algorithm, given that DPO and its descendants are all doing RLHF without using the algorithm from the original paper. The north star for RLCD is programmable AI with programs in the loop and the human removed. He considers TypeSafe a data company in the sense that model capability means data, and is hiring what he calls infinite data people. He describes onboarding them with a talk longer than the interview itself, and explains that the shape of the data follows the shape of the task: RLVR’s data is environments, RLHF’s is human feedback, and TypeSafe has its own kind. His team works like artists studying a cognitive core, finding its jagged edges and addressing each one in a way that generalizes rather than patching a single case.

    Robustness Instead of Determinism

    Asked why there is no seed parameter, he treats reliability as a catch-all for every reason AI fails to automate something, including type safety, determinism and jaggedness. Determinism means identical inputs producing identical outputs, which he concedes is mildly interesting for unit tests and considers the wrong north star. The property he cares about is robustness: similar inputs producing similar outputs. His test is to inject UUIDs or nonces into otherwise identical prompts and check that the answers stay stable, since the question is semantically unchanged, and he notes how badly most language models fail this. Robustness, he argues, is exactly where people get burned when AI makes decisions. He is not opposed to shipping determinism if developers make the case, but notes it trades against intelligence per dollar, and that TypeSafe is doing what he cheerfully calls disgusting things to stay on that frontier. The host predicts he will be peer pressured into seeds eventually, as every provider has been, and Almeida concedes only that he has been told his brand of unshakable is a polite word for stubborn.

    Model Versioning and the Quantization Question

    The host raises the concern developers were already voicing, which is that a company facing GPU constraints and optimizing for cost has every incentive to quietly quantize a model after launch. Almeida’s answer is unambiguous: they will not change a model once deployed, and doing so would be insane for an API even if it is fine for a first party product where you can change whatever you like. What he explicitly refuses to promise is longevity. TypeSafe plans to ship new models far faster than developers expect, and he will not commit to long term support for any particular version, though he acknowledges that developers hate broken dependencies and that the current version may get an LTS designation precisely because so many people are using it. The alternative, a fleet fractured across a hundred versions while the company iterates quickly, is what he wants to avoid. He says research is underway on a better mechanism, and predicts model-to-model deltas will typically be smaller than the variance from calling a string model twice, with the large jumps coming when a previously jagged capability becomes smooth.

    Three Primitives That Are Deliberately Not Types

    The API exposes three primitives, and none of them is named after an existing programming type. The boolean-like one takes its odd spelling from the letters of Bernoulli, because what it returns is a Bernoulli probability rather than a true or false. There is a score, and there is a choice. The naming is intentional: a score is not an integer, and if a library like Instructor or Pydantic silently mapped it to an int or a float, the developer would be misled. He says they erred toward clarity over familiarity. Each primitive maps cleanly onto a programming construct rather than a type: the Bernoulli-derived value drives an if statement, a score drives sorting or thresholding above and below a cut, and a choice is a switch on an enum that you may optionally hydrate into a function call. He is scathing about function calling as the incumbent alternative, describing the enum as the important part and a function call as an extremely ugly way to expose the same thing. More types are coming, and each will map to a programming primitive.

    Decomposition, Structured State, and ML Without the ML

    Asked for pro tips, he gives the section of the interview most likely to change how people build. Every part of the input, including state, instructions and criteria, can be a structured JSON object, and he says people underread this and assume everything is strings. Flattening structured state into a templated system message is old thinking, because you would never stringify your variables inside a program except when printing for a human. Deeper nesting is harder to reason over and TypeSafe is actively working on that, but the direction makes code more legible and agnostic to implementation. He calls system messages disgusting global variables into which you dump everything and hope each instruction lands, and recommends instead asking many small questions in parallel. His refusal example makes the case concrete: rather than asking whether to refuse, ask many independent questions about specific situations, so that discovering an unhandled case is a good outcome rather than a mystery. You add the question, set the threshold, keep the example as a test, and the behavior is fixed permanently rather than until context rot erodes the prompt. He calls this ML without the ML, and notes the honest caveat that this is exactly the pattern people abandoned before, because with expensive slow models it was worse on every axis than one big call. He is candid about where the models are not yet good enough, singling out automated trading as something people should probably leave to professionals, and pointing to confidence estimates as the mechanism for escalating hard cases to a human.

    Calibration Limits, Fine Tuning, and Cascades

    The host presses on the obvious gap: thresholding is the only lever a developer has, so what happens when the calibration itself is locally wrong? Almeida immediately corrects the premise that he claimed perfect calibration, then accepts the criticism that his only answers today are decompose further or adjust the threshold. He points to a report issues button and a commitment that every model version will be noticeably better or they will stop shipping. On fine tuning he is genuinely undecided, noting that generality often helps edge cases even within a narrow task, and that other providers have launched and retracted fine tuning offerings. What he finds more promising is calibration plus a cascade, where a confident answer from a cheap model is trusted and an uncertain one escalates to a larger model. He explicitly confirms multiple model sizes are coming, and speculates that if the cheapest intelligence gets cheap enough, people might stop writing regular expressions altogether.

    A Trillion Tokens a Day and What Actually Counts

    On launch metrics he is careful about which numbers mean anything. The milestone he will name is passing a trillion tokens a day, and what matters to him is that the volume persists overnight, which means machines are calling the API rather than humans trying it out. Waitlist signups, he says, do not matter for a developer platform, and he suspects many signups are not developers at all, arriving expecting a chatbot and leaving confused. His estimate is that if every human on earth wrote a couple of queries it would be a rounding error next to one power user’s loop. The metric that actually binds is rate limits, because once a developer gets value they immediately want more. He admits the team was called marketing geniuses on social media and says there was no marketer, only a group being their genuine irreverent selves, and notes the launch video had reached roughly 38 million views. He is dismissive of neolab framing, says the company sells parody swag about it, and insists what he wants is to be a reliable developer platform rather than the most fashionable lab.

    TFP Growth and the Inverse SaaS Apocalypse

    The economic section starts from a line the host says he has never seen a lab commit to, which is total factor productivity growth above three percent in five years. Almeida ties it back to the original OpenAI charter language about performing the majority of economically valuable work, and argues the field owes an answer to how a system can solve millennium prize problems while automating a rounding error of actual work. His position is that every model today sits at roughly zero percent, possibly not yet one, and that when the shift happens it will show up in economic statistics rather than in demos. He expects no mass unemployment and a great many beneficial shifts. He also says he is tired of AI being the foreground character and wants it to disappear into the background while the world simply becomes more delightful. His sharpest observation is that software in 2026 is essentially unchanged from 2019, differing only by a chat box on the side that cannot be trusted with decisions the company has a stake in. Rather than a SaaS apocalypse, he predicts the inverse, since incumbents know better than anyone which tasks are worth automating.

    Where System One Ends

    Asked how to tell a system one problem from a system two problem now that people are trying to put Jev on everything, he says the honest answer is that it is empirical, in the same way scaling laws are empirical and in the same way robotics has not worked despite the money. His belief is that pre-trained condensations of intelligence are fundamentally system one thinkers, and that system one is simply the best available description of what language models are strong at. He is generous about RLVR’s achievements in system two while noting how fragile and fractal the resulting capability is, comparing today’s complaints about jaggedness to the old complaints that ChatGPT was general but bad at grade school math. Each paradigm’s character follows from its north star: RLHF optimizes to please humans, RLVR optimizes benchmarks by definition since a benchmark is just programmatically verifiable output, and RLCD optimizes reliability under programmatic use. The host reports his own hands-on finding that Jev is state of the art at single hop reasoning and degrades monotonically as hops increase, which Almeida accepts while framing the work ahead as unearthing and smoothing capability rather than adding reasoning in strings. TypeSafe does not discard system two tasks; the intelligent behavior on them is low confidence and high uncertainty, which is itself a useful answer.

    Four Families of Use Cases

    The company mapped its use cases from first principles long before release, and they fall into four families. The first is dark data, the piles of information large companies hoarded but never dared run a language model across because the cost was prohibitive, which he calls a data scientist’s dream and one of the two biggest volume drivers. The second is coding agents. The third is real time intelligence in the loop, where every ten milliseconds shaved improves the product, with e-commerce and assistant-style applications called out and games mentioned with obvious enthusiasm. The fourth is smart software, meaning intrinsically composable systems doing things that could not previously exist, with a programming language built on Jev cited as an example he loves. Computer use arrived from an unexpected direction and impressed him, though he notes he is as anti-demo as he is anti-benchmaxxing and wants to find the weaknesses first. He also volunteers the cost pattern he thinks people are missing, which is to attach IDs to every element of a large state, pay for that state once, and then fan many cheap parallel questions across the IDs.

    Coding Agents Built for a Single Model World

    He describes something he finds genuinely surprising happening in the coding agent space. The two leading agents are architected around a single model world, which made sense while the game consisted of shopping between broadly similar models at different capability levels. Open source coding agents are currently experimenting freely with cheap system one calls, and since they are all at rough parity and there is only so much you can do with a while loop, the first one to find a pattern that depends on this new model class will briefly hold a monopoly on it and everyone else will copy it immediately. What the incumbents do in that situation is the open question, given their architecture. He says he would love to integrate with everyone, considers it not his job as infrastructure to be opinionated, and mentions an internal design patterns document under review by his team that he hopes to publish for agent builders.

    The Argument Against Pacing the Frontier

    On the joint statements labs have signed about pacing frontier development, he calls the discussion narrow because it assumes everyone must keep doing more RLVR. He first clarifies that RLVR was never really about verifiable rewards, since that had been failing long before the reasoning era, and is better understood as a shape in which the model is given latitude to do whatever it wants in the middle in order to solve the hardest problems. That latitude is the source of both the capability and the risk, which is why he calls the framing a sleight of hand: the labs are saying they intend to keep doing the thing that produces dangerous behavior, and then describing the resulting danger as a property of the world. He notes he does not need to do any RLVR, and that zero is optimal for his shape. He assigns the fault to researchers rather than the public, since the public reasonably assumes the labs are pursuing the best available direction and has no way to know what optionality exists. He is explicit that his goal is not to convince labs to change direction but to spark hope in software engineers that the things they always wanted automated can finally be automated. Later the host relays that in at least one researcher gathering the pacing position is political positioning aimed at the 2028 election, and Almeida’s reaction is unfeigned dismay, followed by a broader objection to misleading people even in service of what someone believes is the greater good.

    Fracturing Intelligence

    His unifying technical objection to how models are built today is fracturing. Optimizing a single model for chat and for reasoning forces the intelligence to split, and the resulting pathologies are the ones users complain about constantly: sycophancy, overconfidence, hallucination, and the bolded, emoji-laden, follow-up-question style that performs well in human preference arenas without answering the question. He traces these to the weirdness of strings, where a model must be miscalibrated and mode dropped and overconfident to avoid going off the rails, because the reward model punishes visible errors so severely. This warps the probability space and then interacts badly with reasoning training. He says that at OpenAI nobody was really studying this subtlety because attention was entirely on chat. The principle extends to identity: he will not train the model to say it is Jev from TypeSafe, because that too is a fracture, and what he wants is smooth predictable intelligence that reports what the internet contains. Identity, he argues, belongs to the first party product, not the API, since nobody building a chatbot wants it announcing which model it runs on.

    Leaving OpenAI

    The origin story is the most personal part of the conversation. The host remembers a Thanksgiving sprint when Almeida cancelled everything to commandeer idle GPUs, which turns out to have coincided with the board coup, an episode he describes as annoying while declining to elaborate. The problem had been on his mind since before ChatGPT launched, when he watched that team do what he considered the right task and cared enormously about the experience. He had fought hard to deploy InstructGPT, including writing an unpublished algorithm himself because cleaning the PPO data was too slow, and it took roughly half the LLM market almost immediately. He genuinely asked whether it was AGI, given it looked superhuman at instruction in, instruction out, and says everyone should have an answer for why it was not. What actually happened is that it powered copywriting tools and what is now called slop, and he worried they had made the internet worse. He went back to first principles and asked what would be calling the AI in an actual economic revolution, humans or code. The answer was many nines of code, while all the optimization was going into the human path. He wrote a document, Sam Altman told him to go work on it, and he assumed Anthropic must already be doing it. Eventually the instruction following team declared victory, he started training models expecting a week of work, and it took years. He called Eric first, approached Sasha only for a sanity check and she folded her startup on the spot, funding closed within two weeks, and people moved into the apartment of a self-described neat freak.

    Advice for Researchers and a Verdict on Neolabs

    Asked what a frustrated frontier lab researcher should do, he answers bluntly and with visible awareness that he is burning bridges. Most neolabs, in his view, are bad, and he does not want to be counted among them. The reason is that he does not value researchers as such; he values people who care about picking the right task, which makes credentialism backwards since pure research pedigree generally does not create value. His pragmatic read is that neolabs destroy value by redoing work from scratch with a low probability of moving the frontier, and that most he has spoken to want funding to play with experiments rather than a direction. If a researcher genuinely wants to explore, he says the established labs are probably the best place to do it. If they want to solve a real problem and break out of the field’s single-track thinking, they should absolutely go. He extends the same logic to capital allocation with his flattest line on the subject, that a billion dollars would not buy him a pre-training run, because slicing, combining and Frankensteining existing capability is inelegant and solves problems.

    The Tasks He Is Giving Away

    The closing question asks which north stars he wants other people to take, since his own next fifty years are spoken for. The fun one is games. He points at a demo where NPCs could be controlled by a model and argues you would not even need to call an expensive model in the game loop, since simple intelligent state machines for NPCs could make a static world genuinely compelling, citing his own affection for Stardew Valley. The serious one is coding agents freed from the tyranny of the KV cache, the subject of a piece he titled after the Wu-Tang line. His argument is that efficient cache use forces you into a single model and a continuously appended context, which forbids state management, abstraction and decomposition, and that this single constraint explains why routing is hard, why sub-agents underperform and why compaction is such a mess. You cannot give a sub-agent a genuinely easier task because summarizing the state to hand over would cost more intelligence than the task. If context became cheap, the design space opens: hierarchies of labeled subtasks that can be searched for relevant context on demand, parallel agents reading and writing each other’s state with real coordination rather than asking each other what they are doing, and cheap access to historical context. That last one produces his best reframe, which is that continual learning is a memory management problem rather than a learning problem, since the actual deficiency is having no smart way to look things up. He hopes to publish the document, jokes that his team may veto him, and says that if he were not running a company this is what he would be doing.

    Notable Quotes

    “How can AI be so unbelievably smart? How can we like solve millennium prize problems in math but still not automate even the most basics of works?”

    Diogo Almeida, on the question he says he opens his talks with and which the entire company exists to answer

    “Refusal is just like obviously a type error. If you ever want this in a dependency running in the background, what happens if that refuses? What if someone else is using that dependency?”

    Diogo Almeida, explaining why TypeSafe does not implement refusals in an API

    “We are an API, you are a developer. It’s none of my business, right?”

    Diogo Almeida, on companies asking his permission before deploying

    “The public benchmarks are extremely extremely gameable. Even if they try not to, they still will. Back in the old days, every lab had a team to collect data that looks like MMLU to make it look better.”

    Diogo Almeida, on why TypeSafe published no benchmark numbers at launch

    “System messages are like disgusting global variables where you just put everything in there and you put all the instructions at once. And then you hope that every single instruction gets nailed instead of asking the questions in parallel.”

    Diogo Almeida, on the prompting pattern he wants developers to abandon

    “It’s 2026 now. How is the software basically exactly the same despite AI being so freaking awesome other than sometimes having a chat box on the side?”

    Diogo Almeida, making the case that AI has automated almost none of the economy

    “I obviously don’t think I need to do more RLVR on our models. I think zero is the optimal amount for our shape, right?”

    Diogo Almeida, on why he considers the frontier pacing debate built on an unexamined premise

    “If you gave me a billion dollars I wouldn’t pre-train. I still believe that to be true.”

    Diogo Almeida, on where he thinks capital is being wasted in AI research

    “When that happens, what’ll be calling the AI if AI is an API? Will it be humans or it’ll be code? And I figured it was many nines of code, but all the optimization was going into the humans part.”

    Diogo Almeida, on the question that became TypeSafe

    “Isn’t it kind of weird that you start from scratch every time and you need to solve a problem called continuous learning? That’s actually like a memory management problem because you don’t have a smart way of looking up the memory, right?”

    Diogo Almeida, reframing continual learning near the end of the interview

    This is one of the densest founder interviews in recent memory, and the summary above leaves out the tangents on mid-training, the API naming debates, the Discord town halls and the story about his chief of staff making him lock in. Watch the full conversation here.

    Related Reading

  • Sam Altman on How to Start a Startup in the AI Era: Exponentials, Chaos, Compute Bottlenecks, and the Fight Against AI Authoritarianism

    More than a decade after his famous Stanford lectures on how to start a startup, Sam Altman sits down for a wide-ranging conversation about what has changed. His answer: almost everything. A ten-week-old startup today can ship what used to take a year, the ground is shifting faster than at any point in his career, and the defining fight of the moment is whether AI leads to broadly shared abundance or a new kind of authoritarianism. Along the way he covers the ChatGPT launch week, the decision to kill Sora to feed coding agents, his 28-country world tour, what Jony Ive taught him about design, and why he deleted TikTok.

    TLDW

    Altman argues that startups have their biggest edge when the ground is shifting, and it has never shifted faster, yet most founders are settling for “AI agents for enterprise vertical X” instead of building for the models of two years from now. He explains his core belief system (trust the exponential, in people, companies, and models), why operating in chaos is learnable but not teachable, and how a clear mission plus deep problem understanding tells you what to build. He walks through OpenAI’s bets: courting suppliers by showing them the research roadmap, the joint stock corporation as the industrial revolution’s real invention, why compute (transistors, then electrons) is the bottleneck, and why the world needs more focus on data centers that can build more data centers. He retells the ChatGPT million-user week, the Codex comeback against Claude Code, killing robotics for GPT-3 and Sora for coding agents, the coming third wave of persistent agents, real versus fake trends, Jony Ive’s problem-first design process, his TikTok addiction experiment, hiring fast movers and promoting executives internally, Masayoshi Son’s conviction, and why everyone will be busier, not idler, after superintelligence. The current fight, as he frames it: liberty versus a single machine god.

    Thoughts

    The most useful idea in this conversation is an arbitrage argument. Altman says the market has not priced in that scaling laws will continue, the same way it never fully priced in high-growth young founders. The practical move follows directly: start building the thing that is not economical this month but will be trivial in two years. Almost nobody does this. The gravitational pull toward “apply today’s agents to the easy wins” is exactly the kind of consensus behavior that produces competitive, low-upside companies. He is telling founders, fairly explicitly, that free money is sitting on the table for anyone willing to plan against the curve instead of the current model card.

    His line about algorithms versus data centers deserves more attention than it will get. Everyone in AI is obsessed with recursive self-improvement in software, algorithms that create better algorithms. Altman flips it into the physical world: data centers that can build more data centers, robot fleets powered by a data center’s own thinking, compounding infrastructure. Whether or not you buy the vision, it explains OpenAI’s capital allocation better than any press release. The company is behaving as if the constraint on intelligence is matter and energy, not ideas, and his blunt bottleneck ranking (transistors, then electrons) says the same thing in three words.

    The liberty versus safety framing is doing a lot of strategic work. Positioning the alternative to open access as “one single model as the machine god” makes decentralization sound like the only humane option, and it conveniently aligns with OpenAI’s commercial interest in putting its product in every hand on earth. That said, the underlying claim, that trading liberty for safety has been a long-term net loss every time humanity has tried it, is a serious argument, and he pairs it with a genuinely striking admission: one of the AI risks he worries about most is authoritarianism, a small number of people or companies deciding they need to control the world. Readers can decide how comfortably that sits alongside a trillion-dollar infrastructure buildout controlled by a small number of companies.

    There is also a quieter thread here about what can and cannot be transferred between people. Chaos tolerance is only learnable through reps. Strengths that come supernaturally cannot be explained, only observed, the way gamers study pros. Jony Ive’s leap from deep problem study to a fully formed idea is, by Altman’s own account, a step he does not understand. For a man whose company sells the automation of cognition, he keeps a surprisingly long list of things that resist being taught. That list is arguably a map of what stays valuable for humans, alongside his other candidate: betting with evolutionary biology, cooking, adventure, eating together.

    Finally, the TikTok confession is the most honest moment in the interview. The man building the next attention-capable device deliberately addicted himself to TikTok as product research, loved it, lost a Saturday afternoon to it, and deleted it because self-control was not enough. He then says, in nearly the same breath, that people will misuse the devices OpenAI ships with Jony Ive and that lives will get worse in ways we cannot imagine, and we will adapt. That is the entire ethical tension of consumer AI compressed into one anecdote, delivered by the person best positioned to do something about it.

    Key Takeaways

    • The biggest shift since the original How to Start a Startup lectures is what a tiny team can now do and how fast. A two-week-old startup Altman met had rebuilt an entire office productivity suite designed for AI as a first-class user, work he estimates would recently have taken a year.
    • Startups have their biggest inherent edge when the ground is shifting the most and when costs and cycle times are collapsing, which is happening in many places at once right now.
    • Most founders are building “AI agents for enterprise vertical X.” It will often work, but Altman doubts those will be the defining companies of the era, and he is surprised more people are not attacking crazy ambitious problems with the completely new toolset.
    • The single most important thing he would tell founders today: truly internalize that scaling laws will continue, and start working now on things that require smarter or cheaper models than exist this month.
    • His unifying belief system is a great trust in exponentials, whether in people, companies, or models. The market has still not adapted to either the founder version or the model version, which means there is free money in betting on both.
    • Operating in chaos is only learnable through reps, not teachable. Young founders’ key weakness is that they have not yet reached emotional peace with things constantly going wrong, and they pay for that education in unforced errors.
    • At YC office hours he could always identify new founders by their emotional state when describing problems. Veterans have survived enough company-killing events to stay calm.
    • The opposite of a bad experience is not a good experience, it is no experience. Borrowing Naval Ravikant’s image, a fast-forward button for your life would just end it, so be grateful for the bad days too.
    • A clear mission plus a deep understanding of the problem does most of the work of deciding what to build. OpenAI’s mission is to make intelligence extremely abundant, cheap, and broadly distributed.
    • One of the AI risks Altman worries about most right now is AI authoritarianism: a small number of people or companies thinking they need to control the world.
    • He frames the fight of the current moment as liberty versus a single model as machine god. Every time humanity has traded liberty for safety it has been a long-term net loss, so OpenAI’s answer is to empower people, with guardrails, and let society decide how to use the technology.
    • The key inputs to abundant intelligence (energy, chips, robots, data centers) are also exactly what you want immediately after you have abundant intelligence, because ideas still have to become things in the physical world.
    • Asked for the biggest bottleneck to continued scaling, his answer is four words: transistors, and then electrons, in that order.
    • Keeping suppliers on OpenAI’s timeline means showing them the upcoming models and research so they believe in the mission, then aligning their incentives with yours as much as possible. Orders alone get deprioritized.
    • Altman argues the most important invention of the industrial revolution was the joint stock corporation itself: incentive alignment, liability protection, and pooled capital let strangers cooperate beyond what any family business could do, and the curve of human welfare bent visibly after it appeared.
    • The chart people should study more is the fall of extreme poverty over the last hundred years, which he attributes to the ridiculous overperformance of capitalism.
    • He plans forward from the present guided by a small number of strongly held convictions about the future, rather than planning backward from a rigid 20-year vision. People with too many beliefs about the future end up chasing trends, like space companies turning into AI companies.
    • For over a decade the critical path to abundant intelligence has been clear enough that he never questioned the goal. Feeling close to superintelligence is the first thing that has made him think about what comes next (eventually, the ranch).
    • Get on planes in marginal situations. He recently took a very inconvenient two-overnight trip he cannot talk about, with a new baby at home, and it worked out. People systematically overestimate the risk of taking action.
    • The 2023 world tour (28 countries in 35 days, on Brian Chesky’s advice) happened because world leaders were nervous enough after GPT-4 that he sensed things were about to go very badly if nobody showed up to talk.
    • Simply getting people to explain out loud why they think a decision is high risk or low risk usually breaks through their intellectual blocks, because people are usually wrong in one direction or the other.
    • Corporate careers catastrophically suppress ambition. New founders arrive having always had a boss, punished since childhood for thinking too big; nearly every culture has a phrase like tall poppy syndrome for it. The cure is small repeated wins.
    • OpenAI’s superpower, in his telling, was principled conviction on something obvious that nobody else believed, plus assembling the pieces and talent around it. He was more worried they were drinking their own Kool-Aid than that everyone else was wrong.
    • By 2019 or 2020, Google should have run away with AI. OpenAI’s continued existence is, like AWS’s seven competition-free years, a business miracle that says something about how sclerotic big companies get.
    • On ChatGPT’s fifth day it crossed a million users. Researchers kept calling it a flash in the pan, but YC pattern recognition told him organic growth like that meant the quiet life was over: “we were being shot out of a cannon.”
    • There have been two giant AI form factors so far, chatbots and coding agents, and coding agents are going totally nuts. The third wave, coming soon: persistent agents that act as chiefs of staff, co-workers, and colleagues.
    • Codex was a deliberate kamikaze mission: OpenAI was way behind Claude Code, consensus said you never win against momentum, but coding mattered too much to recursive self-improvement to concede. The team pulled off what he calls a very rare thing in business history.
    • OpenAI repeatedly kills good things to make the best thing work better: robotics died for GPT-3, and Sora and the browser were shut down to pour compute and people into coding agents. Sora would have been super successful; it was still the right call.
    • Killing a project people love is never one meeting. It is a gradual realization that the compute, people, and product direction have a more important use, and people accept it because they understand the mission and the stakes.
    • There is too much focus on algorithms that create better algorithms and not enough on data centers that can create more data centers. With robots and an automated supply chain, a data center’s thinking power could drive the construction of its own copies.
    • The big idea is the easy part and carries none of the glory. Almost all of his time goes into execution: financing fabs, assembling chip design teams, getting the machinery of many companies to work together. Grinding.
    • Jony Ive taught him that really great design is way more about understanding the problem than the flash of insight. Ive studies a problem exhaustively (typefaces, engine sounds, materials, whole books of exploration) before letting himself think about solutions.
    • Altman calls the iPhone the greatest piece of technology humanity has yet made, but he no longer loves his relationship with it. He turned off nearly all notifications and deleted TikTok after an intentional research addiction got away from him.
    • Double down on strengths. The obsession with fixing weaknesses you will never be good at is a huge trap. And the meme that you can only hire for what you deeply understand is false: he cannot design, but thirty minutes with Jony Ive makes greatness obvious.
    • Organizational speed is about 90 percent determined by who you put in leadership roles. He evaluates everyone for whether they are a fast mover, and thinks executives should usually be promoted internally rather than hired from outside.
    • Real trends versus fake trends: a fake trend (VR for years) gets bought, half-loved, and shelved. A real trend (ChatGPT) becomes a persistent part of how people design their lives. The test is deep, enduring, daily use.
    • Technology keeps promising leisure and delivering ambition. Expectations rise, status is relative, and people want to be useful to each other, so everyone will be busier than expected after superintelligence, still complaining, secretly happy.
    • What stays valuable post-AI is what evolution built us for: cooking and eating together, adventure, quests, showing love through effort. Betting against evolutionary biology is usually a bad bet.
    • His last big failure of ambition: badly undershooting compute investment because he got psyched out by financial markets. He considers it a clear mistake he will not repeat.
    • The most painful thing in his last year had nothing to do with OpenAI: having kids while working this hard means missing pieces of a one-time thing, even as a present dad who does nothing but work and family.
    • A startup today still mostly looks like a startup of ten years ago because that is the received wisdom, and “using AI” usually just means using more Codex. Altman thinks it should look completely different, and only a few founders are trying.

    Detailed Summary

    The startup landscape has reset

    Ten years after his Stanford course, the biggest change is what a small team can do and how fast they can do it. A ten-week-old startup today looks nothing like one from 2016, and a startup that still looks like 2016 is in bad shape. What counts as a “hard startup” is changing so quickly that Altman admits he no longer has a perfect mental model for which things will be hard and valuable over a company’s lifetime: everyone says the physical world is where the value is because software is going free, but robots will get good, and even rockets may stop being hard. His conclusion is that times like this are precisely when startups have the biggest edge, because incumbency matters least when the ground is moving. His frustration is that so few founders act on it, defaulting to safe agent-wrapper plays instead of attacking the crazy thing with the new tools and planning for the models of two and four years from now.

    Exponentials as a belief system

    Asked whether years of mentally plotting founders’ growth trajectories prepared him to believe in model scaling curves, Altman generalizes: the common thread is trust in exponentials, whether the subject is a person, a company, or a model. It is evidently hard for people to hold this belief, which is why there is still free money in backing high-growth young founders, and why the market still underprices continued model progress. If he were still advising founders, getting them to wrap their heads around this would be his top priority, because it licenses the most profitable behavior available: building today what only tomorrow’s models make economical.

    Chaos, resilience, and the founder’s education

    Operating amid chaos, trusting you will figure it out, and not treating each crisis as the thing that kills you is, in Altman’s view, learnable only through repetition, never teachable. This is the real weakness of young founders: no career has given them emotional peace with constant malfunction, so they buy it with pain and unforced errors. At YC office hours he could tell a first-batch founder from a two-year veteran purely by emotional register. His reframe for enduring the bad stretches comes from Naval Ravikant: the opposite of a bad experience is not a good experience but no experience, and a fast-forward button for your life would simply end it. Since something will always be going wrong, gratitude for the bad days is a load-bearing skill.

    Mission, liberty, and the machine god question

    OpenAI decides what to tackle by combining a clear mission (make AI abundant, cheap, powerful, and in everyone’s hands) with a deep understanding of what blocks it: chips, energy, data centers, robots. Altman explicitly does not want OpenAI building every vertical on top of its own platform; he says a decentralized economy matters and that one of the AI risks he worries about most is AI authoritarianism. He frames today’s fight bluntly. Alignment and jobs remain unsolved, but the live question is whether the very real safety and economic concerns get used to justify one single model as machine god, or whether the technology is put messily into everyone’s hands. His answer rests on a historical claim: every time humanity has traded liberty for safety, it has been a long-term net loss. He also notes the elegant, or perhaps merely obvious, fact that the inputs to abundant intelligence (energy and robots) are the same things you most want right after you have it, since intelligence still has to manipulate matter.

    Incentives, suppliers, and the joint stock corporation

    Keeping the rest of the world on OpenAI’s timeline means talking to suppliers constantly and showing them the upcoming models and research until they believe, then aligning incentives as tightly as possible; a purchase order alone gets shuffled behind other priorities. Riffing on Charlie Munger’s line about always underestimating the power of incentives, Altman offers a revisionist history of the industrial revolution: the important invention was not any machine but the joint stock corporation, which added incentive alignment, liability protection, and capital pooling to a world of trust-based family businesses, enabling speculative technology development and serious financial systems. Draw all of human history and mark where the company was invented, and the curve changes shape. The fall of extreme poverty over the last century is, to him, the chart people should look at most, and the ridiculous overperformance of capitalism explains it. He pushes back gently on the host’s sociopath-CEO theory: the best CEOs he knows are high-ego, not sociopathic, driven by seeing how good they can get at the most interesting strategic game.

    The world tour and getting on planes

    Three years ago, right after GPT-4, world leaders were asking whether they needed to take control and shut things down. Sensing storm clouds, and advised by Brian Chesky, who had done an eight-city version for Airbnb, Altman compressed what could have been endless one-off trips into 28 countries in 35 days, living on a plane. Because the hops were mostly an hour at a time, jet lag was mild but exhaustion was total; near the end he began half-dreaming that he was waking in his childhood bed, which he read as a deep it-is-time-to-go-home signal. The tour lowered global tensions and taught him to batch international travel into 7 to 10 day chunks once or twice a year. The broader lesson he draws: people wildly overestimate the risk of most actions. Buying call options on Robinhood is risky; getting on a plane in a marginal situation is usually not. His recent unspeakable example: an inconvenient two-overnight trip with a new baby at home, taken reluctantly, that worked out. Codex is the example he can talk about: asking a team to win a category Claude Code already owned looked like a fool’s errand, and it produced what he calls one of the rare comebacks in business history, now the tool most of the best coders he knows use.

    From research lab to product company in five days

    OpenAI began as roughly a dozen people in Greg Brockman’s apartment saying “so here we are, what are we going to do? We should get a whiteboard.” It took a couple of years to find its groove. Running the research lab was, in Altman’s description, the coolest, least stressful, most intellectually satisfying job imaginable: a front-row seat to the most important work of the last century. He knew a product moment would eventually come and successfully deluded himself into acting like it would not. Then ChatGPT launched. Each day traffic peaked higher while researchers dismissed it as a PR flash in the pan, but he had seen enough organic growth curves at YC to recognize the spectral signature. On day five it crossed a million users and he went home and told Ollie: you have no idea how bad this is, our nice quiet life is about to go through a cannon. Running the product company shares almost nothing with running the lab; what YC did prepare him for was recognizing the moment. The pattern is now repeating: chatbots were wave one, coding agents are wave two and going nuts, and persistent agents (chiefs of staff, co-workers, colleagues) are the imminent third wave.

    Killing good things, compute, and self-replicating data centers

    The easy discipline is killing what is not working once you run out of ideas. The hard one is killing things that work: when GPT-3 took off, OpenAI shut down beloved robotics work; when coding agents took off, it shut down Sora and the browser, not because Sora would have failed (Altman says it would have been super successful) but because the compute and people had a more important use. Those calls are gradual realizations, not single meetings, and people accept them because the mission and stakes are understood. On infrastructure, which may become the biggest project of all time, OpenAI will not vertically integrate everything: chip design and model design belong together, electron production is a commodity. But he sees a deep imbalance between the field’s obsession with recursive algorithmic improvement and the neglected idea of data centers that can build more data centers, where a data center’s own intelligence drives robot fleets that construct its copies. Nearly all his time goes into the gritty execution behind this: financing fabs, assembling teams, making supply chains function, work he describes as grinding with none of the glory of big thoughts. His confessed failure of ambition is undershooting compute because financial markets psyched him out.

    Design, Jony Ive, and the device problem

    Working with Jony Ive taught Altman that great design is mostly deep problem understanding, not a flash of insight. Ive studies everything (the history of motorsport, cabin typefaces, engine sounds across decades) and writes literal books of exploration before allowing himself to think about solutions; the middle step, where understanding becomes a fully formed novel idea all at once, remains a mystery even up close. Altman calls the iPhone humanity’s greatest piece of technology while admitting he no longer loves his relationship with it: notifications are off for almost everything, including messaging apps, which he calls a big life upgrade. While building the Sora app he deliberately addicted himself to TikTok as research, loved it, believed he could control it, lost an hour, then a three-hour Saturday afternoon, briefly regained control, and finally deleted it. He is sure the devices OpenAI makes will be beautiful and empowering, and equally sure people will misuse them in ways that make lives worse before we adapt. He does not claim design as his own skill; he claims knowing greatness when he talks to it for thirty minutes, and rejects the meme that you can only hire in domains you deeply understand.

    People, speed, trends, and what stays human

    Organizational pace is 90 percent the people in leadership roles; management systems are rounding error. He sorts leaders into fast movers and slow movers, prefers promoting executives internally, and when hiring externally leans on long conversations, heavy reference checks, and casual trial collaboration. Raising ambition in people broken by corporate life takes time, and the mechanism is small repeated wins, not inspirational speeches, which he does not do. His real-versus-fake trend test, absorbed from mountains of YC data: fake trends (VR for many years) get purchased and shelved; real trends get woven into daily life the way ChatGPT has. Skills that come supernaturally to someone cannot be taught by explanation, only absorbed by studying the person in action, the way CS:GO players study pros. On the future of work, he expects the leisure promise to break the way it always has: expectations rise, status is relative, the desire to be useful persists, so a post-superintelligence world is a busier one, still complaining, secretly happy. What endures is what evolution shaped: cooking for people, eating together, adventure, quests. Betting against evolutionary biology is usually a bad bet. His own next thing, once broadly shared prosperity from superintelligence is on the glide path: eventually, the ranch. And the most painful thing of his year was not corporate at all, but the arithmetic of new fatherhood against the singularity’s work hours.

    Notable Quotes

    “I developed a great trust in exponentials in people or companies or models.”

    Sam Altman, on the belief system connecting his YC founder bets to AI scaling laws

    “Transistors and then electrons in that order.”

    Sam Altman, asked what the biggest bottleneck is to scaling AI unabated

    “Every time that humanity has traded off its liberty for safety it’s been a long-term net loss and so we are going to put this in the hands of people.”

    Sam Altman, framing the fight between AI authoritarianism and broad empowerment

    “I was more worried that we were drinking our own Kool-Aid than everybody else was wrong.”

    Sam Altman, on OpenAI’s early conviction that scaling would work

    “You have no idea how bad this is. You have no idea what’s about to happen. It’s not just bad for me, it’s bad for you, too. Like we have this nice quiet life, you know, it’s really wonderful. It’s about to like kind of go through a cannon.”

    Sam Altman, recounting what he said at home the day ChatGPT crossed a million users

    “There is relatively too much focus on algorithms that create better algorithms and not enough focus on data centers that can create more data centers.”

    Sam Altman, on the neglected physical half of recursive self-improvement

    “Really great design is way more about understanding the problem than the flash of insight.”

    Sam Altman, on the biggest lesson from working with Jony Ive

    “Betting against evolutionary biology is like usually a bad bet.”

    Sam Altman, on which human activities survive a world of superintelligence

    “Honestly, having kids and working really hard at the same time is brutal.”

    Sam Altman, naming the most painful thing of his last twelve months

    Watch the full conversation here.

    Related Reading

  • OpenCode CEO Jay V on 20x Growth in 6 Months: 13 Million Users, 7 Trillion Tokens a Day, the Anthropic Block That Backfired, and the 16-Year Road to Overnight Success

    In this episode of Y Combinator’s Lightcone podcast, Jay V, founder and CEO of OpenCode, the open-source coding agent that works with any model, walks through one of the wildest growth stories in developer tools: 650,000 monthly active users in January to roughly 13 million by June, 7 trillion tokens processed per day, and a business that went from zero to a $40 million revenue run rate in about eight months. He also tells the part almost nobody knows: the company behind this “overnight success” is a 16-year-old legal entity that applied to Y Combinator nine times before getting in.

    TLDW

    Jay V explains how OpenCode grew 20x in six months to around 13 million monthly active users and 4.6 million weekly actives, processing 7 trillion tokens a day (more than OpenRouter’s entire volume), with an inference business annualizing near $40 million plus 160,000 subscribers worth another $18 million. The inflection point came when Anthropic started blocking Claude Code subscriptions inside OpenCode by rejecting requests whose system prompt contained the words “open code,” which backfired by equating the two products and sending curious users flooding in, shortly after which OpenAI’s Codex officially supported OpenCode. The conversation covers OpenCode’s public usage data (DeepSeek Flash dominating token volume despite GLM hype), a global user base led by China at 17% with heavy usage in Indonesia, Brazil, and Vietnam, Fortune 500 companies discovering thousands of employees already using the tool, the shift from ad-based CAC to token-based CAC, the flat 24-hour GPU utilization curve that comes from serving the whole planet, the “betting the field” marketplace thesis on model commoditization, and the founder’s 16-year, nine-application journey from a Waterloo dorm through SST, OpenNext, and selling coffee over SSH to finally catching lightning.

    Thoughts

    The Anthropic block is the most instructive growth story in the episode, because it is a perfect modern Streisand effect. Anthropic had a defensible reason to stop subsidized Claude Code subscriptions from flowing through a third-party harness, but the implementation (rejecting any request whose system prompt literally contained “open code”) turned a quiet policy decision into a public endorsement. As Jay puts it, the block placed OpenCode on the same pedestal as Claude Code in the minds of developers who had never heard of it. The hosts’ Instacart comparison is apt: when Amazon bought Whole Foods, the “death of Instacart” meme drove every grocer in America into Instacart’s arms. Incumbents keep learning this lesson the hard way. You cannot block a product without simultaneously advertising that it matters.

    The deeper story is geographic. Silicon Valley talks about coding agents as if the $200-per-month power user is the market, and Jay’s data says the opposite. China alone is 17% of OpenCode’s usage, with Indonesia, Brazil, and Vietnam each carrying meaningful share, places where a frontier subscription costs more than rent. OpenCode’s $10 Go plan, running DeepSeek and GLM instead of Sonnet and Opus, is how billions of developers will actually have their first coding-agent moment. There is also a hard operational edge hiding in that distribution: because the East works while the West sleeps, OpenCode’s GPU utilization runs a nearly flat 24-hour cycle, which quietly improves unit economics in a way no single-market competitor can match. Serving the whole planet is not just a mission statement. It is a margin strategy.

    OpenCode’s neutrality is turning into one of the most valuable datasets in AI. Because the product is a harness over every model rather than a storefront for one lab, opencode.ai/data shows what developers actually run when they are spending their own money, and it routinely contradicts the Twitter narrative. GLM was supposedly eating DeepSeek’s lunch; the token-volume charts show DeepSeek Flash dipping and then bouncing right back. Users are not loyal, they are rational: they ride frontier limits until they hit caps, then switch to models cheap and fast enough to finish the day’s work. That behavioral reality, boring cost optimization rather than fandom, is what the model market actually looks like once the marketing fog clears, and only a neutral aggregator gets to see it.

    The business model inversion deserves more attention than it usually gets. In the last era, customer acquisition cost meant ads. In this one, it means tokens: the free tier is the marketing budget, spent on giving people the aha moment, and the payoff comes when a fraction of those users become whales paying per token, where OpenCode’s volume discounts become margin. This is the same funnel Anthropic and OpenAI run, except the frontier labs subsidize with investor billions while OpenCode rides the falling cost curve of open-weight models. The enterprise motion follows the same bottoms-up physics: no procurement dance, just inbound emails saying thousands of our employees are already using you, please sign the security questionnaire. That is the purest product-market-fit signal that exists.

    And then there is the 16-year overnight success. Same legal entity since 2010, same two founders from a Waterloo dorm room, nine YC applications and four interviews before acceptance in 2021, years of living with parents and running out of money, a serverless framework, a coffee shop that ran over SSH. Every “dead end” turns out to have been training: the consumer company taught metrics discipline, SST taught open source and building in public, the terminal storefront taught terminal-UI craft that made OpenCode instantly credible with the Neovim crowd. The hosts land the right conclusion: lightning did strike, but the founders spent a decade positioning the bottle. In an industry currently obsessed with six-month-old unicorns, this episode is a useful reminder that most of them are carrying more history than the headline suggests.

    Key Takeaways

    • OpenCode ended June 2026 at roughly 13 million monthly active users and 4.6 million weekly actives, close to Codex’s numbers, a 20x increase from about 650,000 monthly actives at the start of the year.
    • The platform now processes around 7 trillion tokens per day, more than OpenRouter’s total of roughly 6 trillion, up from about 300 billion per day at the beginning of the year.
    • The pay-per-token inference business, launched around late September 2025, annualizes to $31-33 million on June data and $38-40 million on the most recent week, roughly eight months from zero.
    • The subscription product launched in late February has grown to about 160,000 monthly subscribers, roughly $18 million in annualized revenue on top of inference.
    • A Codex lead engineer publicly noted that about 5% of all Codex subscribers use OpenCode as their main harness, and OpenAI officially supports Codex subscriptions inside OpenCode.
    • In the first week of January, Anthropic began blocking Claude Code subscriptions in OpenCode by rejecting any request whose system prompt contained the words “open code.”
    • Jay concedes the block made business sense (Anthropic subsidizes that usage) but says it inadvertently equated OpenCode with Claude Code and drove waves of new users to investigate the product.
    • The hosts compare it to Amazon buying Whole Foods: the “death of Instacart” meme drove every grocer in America to sign with Instacart, fueling its growth instead of killing it.
    • The founding premise is that most people in the world still have not experienced the magic of a coding agent, and frontier per-token prices put that moment out of reach for much of the globe.
    • When OpenCode launched in June 2025 the pitch was using your Claude Code subscription in a better terminal UI; by August and September the first credible open-source models (GLM, Kimi, MiniMax) arrived, roughly six months behind the frontier.
    • February 2026 marked the first four-week span in OpenCode’s data where users ran Gemini more than the Anthropic models (Sonnet plus Opus combined), which convinced the team the non-Anthropic models were ready for real work and triggered the subscription launch.
    • OpenCode publishes its usage data at opencode.ai/data, covering the Go plan where $10 a month buys access to open-source models.
    • DeepSeek Flash leads token volume per day, with the two DeepSeek models plus GLM as the top three, despite social media chatter suggesting GLM had overtaken DeepSeek.
    • By unique users the top models run DeepSeek Flash at about 38,000, DeepSeek Pro at 31,000, and GLM 5.2 near 30,000.
    • A key usage pattern: as users approach daily or weekly limits on premium models, they switch to very cheap models like DeepSeek Flash to finish their work, extending how much coding-agent time their budget buys.
    • Speed matters too: some open models are hosted with far higher tokens-per-second than alternatives, making the agent feel near real time, and users perceive quality niches, like GLM 5.2 being better at front-end design.
    • China is OpenCode’s largest market at 17% of usage, which the hosts note may make it the only YC company in history with meaningful usage in China, partly because Chinese developers want to run Chinese models and OpenCode gives them that choice.
    • Developing countries are huge: Indonesia at 4% of traffic, Brazil at 5%, plus Vietnam and similar markets where a $200-a-month Claude Code subscription is prohibitively expensive.
    • The US, which the team was not even targeting with the Go plan, is growing strongly anyway, which Jay reads as a broader vibe shift toward token budgeting even among Americans.
    • Large US companies with effectively unlimited token budgets also adopted OpenCode early because they did not want to be locked into a specific model or harness.
    • Dozens of forward-leaning Fortune 500 companies have significant OpenCode footprints, often discovered when the company itself emails saying thousands of employees are already using it.
    • Enterprise inbound has inverted the old SaaS procurement dance: companies beg OpenCode to fill out security questionnaires so they can officially use a product their engineers already adopted.
    • Enterprise pull comes in four flavors: officially blessing developer usage, extending the tool to non-technical employees, embedding the agent loop inside their own products, and managing token spend by routing teams to cheaper models.
    • One enterprise asked for deep visibility into exactly what every employee does with the tool, which the team flagged as a should-we-even-build-this question.
    • Ramp built a Slack bot running OpenCode’s embeddable server (the agent loop that works behind the UI) before OpenCode had built anything similar internally, publishing a blog post about it in December.
    • OpenCode is architected as a two-part product: the terminal UI you interact with, and a separately embeddable server that runs the agent loop and calls the LLM.
    • The new CAC is tokens, not ads: the free tier exists to give people the magic moment, the subscription converts them to real work, and whales paying per token feed directly into margin via OpenCode’s volume discounts on inference.
    • The episode references Dylan Patel’s podcast claim that Anthropic reached roughly $50 billion annualized revenue at around 70% margin in Q2, proof that the subsidize-then-harvest funnel can cross into profitability.
    • Global usage produces a nearly flat 24-hour GPU utilization curve (the East works while the West sleeps), improving unit economics versus competitors serving one region.
    • Jay describes OpenCode as a marketplace that showcases model diversity: competition among labs benefits consumers, while vendor lock-in mostly benefits vendor margins.
    • OpenCode is now the largest customer by token volume for most open-source model labs, making the relationship symbiotic: the strategy is not picking a winning lab but betting the whole field.
    • Every bump in OpenCode’s monthly actives traces back to a corresponding release in the open-source model market, making its growth a proxy for open-model progress.
    • The name OpenCode was deliberate positioning: when a market has one or two dominant players, the rest coalesces around an open alternative, and whoever occupies that position first is very hard to displace.
    • To support 70+ models and providers at launch, the team built models.dev, an open-source database of models and providers that Jay calls probably the best such dataset in the world.
    • The origin moment: when Claude Code appeared in February 2025, the team (Neovim users unimpressed by its terminal UI) decided to build a coding agent that met the standard of modern terminal tools, credibility that resonated instantly with the core developer audience.
    • The team had form here: co-founder Dax had built terminal.shop, a complete storefront for buying coffee over SSH, the kind of eccentric-taste project the hosts argue pulls founders toward outlier outcomes.
    • The company is one 16-year-old legal entity, incorporated in 2010, founded by Jay and his college roommate Frank after a Waterloo co-op term convinced Jay he never wanted a normal job.
    • Jay applied to YC nine times between 2016 and 2021 with four interviews before getting in, with his first interview dating back to the era when Paul Graham ran them and an Airbnb founder was hanging around the waiting room.
    • The 2021 YC idea was a serverless platform, Heroku for AWS, which became SST, the team’s first big open-source project and the on-ramp to building in public.
    • Building in public became core identity after co-founder Dax observed that if all your code is public and you work in public, staying silent about it is a disservice to the product; the community now follows the company like a reality TV show.
    • Jay credits survival to stubbornness, visible forward progress, and cheap burn (living with parents after running out of money), while warning founders: don’t try this at home.
    • The hosts’ framing of the whole arc: it took ten years of grinding to get to zero-to-$30-million in eight months, and catching lightning in a bottle requires positioning the bottle correctly first.

    Detailed Summary

    The Numbers: 20x in Six Months

    OpenCode began the year around 650,000 monthly active users and ended June near 13 million, with 4.6 million weekly actives that put it in the same conversation as OpenAI’s Codex. Token throughput grew from roughly 300 billion per day to 7 trillion, a volume larger than all of OpenRouter. The money followed two tracks: a pay-per-token inference business launched in the fall that annualizes near $40 million on recent weeks, and a subscription product launched in late February that reached 160,000 monthly subscribers and about $18 million annualized. Codex officially supporting OpenCode, with around 5% of Codex subscribers choosing it as their harness, added a second frontier on-ramp right as the Anthropic controversy peaked.

    The Anthropic Block That Backfired

    Using a Claude Code subscription inside OpenCode was one of the most common usage patterns until Anthropic moved to stop it in early January, rejecting requests whose system prompt mentioned “open code.” Jay is gracious about the logic (Anthropic subsidizes subscription usage and wants it inside its own product) but the effect was the opposite of containment. The block put the scrappy open-source harness on the same pedestal as the category leader, told every developer who had not tried it that it was worth investigating, and kicked off the year’s 20x run. The hosts draw the Instacart parallel: a supposed death blow that functioned as the best marketing campaign the company never paid for.

    A Global User Base the Valley Doesn’t See

    The product premise is that the coding-agent aha moment is a once-a-generation experience most of the world cannot afford at frontier prices. The Go plan ($10 a month for open-source models) was built for that global audience, and the geography shows it: China leads at 17%, with Indonesia at 4%, Brazil at 5%, and Vietnam prominent, markets where $200 a month is simply not a consumer price point. Two surprises followed. Chinese developers use OpenCode partly to run their own country’s models, which no US-locked product lets them do. And the US, never the target for Go, is growing fast anyway, which Jay reads as the token-budgeting vibe shift reaching even the throw-money-at-it crowd, helped by moments like GLM 5.2’s popularity making the plan the easiest way to try it.

    What the Usage Data Really Shows

    OpenCode publishes per-model usage at opencode.ai/data, and because every data point is an actual end user rather than aggregated API traffic, it is arguably the cleanest picture of what working engineers really run. DeepSeek Flash dominates token volume, the two DeepSeeks plus GLM hold the top three, and the market-share graph shows DeepSeek dipping when GLM launched and then bouncing back, contradicting the Twitter narrative of a GLM takeover. By unique users, Flash leads at 38,000 with DeepSeek Pro at 31,000 and GLM 5.2 near 30,000. The behavioral driver is pragmatic: cheap, fast models let users keep working after they hit premium limits, hosted speeds make some models feel real time, and perceived niches (GLM for front-end design) steer specific workloads.

    Enterprises Arriving Through the Back Door

    Before the open-model wave, companies adopted OpenCode to avoid lock-in to any single model or harness. Now dozens of forward-thinking Fortune 500 companies have significant footprints, and the procurement process has inverted: instead of sales outreach, OpenCode receives DMs saying a few thousand employees are already using the product, please sign the security questionnaire, and often, please don’t tell anyone. Once inside, enterprises pull in predictable directions: extend access to non-technical staff, embed the agent loop in their own products, and manage token spend by restricting expensive frontier models to teams that need them. Ramp exemplified the embedding path, running a Slack bot on OpenCode’s server component before OpenCode itself had tried it. One request, total visibility into employee activity, raised the harder question of what the company is willing to build.

    Token Economics: CAC Is Now Paid in Tokens

    The episode’s sharpest business insight is that customer acquisition cost has migrated from ads to tokens. Becoming skilled enough with coding agents to justify heavy spend is itself expensive, a chasm most individuals and companies cannot cross unaided. Anthropic and OpenAI solve this by subsidizing subscriptions until a percentage of users become whales, and per Dylan Patel’s numbers cited in the episode, that funnel has carried Anthropic to roughly $50 billion annualized at 70% margins. OpenCode runs the same funnel without frontier-scale subsidies: the free tier delivers the magic moment, the $10 plan makes real work affordable on open models, and whales paying per token convert OpenCode’s volume discounts into margin. The flat 24-hour GPU utilization curve from serving every timezone compounds the advantage.

    Betting the Field: The Marketplace Thesis

    Jay frames OpenCode as a marketplace where users pick models by attribute and cost, which keeps labs honest and passes competitive gains to consumers instead of vendor margins. Every bump in OpenCode’s growth traces to a release in the open-model market, so the company is explicitly not picking a winning lab; it is betting the field. That bet has made OpenCode the largest customer by token volume for most open-source model labs, a symbiosis where each side needs the other. On commoditization, Jay’s view is nuanced: the intelligence market is so large that labs will carve defensible niches along the quality-cost-performance axes, the way DeepSeek deliberately owns the cost corner. The positioning strategy has deep roots: as with the team’s earlier OpenNext project, when a market has two dominant players, the rest coalesces around an open alternative, and OpenCode raced to become that default, building models.dev along the way just to support 70+ providers at launch.

    Sixteen Years to Overnight Success

    The backstory reframes everything. Jay started the company after a discouraging Waterloo co-op term in 2006-2007, incorporated with college roommate Frank in 2010, and spent the next decade shipping products that did “reasonably well” while applying to YC nine times across 2016-2021, with four interviews, all as the same legal entity, the same founders, and a rotating cast of ideas. His first YC interview was with Paul Graham, in a waiting room shared with an Airbnb founder. Acceptance finally came in 2021 with the serverless platform that became SST, the team’s gateway into open source and building in public, a practice pushed by YC’s Dalton and crystallized by co-founder Dax’s observation that public code deserves public storytelling. When Claude Code landed in February 2025, the team’s terminal-UI taste (honed on projects as eccentric as coffee-over-SSH) told them exactly what to build. The hosts close on the honest version of the lightning-in-a-bottle myth: ten years of grinding taught the team consumer metrics, open source, marketing, and positioning, so when the strike came, the bottle was already in place.

    Notable Quotes

    “Most people in the world still haven’t experienced the magic of a coding agent.”

    Jay V, on the founding premise of OpenCode

    “You really know you have product market fit when like enterprises are bugging you to sign the security agreement so they can use your product.”

    Lightcone host, on OpenCode’s inverted enterprise sales motion

    “It’s not that we’re picking a winner in terms of a model lab. We’re just betting the field. We just think the rest of the field is going to do well.”

    Jay V, on OpenCode’s strategy toward the model market

    “With these open-source models, we’re the largest customer for most of them.”

    Jay V, on OpenCode’s token volume relative to open-model labs

    “When you’ve got a dominant or in this case two dominant players in the market, the rest of the market coalesces around an open alternative. And picking that position ends up being really valuable because if you pick it, it’s very hard for somebody else to displace you.”

    Jay V, on the deliberate positioning behind the OpenCode name

    “This is just an unprecedented market, like the market for intelligence has not existed before, everybody should be thinking in a positive-sum grow-the-pie mentality.”

    Lightcone host, on why labs should welcome OpenCode’s growth

    “Look, you know, all your code is public. You work basically in public. If you don’t talk about it publicly, you’re probably doing yourself a disservice and your product a disservice.”

    Jay V, recounting co-founder Dax’s case for building in public

    “It was really more a journey that took 10 years to get to 0 to 30 million in 8 months.”

    Lightcone host, reframing the overnight-success narrative

    “To catch the lightning in the bottle, you actually like have to sort of position the bottle correctly and be ready for it and know what to do with it.”

    Lightcone host, closing the episode on preparation meeting luck

    Watch the full conversation here.

    Related Reading

    • OpenCode the open-source coding agent discussed throughout the episode, including its public usage data.
    • models.dev the open-source database of AI models and providers the team built to support 70+ providers at launch.
    • SST the serverless framework that got the company into YC and established its open-source, build-in-public roots.
    • Terminal the coffee-over-SSH storefront that proved the team’s terminal-UI chops before OpenCode existed.
    • Y Combinator the accelerator behind the Lightcone podcast, which Jay applied to nine times before getting in.
  • Jensen Huang at Stanford CS153 Frontier Systems on Co-Design, Agentic Computing, Vera Rubin, Open Models, and the Million-X Decade That Reshaped AI Infrastructure

    https://www.youtube.com/watch?v=tsQB0n0YV3k

    NVIDIA CEO Jensen Huang returned to Stanford for the CS153 Frontier Systems class (the room nicknamed itself “AI Coachella”) to lay out, in raw form, how he thinks about the computer being reinvented for the first time in over sixty years. Across roughly seventy minutes of student questions he walks through the codesign philosophy that gave NVIDIA a million-x decade, the architectural through-line from Hopper to Grace Blackwell to Vera Rubin to Feynman, the case for open source foundation models, the realities of tokens per watt and MFU, energy demand running a thousand times higher, the China and export-control debate, and his own biggest strategic mistakes. Watch the full conversation on YouTube.

    TLDW

    Huang argues every layer of computing has changed: the programming model, the system architecture, the deployment pattern, the economics. Co-design across CPUs, GPUs, networking, storage, switches and compilers gave NVIDIA roughly a million-x speed-up over ten years versus the ten-x Moore’s Law era, and that headroom is what let researchers say “just train on the whole internet.” Hopper was built for pre-training, Grace Blackwell NVLink72 for inference and reasoning (50x over Hopper in two years), Vera Rubin is built for agents that load long memory, call tools and need a low-latency single-threaded CPU bolted directly to the GPU, and Feynman extends that to swarms of agents that spawn sub-agents. Open weights matter because safety, sovereignty (230-plus languages no one else will fund) and domain models for biology, autonomy, robotics and climate need a foundation that NVIDIA is willing to seed. Compute is not really the scarce resource (Huang says place the order and the chips ship), the broken thing is institutional budgeting that can’t put a billion dollars into a shared university supercomputer. Energy demand is heading a thousand times higher and this is finally the moment market forces alone will fund sustainable generation. On geopolitics he rejects the GPUs-as-atomic-bombs framing and warns America will end up like its telecom industry if it cedes two thirds of the world. On career he advises seeking suffering on purpose. On strategy he says observe, reason from first principles, build a mental model, work backwards, minimize opportunity cost, maximize optionality.

    Key Takeaways

    • The computing model has been substantially unchanged since the IBM System 360, sixty-plus years ago. Huang’s first computer architecture book was the System 360 manual. AI is the first true reinvention.
    • Old computing was pre-recorded retrieval. New computing is generated, contextually aware and continuous. Cloud was on-demand. Agentic systems run continuously.
    • Codesign is NVIDIA’s central thesis. Inherited from the Hennessy and Patterson RISC era at Stanford, extended across CPUs, GPUs, networking, switches, storage, compilers and frameworks all optimized together.
    • The result of full-stack codesign: roughly 1,000,000x faster compute over ten years, versus a generous 10x to 100x for Moore’s Law in the same period. Dennard scaling effectively ended a decade ago.
    • That million-x speed-up is what unlocked “train on all of the internet” as a realistic AI strategy.
    • After GPT, Huang says it was obvious thinking was next. Reasoning is just generating tokens consumed internally, then using tools is generating tokens consumed externally. Agentic systems followed predictably.
    • Education needs AI baked into the curriculum, not just taught as a subject. Pre-recorded textbooks cannot keep pace with knowledge being generated in real time.
    • Huang says he cannot learn anymore without AI. He has the AI read the paper, then read every related paper, then become a dedicated researcher he can interrogate.
    • Mead and Conway and the first-principles methodology of semiconductor design are still worth learning even though most of the scaling tricks have been exhausted.
    • NVIDIA itself is one of the largest consumers of Anthropic and OpenAI tokens in the world. One hundred percent of NVIDIA engineers are now agentically supported. Huang recommends Claude and similar tools by name and says open-source downloads will not match the integrated product harness.
    • NVIDIA still invests heavily in open foundation models because language and intelligence represent the codification of human knowledge. Five pillars: Nemotron (language), BioNeMo (biology), Alphamayo (autonomous vehicles), Groot (humanoid robotics) and a climate science model (mesoscale multiphysics).
    • Sovereign language models matter. Roughly 230 world languages will never be a top priority for a commercial frontier lab. Nemotron is near-frontier and fully fine-tunable so any country can adapt it.
    • Safety and security require open weights. You cannot defend against or audit a black box. Transparent systems let researchers interrogate models and let defenders deploy swarms.
    • The future of cyber defense is not bigger-model-versus-bigger-model. It is trillions of cheap fast small models like Nemotron Nano surrounding the threat.
    • Domain models fuse language priors with world models. Alphamayo learned to drive safely on a few million miles instead of billions because it can reason like a human about the road.
    • MFU (Model Flops Utilization) is a misleading metric. Huang says he wants low MFU, because that means he over-provisioned every resource and never gets pinned by Amdahl’s law during a spike.
    • The xAI Memphis cluster running at 11 percent MFU is not necessarily a failure mode. In disaggregated prefill plus decode inference you can deliver very high tokens per watt with very low MFU.
    • The right metric is performance, ultimately tokens per watt as a proxy for intelligence per watt, and even that needs adjustment because not all tokens are equal. Coding tokens are worth more than other tokens.
    • Hopper was designed for pre-training. NVIDIA chose to build multi-billion-dollar systems when the largest existing scientific supercomputer cost $350 million, with no proven customer base. It worked.
    • Grace Blackwell NVLink72 was designed for inference, especially the high-memory-bandwidth decode phase. It is the world’s first rack-scale computer and delivered a 50x speed-up over Hopper in two years, against an expected 2x from Moore’s Law.
    • Vera Rubin is designed for agents. Long-term memory wired into storage and into the GPU fabric, working memory, heavy tool use, and Vera, a CPU optimized for low-latency multi-core single-threaded code so a multi-billion-dollar GPU system does not stall waiting on a slow tool call.
    • Feynman is being shaped for swarms of agents with sub-agents and sub-sub-agents, a recursive software topology that demands a new compute pattern.
    • Tokens per watt improved 50x in one generation. Compounding energy efficiency is the lever NVIDIA controls directly.
    • Total compute energy demand is heading roughly a thousand times higher than today, possibly two orders of magnitude beyond that. Huang says he would not be surprised if the estimate is low.
    • For the first time in history, market forces alone are enough to fund solar, nuclear and grid upgrades. Government subsidies are no longer required to make sustainable energy investment rational.
    • Copper interconnect is becoming a bottleneck. Photonics is moving from optional to structural inside racks and across them.
    • Comparing NVIDIA GPUs to atomic bombs, Huang says, is a stupid analogy. A billion people use NVIDIA GPUs. He advocates them to his family. He does not advocate atomic bombs to anyone.
    • If the United States cedes two thirds of the global market to competitors on policy grounds, the American technology industry will end up like American telecommunications, which was policied out of existence.
    • Huang directly rejects AI doom-by-singularity narratives. It is not true that we have no idea how these systems work. It is not true that the technology becomes infinitely powerful in a nanosecond. He calls the rhetoric irresponsible and harmful to the field students are about to enter.
    • On Stanford specifically: if the university president places an order, NVIDIA will deliver the chips. The bottleneck is that no university department has a billion-dollar compute budget because budgeting is fragmented across grants. Stanford’s $40 billion endowment is more than enough to fix that.
    • “It’s Stanford’s fault” is meant as empowerment. If something is your fault, you can solve it.
    • Career advice: do not optimize purely for passion. Most people do not yet know what they love. Pick the job in front of you and do it as well as possible. Even as CEO, Huang says, 90 percent of the work is hard and he suffers through it.
    • Suffering on purpose builds the muscle of resilience. When the company, the team or the family needs you to be tough, that muscle has to already exist.
    • NVIDIA’s first generation of products was technically wrong in nearly every dimension: curved surfaces instead of triangles, no Z-buffer, forward instead of inverse texture mapping, no floating point. The strategic recovery, not the technology, taught Huang the lessons that have lasted decades.
    • The biggest clean strategic mistake Huang names is the move into mobile chips (Tegra). It grew to a billion dollars then went to zero when Qualcomm’s modem dominance shut NVIDIA out of the 3G to 4G transition. The recovery into automotive and robotics (the Thor chip is the great great great grandson of that mobile lineage) was real, but Huang refuses to rationalize the original choice.
    • Forecasting framework: observe, reason from first principles, ask “so what” and “what next” until you have a mental model of the future, place your company inside that model, then work backwards while minimizing opportunity cost and maximizing optionality.
    • Best part of the CEO job: living at the intersection of vision, strategy and execution surrounded by people capable enough to make ambitious visions real. Worst part: the responsibility for everyone who joined the spaceship, especially in the near-death moments NVIDIA had four or five times early on.
    • Underrated insider note: Huang’s first apple pie with cheese, first hot fudge sandwich and first milkshake all happened at Denny’s. The Superbird, the fried chicken and a custom Superbird-style ham and cheese with tomato and mustard are his order.

    Detailed Summary

    Computing reinvented from the ground up

    Huang frames the moment as the first true rewrite of the computer in sixty-plus years. From the IBM System 360 forward, the mental model of writing code, running code, taking a computer to market and reasoning about applications stayed roughly constant. AI changes the programming model itself. Software is no longer a compiled binary running deterministically on a CPU. It is a neural network running on a GPU producing generated, contextual, real-time output. That cascades into how companies are organized, what tools developers use, what the network and storage stack look like, and what an application is even allowed to do. Robo-taxis, he notes, are an application no one would have attempted before deep learning unlocked perception.

    Codesign and the million-x decade

    Codesign is the philosophical center of the talk. Huang traces it to the RISC work of John Hennessy at Stanford, where simpler instruction sets won by being co-designed with the compiler rather than maximally optimized in isolation. NVIDIA extends the principle across every layer simultaneously: GPU architecture, CPU architecture, NVLink and NVSwitch fabrics, photonic interconnects, networking silicon, storage paths, CUDA libraries, frameworks and ultimately the model design. The numbers Huang gives are arresting. Moore’s Law in its prime delivered roughly 100x per decade. By the time Dennard scaling broke, real-world gains had compressed to roughly 10x. NVIDIA’s codesigned stack delivered between 100,000x and 1,000,000x over the same ten-year window. That non-linear speed-up is, in Huang’s telling, the precondition for modern AI: it is what allowed researchers to stop curating training sets and just feed the entire internet to the model.

    Education has to fuse first principles with AI tools

    Asked how curriculum should evolve, Huang argues AI must be integrated into the learning process, not just taught about. He recalls Hennessy writing his textbook by hand a chapter a week while Huang was a student, and says pre-recorded textbooks cannot keep up with the rate at which AI generates new knowledge. He describes his own learning workflow: hand the paper to an AI, then have it read the entire surrounding literature, then treat the AI as a dedicated researcher who can be interrogated. At the same time he defends the classics. Mead and Conway are still the foundation. Most modern semiconductor scaling tricks have been exhausted, but knowing where the field came from sharpens judgment when designing what comes next.

    Open source and the five domain pillars

    Huang gives one of the most detailed public accounts of why NVIDIA invests so heavily in open foundation models even while being a top customer of closed labs. He recommends Claude and OpenAI by name for production coding work, and says 100 percent of NVIDIA engineers are now agentically supported. The open-weights case rests on three legs. First, language is the codification of intelligence, and there are at least 230 languages that no commercial lab will ever prioritize. Nemotron is built near frontier and released so any country or community can fine-tune it. Second, the same representation-learning approach has to be replicated in domains where the data is not internet text, so NVIDIA seeded BioNeMo for biology, Alphamayo for autonomy, Groot for humanoid robotics and a climate model for mesoscale multiphysics. The economics of those fields would never produce a foundation model on their own. Third, safety and security require transparency. A black box cannot be defended or audited, and the future of cyber defense is not bigger-model-versus-bigger-model but swarms of cheap fast small models like Nemotron Nano surrounding the threat.

    MFU is the wrong metric, tokens per watt is closer

    A student raises the leaked memo that the xAI Memphis cluster is running at 11 percent Model Flops Utilization. Huang flips the framing. He says he would rather be at low MFU all the time, because that means he over-provisioned flops, memory bandwidth, memory capacity and network capacity. Bottlenecks shift constantly, so over-provisioning across every dimension is what lets the system absorb a spike without getting pinned by Amdahl’s law. In disaggregated inference, where prefill and decode are physically separated and decode is bandwidth-bound rather than flop-bound, NVLink72 can deliver extremely high tokens per watt while reporting very low MFU. Huang argues the right framing is performance, and ultimately tokens per watt as a rough proxy for intelligence per watt, adjusted for the fact that not all tokens are equal. A coding token is worth more than a generic token.

    Hopper, Grace Blackwell NVLink72, Vera Rubin, Feynman

    Huang gives the clearest public framing of NVIDIA’s roadmap as a sequence of architectural answers to evolving compute patterns. Hopper was built for pre-training, at a moment when NVIDIA chose to build multi-billion-dollar machines while the largest scientific supercomputer in the world cost $350 million and the marketplace for such systems was, on paper, zero. Grace Blackwell NVLink72 was the answer to inference and reasoning: a rack-scale computer that ganged 72 GPUs together because decode needs aggregate memory bandwidth far beyond a single chip. The generation-over-generation speed-up was 50x in two years, twenty-five times what Moore’s Law would have delivered. Vera Rubin is being built explicitly for agents. Agents load long-term memory from storage that has to be wired directly into the GPU fabric, they use working memory, they call tools that run on a CPU, and they wait. So the CPU has to be Vera, optimized for low-latency single-threaded code, because the multi-billion-dollar GPU system cannot afford to idle waiting on a slow tool call. Feynman extends the pattern to swarms of agents with sub-agents and sub-sub-agents, a recursive software topology that will demand its own compute pattern.

    Energy demand and the grid

    Huang’s energy projection is one of the most aggressive numbers in the talk. NVIDIA can compound tokens per watt by 50x per generation through codesign, but the total compute demand is heading roughly a thousand times higher, and Huang says he would not be surprised if the real figure is one or two orders of magnitude beyond that. The reason is structural: future computing is generative and continuous, not pre-recorded and on-demand. The good news, he argues, is that this is the best moment in the history of humanity to invest in sustainable generation. Market forces alone are now sufficient to fund solar, nuclear and grid upgrades. Government subsidies are no longer required to make the math work.

    Adversarial countries, export controls and the telecom warning

    This is the segment where Huang is visibly fired up. He attacks the GPUs-as-atomic-bombs framing on its face. NVIDIA GPUs power medical imaging, video games and soy sauce delivery. A billion people use them. He advocates them to his family. The analogy collapses at the first comparison. He attacks the second framing, that American companies should not compete abroad because they will lose anyway, as a self-fulfilling defeat. Competition makes the company better. The third framing, that depriving the rest of the world of general-purpose computing benefits the United States, also fails on first principles: it benefits one or two American companies at the cost of an entire industry. The cautionary parallel is telecommunications. The United States once had a leading position in telecom fundamental technology and policied itself out of it. Huang’s worry, voiced explicitly to a room of CS students, is that they will graduate into a shell of a computer industry if the same path is repeated.

    AI doom and rational optimism

    In the same arc Huang rejects the science-fiction framing of AI as a singularity that arrives suddenly on a Wednesday at 7pm and ends civilization. He calls those claims irresponsible, says they are not true, and points out that the people advancing them are believed by audiences who then make policy on that basis. It is not true that no one understands how these systems work. It is not true that intelligence becomes infinitely powerful instantaneously. It is not true that there is no defense. His framing, which the host echoes as “rational optimism,” is that the goal is to create a future where people care about computers because the technology students are learning is worth mastering.

    Stanford’s compute problem is Stanford’s fault

    A student presses on the scarcity of compute for independent researchers, startups and universities inside the United States. Huang’s answer is sharp: there is no shortage. Place the order and the chips will arrive. The actual broken thing is institutional. University grants are fragmented across departments. No researcher can raise enough on a single grant to fund a billion-dollar shared cluster, and no one shares. He compares it to showing up at the grocery store demanding a billion dollars of tomatoes today. The solution is planning, aggregation and a campus-scale supercomputer, the way Stanford once built the linear accelerator. The endowment is $40 billion. Pulling a billion off it, contracting cloud capacity and giving every student and researcher AI supercomputer access is, in Huang’s view, obviously doable. When he says “it is Stanford’s fault” the host laughs, but Huang clarifies: if it is your fault you have the power to fix it.

    Career, suffering and resilience

    Asked how a CS student should spend the next few years, Huang pushes back on the standard “follow your passion” advice. Most people do not know what they love yet, because no one knows what they do not know. The bar of demanding joy from every working day is too high. Whatever the job is, do it as well as you can. Even as CEO of NVIDIA he says he genuinely loves about 10 percent of his work. The other 90 percent is hard and he suffers through it. He recommends suffering on purpose, because resilience is a muscle that only builds under load, and when the company, the team or the family needs that muscle, it has to already exist. Earlier in his life that meant cleaning toilets and busing tables at Denny’s. He does it today running a multi-trillion-dollar company.

    The biggest mistakes

    Huang separates technical mistakes from strategic mistakes. NVIDIA’s first generation of products was technically wrong in almost every way: curved surfaces instead of triangles, no Z-buffer, forward instead of inverse texture mapping, no floating point inside. The company wasted two and a half years. But the strategic genius of the recovery, the reading of the market, the conservation of resources and the reapplication of talent, is what taught him strategy. The clean strategic mistake he names is mobile. NVIDIA’s Tegra line grew to a billion dollars of revenue and then collapsed to zero when Qualcomm’s modem dominance locked NVIDIA out of the 3G to 4G transition. Huang explicitly refuses the comforting rationalization that the Tegra effort fed the Thor automotive chip (“Thor is the great great great grandson”). The original decision, he says, was a waste of time. The lesson is to think one or two clicks further about whether a market is structurally winnable before committing the company.

    Forecasting under fog of war

    The final substantive exchange is on forecasting. Huang’s method has four steps. Observe what is actually happening (AlexNet crushing two decades of computer vision research in one shot, GPT producing reasoning by token generation). Reason from first principles about why it works. Ask “so what” and “what next” recursively until a mental model of the future emerges. Place the company inside that future and work backwards. Crucially, expect to be partly wrong. Some outcomes will absolutely happen, some will likely happen, some might happen, and the strategy has to be robust across that distribution. The real cost of any strategic choice is the opportunity cost of the alternatives you did not take, so the discipline is to minimize that cost and maximize optionality while letting the journey itself pay for the journey.

    Thoughts

    The most useful thing in this conversation is the explicit architectural mapping of compute patterns to chip generations. Hopper for pre-training. Grace Blackwell NVLink72 for inference, because decode is bandwidth-bound and a single chip cannot supply it. Vera Rubin for agents, because tool calls stall multi-billion-dollar GPU systems and so the CPU has to be optimized for low-latency single-threaded code. Feynman for swarms. That sequence is not marketing. It is a falsifiable thesis about where the bottleneck moves next, and every other infrastructure company should be measuring themselves against it. If Huang is right that swarms of sub-agents are the next dominant pattern, then the design pressure shifts from raw flops to fabric topology, memory hierarchy and storage-to-GPU latency. That has implications for everyone downstream, including the hyperscalers building competing accelerators.

    The MFU section is the most intellectually generous moment in the talk. The instinct in the AI ops community has been to chase MFU as if it were a virtue. Huang argues, persuasively, that low MFU is consistent with high tokens per watt in a disaggregated inference setup, and that bottlenecks rotate fast enough that over-provisioning every resource is the rational design. That reframing matters because it changes what “scarce” means. Compute is not scarce in the way the discourse treats it. What is scarce is a coherent system designed end-to-end. The xAI 11 percent number, in that frame, is not embarrassing. It is the natural reading of a workload that is mostly decode.

    The Stanford segment is the part most likely to be quoted out of context. “It’s Stanford’s fault” is a deliberately provocative line, but the underlying claim is correct and load-bearing. Compute is not gated by NVIDIA refusing to ship chips. It is gated by the fact that fragmented grant funding cannot aggregate into the billion-dollar order that NVIDIA can fulfill. The implication is that universities and national labs need a structural change in how they pool capital for compute, and that the current model of every researcher buying a handful of cards is genuinely obsolete. Huang’s nudge about pulling a billion off the endowment is concrete enough to be acted on, and other major research universities should read this segment as a direct prompt.

    The geopolitical segment is the highest-stakes one. The telecommunications comparison is correct as a historical pattern, and Huang is one of the very few executives in a position to deliver that warning credibly. The unresolved tension is that the argument applies symmetrically. If American AI dominance is built by selling globally, that includes selling into adversarial states, and the policy question is where the line falls. Huang does not answer that question. He attacks the framing that lets the question be answered badly. That is a meaningful contribution to the discourse even if it does not resolve the underlying tradeoff.

    The career advice section is the part the social-media clips will mishandle. “Seek suffering” reads as macho when extracted. In context it is a specific operational claim about how resilience compounds, and it is paired with the Tegra story where Huang himself paid the price of not thinking one more click ahead. That kind of self-implication is rare in CEO talks, and it is the reason the talk is worth listening to in full rather than only reading the recap.

    Watch the full Stanford CS153 Frontier Systems conversation with Jensen Huang here.

  • Andrej Karpathy on AutoResearch, AI Agents, and Why He Stopped Writing Code: Full Breakdown of His 2026 No Priors Interview

    TL;DW

    Andrej Karpathy sat down with Sarah Guo on the No Priors podcast (March 2026) and delivered one of the most information-dense conversations about the current state of AI agents, autonomous research, and the future of software engineering. The core thesis: since December 2025, Karpathy has essentially stopped writing code by hand. He now “expresses his will” to AI agents for 16 hours a day, and he believes we are entering a “loopy era” where autonomous systems can run experiments, train models, and optimize hyperparameters without a human in the loop. His project AutoResearch proved this works by finding improvements to a model he had already hand-tuned over two decades of experience. The conversation also covers the death of bespoke apps, the future of education, open vs. closed source models, robotics, job market impacts, and why Karpathy chose to stay independent from frontier labs.

    Key Takeaways

    1. The December 2025 Shift Was Real and Dramatic

    Karpathy describes a hard flip that happened in December 2025 where he went from writing 80% of his own code to writing essentially none of it. He says the average software engineer’s default workflow has been “completely different” since that month. He calls this state “AI psychosis” and says he feels anxious whenever he is not at the forefront of what is possible with these tools.

    2. AutoResearch: Agents That Do AI Research Autonomously

    AutoResearch is Karpathy’s project where an AI agent is given an objective metric (like validation loss), a codebase, and boundaries for what it can change. It then loops autonomously, running experiments, tweaking hyperparameters, modifying architectures, and committing improvements without any human in the loop. When Karpathy ran it overnight on a model he had already carefully tuned by hand over years, it found optimizations he had missed, including forgotten weight decay on value embeddings and insufficiently tuned Adam betas.

    3. The Name of the Game Is Removing Yourself as the Bottleneck

    Karpathy frames the current era as a shift from optimizing your own productivity to maximizing your “token throughput.” The goal is to arrange tasks so that agents can run autonomously for extended periods. You are no longer the worker. You are the orchestrator, and every minute you spend in the loop is a minute the system is held back.

    4. Mastery Now Means Managing Multiple Agents in Parallel

    The vision of mastery is not writing better code. It is managing teams of agents simultaneously. Karpathy references Peter Steinberg’s workflow of having 10+ Codex agents running in parallel across different repos, each taking about 20 minutes per task. You move in “macro actions” over your codebase, delegating entire features rather than writing individual functions.

    5. Personality and Soul Matter in Coding Agents

    Karpathy praises Claude’s personality, saying it feels like a teammate who gets excited about what you are building. He contrasts this with Codex, which he calls “very dry” and disengaged. He specifically highlights that Claude’s praise feels earned because it does not react equally to half-baked ideas and genuinely good ones. He credits Peter (OpenClaw) with innovating on the “soul” of an agent through careful prompt design, memory systems, and a unified WhatsApp interface.

    6. Apps Are Dead. APIs and Agents Are the Future.

    Karpathy built “Dobby the Elf Claw,” a home automation agent that controls his Sonos, lights, HVAC, shades, pool, spa, and security cameras through natural language over WhatsApp. He did this by having agents scan his local network, reverse-engineer device APIs, and build a unified dashboard. His conclusion: most consumer apps should not exist. Everything should be API endpoints that agents can call on behalf of users. The “customer” of software is increasingly the agent, not the human.

    7. AutoResearch Could Become a Distributed Computing Project

    Karpathy envisions an “AutoResearch at Home” model inspired by SETI@home and Folding@home. Because it is expensive to find code optimizations but cheap to verify them (just run the training and check the metric), untrusted compute nodes on the internet could contribute experimental results. He draws an analogy to blockchain: instead of blocks you have commits, instead of proof of work you have expensive experimentation, and instead of monetary reward you have leaderboard placement. He speculates that a global swarm of agents could potentially outperform frontier labs.

    8. Education Is Being Redirected Through Agents

    Karpathy describes his MicroGPT project, a 200-line distillation of LLM training to its bare essence. He says he started to create a video walkthrough but realized that is no longer the right format. Instead, he now “explains things to agents,” and the agents can then explain them to individual humans in their own language, at their own pace, with infinite patience. He envisions education shifting to “skills” (structured curricula for agents) rather than lectures or guides for humans directly.

    9. The Jaggedness Problem Is Still Real

    Karpathy describes current AI agents as simultaneously feeling like a “brilliant PhD student who has been a systems programmer their entire life” and a 10-year-old. He calls this “jaggedness,” and it stems from reinforcement learning only optimizing for verifiable domains. Models can move mountains on agentic coding tasks but still tell the same bad joke they told four years ago (“Why don’t scientists trust atoms? Because they make everything up.”). Things outside the RL reward loop remain stuck.

    10. Open Source Is Healthy and Necessary, Even If Behind

    Karpathy estimates open source models are now roughly 6 to 8 months behind closed frontier models, down from 18 months and narrowing. He draws a parallel to Linux: the industry has a structural need for a common, open platform. He is “by default very suspicious” of centralization and wants more labs, more voices in the room, and an “ensemble” approach to AI governance. He thinks it is healthy that open source exists slightly behind the frontier, eating through basic use cases while closed models handle “Nobel Prize kind of work.”

    11. Digital Transformation Will Massively Outpace Physical Robotics

    Karpathy predicts a clear ordering: first, a massive wave of “unhobling” in the digital space where everything gets rewired and made 100x more efficient. Then, activity moves to the interface between digital and physical (sensors, cameras, lab equipment). Finally, the physical world itself transforms, but on a much longer timeline because “atoms are a million times harder than bits.” He notes that robotics requires enormous capital expenditure and conviction, and most self-driving startups from 10 years ago did not survive long term.

    12. Why Karpathy Stays Independent From Frontier Labs

    Karpathy gives a nuanced answer about why he is not working at a frontier lab. He says employees at these labs cannot be fully independent voices because of financial incentives and social pressure. He describes this as a fundamental misalignment: the people building the most consequential technology are also the ones who benefit most from it financially. He values being “more aligned with humanity” outside the labs, though he acknowledges his judgment will inevitably drift as he loses visibility into what is happening at the frontier.

    Detailed Summary

    The AI Psychosis and the End of Hand-Written Code

    The conversation opens with Karpathy describing what he calls a state of perpetual “AI psychosis.” Since December 2025, he has not typed a line of code. The shift was not gradual. It was a hard flip from doing 80% of his own coding to doing almost none. He compares the anxiety of unused agent capacity to the old PhD feeling of watching idle GPUs. Except now, the scarce resource is not compute. It is tokens, and you feel the pressure to maximize your token throughput at all times.

    He describes the modern workflow: you have multiple coding agents (Claude Code, Codex, or similar harnesses) running simultaneously across different repositories. Each agent takes about 20 minutes on a well-scoped task. You delegate entire features, review the output, and move on. The job is no longer typing. It is orchestration. And when it does not work, the overwhelming feeling is that it is a “skill issue,” not a capability limitation.

    Karpathy says most people, even his own parents, do not fully grasp how dramatic this shift has been. The default workflow of any software engineer sitting at a desk today is fundamentally different from what it was six months ago.

    AutoResearch: Closing the Loop on AI Research

    The centerpiece of the conversation is AutoResearch, Karpathy’s project for fully autonomous AI research. The setup is deceptively simple: give an agent an objective metric (like validation loss on a language model), a codebase to modify, and boundaries for what it can change. Then let it loop. It generates hypotheses, runs experiments, evaluates results, and commits improvements. No human in the loop.

    Karpathy was surprised it worked as well as it did. He had already hand-tuned his NanoGPT-derived training setup over years using his two decades of experience. When he let AutoResearch run overnight, it found improvements he had missed. The weight decay on value embeddings was forgotten. The Adam optimizer betas were not sufficiently tuned. These are the kinds of things that interact with each other in complex ways that a human researcher might not systematically explore.

    The deeper insight is structural: everything around frontier-level intelligence is about extrapolation and scaling laws. You do massive exploration on smaller models and then extrapolate to larger scales. AutoResearch is perfectly suited for this because the experimentation is expensive but the verification is cheap. Did the validation loss go down? Yes or no.

    Karpathy envisions this scaling beyond a single machine. His “AutoResearch at Home” concept borrows from distributed computing projects like Folding@home. Because verification is cheap but search is expensive, you can accept contributions from untrusted workers across the internet. He draws a blockchain analogy: commits instead of blocks, experimentation as proof of work, leaderboard placement as reward. A global swarm of agents contributing compute could, in theory, rival frontier labs that have massive but centralized resources.

    The Claw Paradigm and the Death of Apps

    Karpathy introduces the concept of the “claw,” a persistent, looping agent that operates in its own sandbox, has sophisticated memory, and works on your behalf even when you are not watching. This goes beyond a single chat session with an AI. A claw has persistence, autonomy, and the ability to interact with external systems.

    His personal example is “Dobby the Elf Claw,” a home automation agent that controls his entire smart home through WhatsApp. The agent scanned his local network, found his Sonos speakers, reverse-engineered the API, and started playing music in three prompts. It did the same for his lights, HVAC, shades, pool, spa, and security cameras (using a Qwen vision model for change detection on camera feeds).

    The broader point is that this renders most consumer apps unnecessary. Why maintain six different smart home apps when a single agent can call all the APIs directly? Karpathy argues the industry needs to reconfigure around the idea that the customer is increasingly the agent, not the human. Everything should be exposed API endpoints. The intelligence layer (the LLM) is the glue that ties it all together.

    He predicts this will become table stakes within a few years. Today it requires vibe coding and direct agent interaction. Soon, even open source models will handle this trivially. The barrier will come down until every person has a claw managing their digital life through natural language.

    Model Jaggedness and the Limits of Reinforcement Learning

    One of the most technically interesting sections covers what Karpathy calls “jaggedness.” Current AI models are simultaneously superhuman at verifiable tasks (coding, math, structured reasoning) and surprisingly mediocre at anything outside the RL reward loop. His go-to example: ask any frontier model to tell you a joke, and you will get the same one from four years ago. “Why don’t scientists trust atoms? Because they make everything up.” The models have improved enormously, but joke quality has not budged because it is not being optimized.

    This jaggedness creates an uncanny valley in interaction. Karpathy describes the experience as talking to someone who is simultaneously a brilliant PhD systems programmer and a 10-year-old. Humans have some variance in ability across domains, but nothing like this. The implication is that the narrative of “general intelligence improving across all domains for free as models get smarter” is not fully accurate. There are blind spots, and they cluster around anything that lacks objective evaluation criteria.

    He and Sarah Guo discuss whether this should lead to model “speciation,” where specialized models are fine-tuned for specific domains rather than one monolithic model trying to be good at everything. Karpathy thinks speciation makes sense in theory (like the diversity of brains in the animal kingdom) but says the science of fine-tuning without losing capabilities is still underdeveloped. The labs are still pursuing monocultures.

    Open Source, Centralization, and Power Balance

    Karpathy, a long-time open source advocate, estimates the gap between closed and open source models has narrowed from 18 months to roughly 6 to 8 months. He draws a direct parallel to Linux: despite closed alternatives like Windows and macOS, the industry structurally needs a common open platform. Linux runs on 60%+ of computers because businesses need a shared foundation they feel safe using.

    The challenge for open source AI is capital expenditure. Training frontier models is astronomically expensive, and that is where the comparison to Linux breaks down somewhat. But Karpathy argues the current dynamic is actually healthy: frontier labs push the bleeding edge with closed models, open source follows 6 to 8 months behind, and that trailing capability is still enormously powerful for the vast majority of use cases.

    He expresses deep skepticism about centralization, citing his Eastern European background and the historical track record of concentrated power. He wants more labs, more independent voices, and an “ensemble” approach to decision-making about AI’s future. He worries about the current trend of further consolidation even among the top labs.

    The Job Market: Digital Unhobling and the Jevons Paradox

    Karpathy recently published an analysis of Bureau of Labor Statistics jobs data, color-coded by which professions primarily manipulate digital information versus physical matter. His thesis: digital professions will be transformed first and fastest because bits are infinitely easier to manipulate than atoms. He calls this “unhobling,” the release of a massive overhang of digital work that humans simply did not have enough thinking cycles to process.

    On whether this means fewer software engineering jobs, Karpathy is cautiously optimistic. He invokes the Jevons Paradox: when something becomes cheaper, demand often increases so much that total consumption goes up. The canonical example is ATMs and bank tellers. ATMs were supposed to replace tellers, but they made bank branches cheaper to operate, leading to more branches and more tellers (at least until 2010). Similarly, if AI makes software dramatically cheaper, the demand for software could explode because it was previously constrained by scarcity and cost.

    He emphasizes that the physical world will lag behind significantly. Robotics requires enormous capital, conviction, and time. Most self-driving startups from a decade ago failed. The interesting opportunities in the near term are at the interface between digital and physical: sensors feeding data to AI systems, actuators executing AI decisions in the real world, and new markets for information (he imagines prediction markets where agents pay for real-time photos from conflict zones).

    Education in the Age of Agents

    Karpathy’s MicroGPT project distills the entire LLM training process into 200 lines of Python. He started making an explanatory video but stopped, realizing the format is obsolete. If the code is already that simple, anyone can ask an agent to explain it in whatever way they need: different languages, different skill levels, infinite patience, multiple approaches. The teacher’s job is no longer to explain. It is to create the thing that is worth explaining, and then let agents handle the last mile of education.

    He envisions a future where education shifts from “guides and lectures for humans” to “skills and curricula for agents.” A skill is a set of instructions that tells an agent how to teach something, what progression to follow, what to emphasize. The human educator becomes a curriculum designer for AI tutors. Documentation shifts from HTML for humans to markdown for agents.

    His punchline: “The things that agents can do, they can probably do better than you, or very soon. The things that agents cannot do is your job now.” For MicroGPT, the 200-line distillation is his unique contribution. Everything else, the explanation, the teaching, the Q&A, is better handled by agents.

    Why Not Return to a Frontier Lab?

    The conversation closes with a nuanced discussion about why Karpathy remains independent. He identifies several tensions. First, financial alignment: employees at frontier labs have enormous financial incentives tied to the success of transformative (and potentially disruptive) technology. This creates a conflict of interest when it comes to honest public discourse. Second, social pressure: even without arm-twisting, there are things you cannot say and things the organization wants you to say. You cannot be a fully free agent. Third, impact: he believes his most impactful contributions may come from an “ecosystem level” role rather than being one of many researchers inside a lab.

    However, he acknowledges a real cost. Being outside frontier labs means his judgment will inevitably drift. These systems are opaque, and understanding how they actually work under the hood requires being inside. He floats the idea of periodic stints at frontier labs, going back and forth between inside and outside roles to maintain both independence and technical grounding.

    Thoughts

    This is one of the most honest and technically grounded conversations about the current state of AI I have heard in 2026. A few things stand out.

    The AutoResearch concept is genuinely important. Not because autonomous hyperparameter tuning is new, but because Karpathy is framing the entire problem correctly: the goal is not to build better tools for researchers. It is to remove researchers from the loop entirely. The fact that an overnight run found optimizations that a world-class researcher missed after years of manual tuning is a powerful data point. And the distributed computing vision (AutoResearch at Home) could be the most consequential idea in the entire conversation if someone builds it well.

    The “death of apps” framing deserves more attention. Karpathy’s Dobby example is not a toy demo. It is a preview of how every consumer software company’s business model gets disrupted. If agents can reverse-engineer APIs and unify disparate systems through natural language, the entire app ecosystem becomes a commodity layer beneath an intelligence layer. The companies that survive will be the ones that embrace API-first design and accept that their “user” is increasingly an LLM.

    The jaggedness observation is underappreciated. The fact that models can autonomously improve training code but cannot tell a new joke should be deeply uncomfortable for anyone claiming we are on a smooth path to AGI. It suggests that current scaling and RL approaches produce narrow excellence, not general intelligence. The joke example is funny, but the underlying point is serious: we are building systems with alien capability profiles that do not match any human intuition about what “smart” means.

    Finally, Karpathy’s decision to stay independent is itself an important signal. When one of the most capable AI researchers in the world says he feels “more aligned with humanity” outside of frontier labs, that should be taken seriously. His point about financial incentives and social pressure creating misalignment is not abstract. It is structural. And his proposed solution of rotating between inside and outside roles is pragmatic and worth consideration for the entire field.