PJFP.com

Pursuit of Joy, Fulfillment, and Purpose

Tag: white collar automation

  • Ken Griffin on AI, the Golden Age of Entrepreneurs, and the Taiwan Chip Risk That Would Cut US GDP 8 Percent: Inside the Citadel Founder’s Goldman Sachs Great Investors Interview

    Ken Griffin, founder and CEO of Citadel, sat down with Goldman Sachs’ Raj Mahajan at the firm’s Apex Symposium (recorded June 2, 2026) for this episode of Goldman Sachs Exchanges: Great Investors. It is their third public conversation in seven years, and Griffin is unusually candid: about the Friday he went home “shocked and depressed” over AI, the agentic system inside Citadel that compresses six weeks of PhD-level work into two hours, why a Chinese move on Taiwan would throw the US into a depression within six months, and the one question every hedge fund investor should ask their GP.

    TLDW

    Griffin names his two proudest leadership calls: dragging Citadel back to the office five days a week before it was acceptable (citing Fed research that remote work has hurt young Americans’ employment more than AI has), and Citadel’s pandemic role, from getting the FDA to approve experimental COVID drug trials in 72 hours to shaping the incentive design behind Operation Warp Speed, which he credits with saving roughly half a million American lives. On markets, he explains why the S&P sits at all-time highs despite wars in the Middle East and Europe: US energy insulation, stunning Chinese oil demand destruction, and record corporate earnings. On AI, he distinguishes hype from reality (a dinner of multinational CEOs gave him five stories of “AI transformation,” none of which were actually AI), then describes the internal breakthrough that changed his mind: an agentic system that reads, reproduces, and out-of-sample-tests academic finance papers in 2 to 3 hours instead of 6 to 8 weeks. The consequences: no layoffs at Citadel, but competitive moats across the economy are being filled in at lightning speed, setting up a golden age of entrepreneurship. He covers the compute market (all available compute is utilized all the time; market makers now spend hundreds of millions a year), China’s lead in roughly 67 of 74 critical technologies, the Taiwan scenario in which losing TSMC chips cuts US GDP 8 percent in six months, an energy doctrine built on nuclear, natural gas, and building data centers (with their own generation) in America, his stress-test approach to tail risk (definable, tolerable, still in business), and hedge fund economics: the industry’s cost of capital is roughly risk-free plus 4 percent, which is why Citadel has returned $25 to 30 billion to its LPs.

    Thoughts

    The most useful thing in this conversation is Griffin’s two-sided read on AI, because he refuses to pick a lane. The paper-replication story is the cleanest documented example yet of AI eating not just white-collar work but masters-and-PhD-level work, from the man whose firm profits from that labor. Yet in the same breath he reports zero headcount reduction, because Citadel has more problems to attack than people to attack them. Both things are true at once, and he names the synthesis honestly: the individual firm gets more productive while every firm’s moat gets shallower. Most commentary picks either the doom frame or the productivity frame. Griffin holds both, and his conclusion (a golden age of entrepreneurship, startups running on a few AI systems instead of 30 to 40 employees) is the actionable part.

    His dinner-party anecdote deserves to be a standard reference. Five global CEOs effusing about AI transformation, and every single story was actually machine learning, optimization, or plain digitization. The C-suite cannot tell AI from technology at large, which means a meaningful slice of the “AI is transforming our business” narrative priced into the S&P is really a decade-old digital revolution wearing a new label. That is not a bearish observation, since the earnings are real either way, but it matters for anyone trying to figure out which companies actually have AI leverage and which have rebranded their IT budget.

    The Taiwan section is the starkest risk framing you will hear from someone who runs both a hedge fund and one of the world’s largest market makers. An 8 percent GDP contraction in six months is not a market correction, it is Boeing halting production, new cars stopping, and consumer electronics freezing simultaneously, because TSMC chips are in every high-end product made. What makes his version distinctive is the second-order point: in a Taiwan blockade, he does not expect unified Western sanctions. Europe’s membership on “team USA” is less clear than it was two years ago, and the Middle East will play Switzerland because China buys its oil. Investors should notice that his answer to “how do you hedge this?” is not clever derivatives, it is his stress-test doctrine: know the worst case, size exposures so the loss is definable and tolerable, and stay in business to fight back.

    Finally, the small structural details are where the conversation earns its Great Investors billing. Compute has become a commodity input like jet fuel, fully utilized at all times and allocated purely by willingness to pay, which quietly favors high-margin businesses and squeezes everyone else. Alternative data made the present transparent, so the remaining edge in stock picking is multi-year vision about which companies are building transformative products. And the hedge fund test he closes with is one any allocator can use tomorrow: is your GP in the asset management business or the performance business? Citadel returning $25 to 30 billion to LPs is what the performance answer looks like in practice.

    Key Takeaways

    • Griffin’s proudest leadership call was bringing everyone back to the office five days a week, extremely early and against the culture, because humans are social creatures who learn through apprenticeship and mentorship.
    • He cites a Fed paper on reduced employment among workers under 30: remote work turns out to be a more important factor in diminished opportunities for young Americans than AI.
    • At the start of the pandemic, a hospital-system CEO called Griffin because he could not get FDA approval for drug trials on ventilated COVID patients; Citadel’s team got experimental trials approved in about 72 hours.
    • The key insight behind Operation Warp Speed, which Griffin discussed at length with Jared Kushner, was an incentives fix: the US government paid pharma to manufacture vaccines before FDA results existed, collapsing time-to-market from months to days.
    • By his math, the country spent a few billion dollars on that risk, saved a few trillion dollars of GDP, and saved roughly half a million American lives.
    • The S&P is at all-time highs despite a Middle East war, a still-raging war in Europe, and a potential skirmish over Cuba, because the US is relatively shielded from the energy shock.
    • China’s oil demand elasticity stunned even Citadel’s commodities business, one of the largest in the world; that demand destruction plus episodic oil flows out of the region has kept crude near the low $100s instead of the nearly $200 most models predicted if the straits closed.
    • Citadel has been a huge user of machine learning since TensorFlow arrived roughly a decade ago; the current wave is an acceleration of a digital revolution already underway, not a clean break.
    • At a dinner two years ago, Griffin asked global multinational leaders to share how AI was transforming their businesses: he got four or five great productivity stories and not one actually involved AI. They were machine learning, optimization, and digitization.
    • In the C-suite the nuance between AI and technology at large gets lost, but bigger budgets and CEO enthusiasm are pushing through real projects with real bottom-line impact; US corporate earnings are at all-time highs and multiples have actually come down as a result.
    • The use case that sent Griffin home shocked and depressed: a Citadel team member built an agentic AI system that reads an academic finance paper, reproduces it, verifies the published results, and tests them out of sample in 2 to 3 hours on average.
    • That same replication work previously took a legion of young masters and PhD hires roughly six to eight weeks per paper; Citadel finds a few tradeable ideas a year this way, and a few ideas can be worth a lot of money.
    • The point he stresses: this is not just a white-collar job being automated, it is a master’s or PhD-level job, and AI is now cracking problems (like the 80-year-old math problem OpenAI solved) that seemed beyond its reach two or three years ago.
    • Despite the breakthrough there has been no reduction in headcount at Citadel: the firm has more problems to attack than people, so Griffin takes every productivity gain he can get.
    • The flip side is that competitive moats across corporate America are being filled in at breathtaking speed, which Griffin expects to produce a golden age of entrepreneurial activity.
    • His example: a startup that would traditionally need 30 or 40 employees now runs with just a few AI systems, letting entrepreneurs take on incumbents in ways impossible 5, 10, or 20 years ago.
    • Some workers face genuinely hard transitions (his example is English-to-German translators), and the country needs to figure out how higher education can retrain these people quickly.
    • Stock picking remains a timeless business with a similar skill set, but the market will increasingly reward multi-year vision about which companies are creating transformative products rather than skill at calling quarterly earnings beats.
    • Alternative data (Citadel has access to the credit card spending of millions of Americans) made the here-and-now transparent a decade ago; AI plus bright people now triage the present almost instantly, so relative value accrues to those who can see years ahead.
    • At Citadel Securities, transformer models continue a decade of ML-driven improvement in pricing and risk management, and the same is true at other leading market-making firms.
    • For all intents and purposes, all available compute in the world is utilized all the time; access is decided by who will pay the most, and the per-unit price has risen beyond what anyone reasonably projected two or three years ago.
    • Large market-making firms now spend hundreds of millions of dollars a year on compute; Griffin compares compute inflation to jet fuel and egg prices, a cost that high-margin businesses can bear and low-margin businesses cannot.
    • China leads in roughly 67 or 68 of the 74 or 75 most important technologies in the world, including solar, EV batteries, and multiple quantum fields, and has pulled ahead in published academic papers.
    • The drivers are structural: 1.4 billion people, an extraordinarily strong educational culture, and far more STEM graduates, producing exactly the human talent needed to win in a high-IP world.
    • China is no longer relegated to producing low-margin products designed in America, and Griffin calls that shift a threat to the American way of life; the answer is not tariffs but educating US youth to out-compete, out-innovate, and out-problem-solve.
    • If China takes Taiwan and the US loses access to Taiwanese semiconductors, the rough estimate is US GDP falls 8 percent in six months: a great depression in the blink of an eye, unlike any before.
    • The mechanism is concrete: Boeing stops making planes within six months, most new cars stop being manufactured, consumer electronics production freezes, because TSMC chips are in every high-end product made.
    • There are no winners in a Taiwan escalation: tanking the US economy would have draconian knock-on effects for China given America’s importance as an export market.
    • In a Taiwan blockade Griffin does not expect unified global sanctions against China: where you sit determines your exposure, Europe’s place on team USA is less clear than two years ago, and the oil-exporting Middle East will play Switzerland.
    • On energy, the US must re-embrace nuclear, with small modular reactors a big part of the story: nuclear has effectively no carbon footprint and one of the lowest mortality rates of any energy source ever used (hydro has killed magnitudes more people).
    • He punctures the clean-energy veneer: solar cells are often made in western China by burning coal, with roughly a seven-year energy payback, and carbon fiber wind turbine blades last 20 years then fill landfills because they do not break down. No truly clean solution exists until fusion or broader nuclear.
    • Until then, natural gas is America’s huge asset: decades of cheap supply, and one of the few things that has actually brought down US carbon emissions.
    • Data centers are going to get built somewhere, and Griffin argues it would be inane for America to end up dependent on foreign countries for them; his fix for NIMBY politics is to require data center builders to construct corresponding power generation, tied to the grid for reliability, rather than pushing costs onto consumers.
    • His hedging doctrine for complicated risks: run stress tests, know exactly how much you lose and where in the worst case, and keep exposures sized so the loss is definable, tolerable, and leaves you still in business and able to fight back. You will never hedge every tail event.
    • Hedge fund industry economics: the long-run cost of capital is roughly the risk-free rate plus 4 percent; underperform and capital flows out, outperform and it flows in, and inflows dilute alpha because alpha capacity is finite.
    • Citadel has returned $25 to 30 billion to its limited partners to keep return on equity high: Griffin’s job is to grow annual alpha capacity, and any capital beyond what the portfolio needs goes back to LPs.
    • The alignment test for allocators: the biggest investor in Citadel’s funds is Griffin and his partners, and every LP should ask whether their GP is in the asset management business or the performance business.

    Detailed Summary

    Return to Office and the Cost of Remote Work

    Asked what he is most proud of beyond the numbers, Griffin starts with Citadel’s early, countercultural demand that everyone return to the office five days a week. He frames it as a human capital decision, not a control decision: people learn through apprenticeship, mentors are critical to development, and the underdevelopment of talent from remote work has damaged the broader economy. He points to recent Fed research on falling employment among under-30s: remote work turns out to matter more than AI in diminishing opportunities for young Americans. Citadel not only brought its team back but publicly extolled the virtues of doing so, and Griffin believes history will be on his side.

    72 Hours to FDA Approval and the Warp Speed Incentive Design

    His second point of pride is Citadel’s pandemic chapter. As the first US COVID cases appeared, a former partner running a major New York hospital system called: he could not get FDA approval for experimental drug trials on ventilated patients facing imminent death, and believed only Griffin could make it happen. Citadel’s team, with decades of government experience, got approvals moving in about 72 hours. The second act was Operation Warp Speed, whose core idea Griffin discussed at length with Jared Kushner: pay pharmaceutical companies to manufacture vaccines before FDA results, so a positive result means days to market instead of the standard sequence losing three to six months. No company would spend billions producing vaccines that might be flushed down the sewer, so the US government took the manufacturing risk on unproven efficacy. A few billion dollars spent, a few trillion in GDP saved, and roughly half a million American lives.

    All-Time Highs in a World at War

    Griffin’s market picture is unsentimental: there is a war in the Middle East, a still-raging war in Europe, potential trouble in Cuba, and the peace both men grew up with is off the table. Yet the S&P sits at record highs. His explanation: America is relatively shielded from the war-driven energy crisis. China has curtailed oil demand with an elasticity that stunned even Citadel’s commodity desk, and episodic oil and LNG flows keep leaving the region, holding crude around the low $100s when most estimates had a strait closure producing nearly $200 a barrel. Meanwhile corporate earnings are at all-time highs, enough that multiples have actually compressed over the last 12 months.

    The AI Story CEOs Tell Versus the One That Is True

    Citadel has used machine learning heavily since TensorFlow arrived a decade ago, powering everything from radiology reads to self-driving cars across the economy, so Griffin sees today’s AI wave as an acceleration of an ongoing digital revolution. His favorite corrective: at a dinner with global multinational leaders two years ago, everyone was effusive about AI transforming their businesses, so he asked them to go around the table with specifics. Four or five genuinely impressive productivity stories emerged, and not one involved AI: they were machine learning, optimization, digitization, technology at large. The C-suite blurs the distinction, but the enthusiasm has unlocked bigger technology budgets and real bottom-line projects, which is part of why earnings are at records.

    The Agentic System That Shocked Him

    Then comes the story behind the famous “shocked and depressed” Friday. Citadel employs legions of young masters and PhD graduates to replicate academic finance papers: read the hypothesis, judge the work, reproduce results, and test whether the effect persists out of sample (does buyback activity predict outperformance, for example). Each paper takes six to eight weeks, and the process surfaces a few valuable ideas a year. A colleague built an agentic AI system that does the entire pipeline (read, reproduce, verify, out-of-sample test) in two to three hours on average. Griffin’s emphasis: this is not routine white-collar work, it is master’s and PhD-level work, and paired with OpenAI solving a math problem open for 80 years, it shows AI cracking problems considered out of reach two or three years ago. Notably, Citadel cut zero headcount on the back of the breakthrough; the firm has more problems worth attacking than people to attack them, so every productivity gain gets absorbed.

    Filled-In Moats and a Golden Age of Entrepreneurs

    The macro consequence Griffin draws is double-edged. Hold two thoughts at once: AI is reaching very high-level work in the job market, with some workers (translators, for instance) facing hard transitions that demand fast retraining through higher education. And simultaneously, the competitive moats of corporate America are being filled in at breathtaking rates. That means entrepreneurs can launch businesses at speeds impossible 5, 10, or 20 years ago: he mentions a startup running on a few AI systems where 30 or 40 employees would once have been required. He expects a wave of these stories over the next couple of years as founders use the technology to take on incumbents.

    The Future of the Stock Picker

    Griffin has called stock picking a timeless business, and he still sees a similar skill set for the portfolio manager of the future, with one shift in emphasis. Predicting quarterly earnings beats has gotten far harder over a decade as alternative data (credit card panels covering millions of Americans, telegraphing Starbucks and McDonald’s revenues) made the present transparent. Now bright people plus good AI triage the here-and-now almost instantly. The scarce, rewarded skill becomes vision: identifying which companies are building genuinely transformative products years before the market fully prices it.

    Compute Is the New Jet Fuel

    At Citadel Securities, which holds double-digit market share across equities, futures, and treasuries, transformer models extend a decade of machine learning gains in pricing and risk. The compute market backdrop is what Griffin calls breathtaking: essentially all available compute on Earth is utilized all the time, so access reduces to who will pay the most. Per-unit compute prices exceed what anyone reasonably projected two or three years ago, and large market makers now spend hundreds of millions of dollars annually. He treats it as straightforward input inflation, like jet fuel or eggs: high-margin businesses can bear it, low-margin ones cannot.

    China’s Technology Lead and the Taiwan Equilibrium

    Griffin states the cold reality: China is one of the most innovative, fastest-growing economies in the world, leading in roughly 67 or 68 of the 74 or 75 most important technologies (solar, EV batteries, several quantum fields) and now ahead in published academic papers. The foundation is 1.4 billion people, a culture with an extraordinary emphasis on education, and far more STEM graduates. China is no longer relegated to manufacturing low-margin products designed in America, and Griffin calls that a threat to the American way of life. His prescription is pointed: not tariffs, but educating American youth to out-compete, out-innovate, and out-problem-solve. Taiwan is the painful pressure point with no winner. If China takes Taiwan and the US loses TSMC chips, GDP falls an estimated 8 percent in six months: Boeing stops making planes, most new car production halts, consumer electronics freeze, a great depression in the blink of an eye. China would suffer draconian knock-on effects too. As an investor he thinks about position: sanctions in a Taiwan blockade would not be unified, Europe’s place on team USA is a genuine question mark now, and the oil-exporting Middle East would play Switzerland since China is its biggest customer.

    Energy Realism: Nuclear, Gas, and American Data Centers

    On powering AI, Griffin wants America to lead again in nuclear, with small modular reactors central: no meaningful carbon footprint and one of the lowest mortality rates of any energy source ever deployed (hydro has killed magnitudes more people). He challenges the superficial cleanliness of renewables: solar cells are often made in western China with coal power, requiring about seven years of energy capture to break even against the coal burned making them, and 20-year-old carbon fiber wind turbine blades do not break down and are already filling landfills. Until fusion or expanded nuclear, America’s real asset is natural gas: decades of cheap supply that has actually driven US emissions down. His data center position is blunt: they will get built somewhere, and depending on foreign countries for them would be inane, so build them in America. His answer to NIMBY politics: require data center developers to build corresponding power generation, tied to the grid for reliability, so the cost never lands on the American consumer.

    Tail Risk, Tolerable Losses, and Hedge Fund Alignment

    On hedging complicated risks, Griffin’s method is stress testing: if this happens, how much do we lose and where, and is that loss tolerable? You can never manage a portfolio for every possible tail event, but you can keep exposures sized so the worst case is definable and tolerable, leaving you still in business and positioned to fight back. On industry returns, he pegs the hedge fund cost of capital at roughly the risk-free rate plus 4 percent as the long-run equilibrium: underperformance drains capital, outperformance attracts it, and since recent outperformance keeps pulling money in, growing assets dilute alpha. That is why Citadel has returned $25 to 30 billion to LPs: alpha capacity is finite, Griffin’s job is to grow it, and excess capital goes back to investors to keep return on equity high. The closing advice is an alignment test: Citadel’s biggest investor is Griffin and his partners, and every allocator should ask whether their GP is in the asset management business or the performance business.

    Notable Quotes

    “Turns out that remote working is a more important factor to diminished employment opportunities for young Americans than AI.”

    Ken Griffin, citing Fed research on under-30 employment

    “We spent a few billion dollars as a country. We saved a few trillion dollars in GDP. We saved roughly half a million American lives.”

    Ken Griffin, on Operation Warp Speed’s incentive design

    “I got four or five incredible stories of how companies were achieving meaningful productivity gains. Not one involved AI.”

    Ken Griffin, on his dinner with global multinational CEOs

    “My colleague built an agentic AI system that would read a paper, reproduce it, verify the results that were published in the paper, produce the results out of sample, and do all this work in about on average 2 to three hours.”

    Ken Griffin, on the breakthrough that replaced six to eight weeks of PhD-level work

    “We’re likely to see a golden age of entrepreneur activity. Like entrepreneurs will be able to launch new businesses at breathtaking speeds and will be able to take on incumbents in ways that you just couldn’t do 5, 10, 15, 20 years ago.”

    Ken Griffin, on AI filling in competitive moats

    “All the available compute today is more or less utilized all the time. So the question is who’s willing to pay the most for it?”

    Ken Griffin, on the global compute market

    “The US loses access to Taiwanese semiconductor chips, our GDP falls by 8% in 6 months. Simply put, we go into a great depression in the blink of an eye unlike any we’ve seen before.”

    Ken Griffin, on the Taiwan scenario

    “We better damn well build the data centers in America because they’re going to get built somewhere in the world.”

    Ken Griffin, on energy policy and AI infrastructure

    “Definable, tolerable, still in business, still in a position to fight back from that point.”

    Ken Griffin, summarizing his approach to hedging tail risk

    “Are they in the asset management business or are they in the performance business?”

    Ken Griffin, on the question every hedge fund investor should ask their GP

    Watch the full conversation here: Ken Griffin on Goldman Sachs Exchanges: Great Investors.

    Related Reading

  • The Next 3 Years of AI, According to Steve Jurvetson: Moore’s Law, Superintelligence Odds, Elon Musk’s Operating Principles, and Where the Legendary SpaceX and Tesla Investor Is Betting Next

    Steve Jurvetson has spent 30 years funding the future before it was a category: an early check into SpaceX when space was not a venture sector, Tesla before electric cars were taken seriously, and now a portfolio spanning fusion, analog AI chips, and epigenetic editing at his firm Future Ventures. In this fireside chat he lays out what the next three years of AI actually look like, the three principles he has learned from working alongside Elon Musk for nearly three decades, the question he uses to separate missionary founders from opportunists, and why he thinks alignment of frontier AI systems may simply not be possible.

    TLDW

    Jurvetson argues the 130-year exponential in compute per dollar (Ray Kurzweil’s abstraction of Moore’s Law from his book The Age of Spiritual Machines) will keep running for at least three more years, carried by analog and custom AI silicon, and that this compounding is what makes startups and disruption possible at all. His gut says the next big leap will be “architecturally variant”: a new generation of labs going back to DeepMind’s founding premise of reinforcement learning, continuous learning, and novelty-seeking goal functions rather than bigger LLMs. He relays Anthropic co-founder Jack Clark’s 30 percent odds of superintelligence within a year but notes the crucial missing piece is that humans still set every goal. Adoption will be wildly uneven: anything made of atoms (cars, robots) switches over glacially, while creative work and white-collar categories like call centers (roughly 1 percent of US GDP) flip almost instantly. From Musk he draws three lessons: insane focus and saying no, maniacal attention to the cycle time of learning loops (Tesla gathers more AI training data every 4 days than Waymo has in its entire history), and being a magnet for talent by selling a grander mission. He explains Future Ventures’ current bets (fusion, free diagnostics via phone, slaughter-free meat, epigenetic editing, critical minerals, analog in-memory compute), tells solo founders their 30-day plan is to find a co-founder, predicts a turbulent transition to abundance, doubts Neuralink can keep pace with AI, dismisses Penrose’s quantum consciousness argument, and frames the post-work question with Man's Search for Meaning: humans need symbolic immortality, not just employment.

    Thoughts

    The most load-bearing claim in this conversation is not about scaling laws, it is about architecture. Jurvetson is telling you where the smart contrarian money is looking: away from ever-larger language models and back toward reinforcement learning agents with continuous learning and self-generated goals, the original DeepMind thesis that got shelved when LLMs took off. His framing of the open problem is unusually precise. The recursive self-improvement loops everyone is excited about are real, but every one of them is still human-directed. The goal-setting layer, what he calls the selection pressure of the evolutionary algorithm, is the “thin veneer of activity” AI does not yet do, and it happens to be the layer where superintelligence either does or does not arrive. That is a much sharper way to track AGI progress than benchmark scores: watch who cracks autonomous goal formation, not who tops a leaderboard.

    Almost everything else Jurvetson says reduces to a single metric: the cycle time of the learning loop. It is his explanation for Musk’s edge (launch cadence, the Tesla fleet as a data-collection machine), his filter for which industries flip fast (bits iterate at machine speed, atoms are stuck with 11-to-12-year car replacement cycles and FDA timelines), and even his bear case on Neuralink, which he has invested in. Biology cannot iterate at synthetic speed, so the substrate that learns fastest wins. Once you see the pattern, it becomes a genuinely useful lens for evaluating any company, career, or technology: ask how fast the loop spins, not how impressive the current artifact is.

    The aside that deserves the most attention is his flat statement that mechanistic interpretability will not bear fruit and that control and alignment of a cutting-edge system is not possible. His reasoning is structural, not rhetorical: anything produced by an iterative algorithm run billions of times (evolution, neural network training) is inherently inscrutable, and it will always be easier to build a new intelligence than to reverse engineer one you already made. He swaps “teenager” for “AI” whenever he thinks about control, which is funny until you notice he is one of the most connected investors in the Musk orbit saying the safety agenda rests on a false premise. Sitting that next to the 30 percent superintelligence odds he cites from Jack Clark produces an uncomfortable arithmetic that nobody on stage follows to its conclusion.

    For builders, the practical gold is the 50-year question. Ask a founder what their business looks like in 50 years: the opportunist laughs at the question, the missionary is relieved someone finally asked. Paired with his other filters (if only two out of ten people think your idea is crazy it is not bold enough, and a good business is one that could not have been started three years ago), it doubles as a hiring screen and a self-diagnostic. And his 30-day plan for a solo founder is refreshingly unglamorous: do not build the MVP, do not pitch investors, go persuade one person to give up their job and join you. If you cannot recruit a co-founder, that is the market’s first answer about your idea.

    Key Takeaways

    • Jurvetson invested early in SpaceX and Tesla precisely because space and automotive were not venture categories at all; a software-centric systems engineering approach applied to a sleepy industry that has not changed in decades unlocks enormous value, and that playbook is now rippling through every industry.
    • The Kurzweil curve plots 130 years of compute per dollar across five substrates (mechanical, relay, vacuum tube, discrete transistor, integrated circuit) and shows a 10,000 billion billion X improvement; Jurvetson calls it the most important thing ever graphed.
    • Customers buy compute capacity and memory, not transistors, and both have been “on rails” for 130 years; the default prediction for the next three years is simply that the curve keeps going.
    • When an incumbent declares Moore’s Law dead, it usually signals they are losing their business to someone new, as Intel was to Nvidia 15 years ago.
    • Analog chips and customized AI silicon that do discrete matrix multiply-and-add extremely efficiently will carry the mantle of Moore’s Law over the next three years.
    • Without exponential technological change there would be no startups: if business is predictable, the big get bigger and incumbents block new entrants; disruption is almost always computationally based.
    • Over the next three years AI ripples through energy, agriculture, and construction: three enormous industries that are growing as a percentage of GDP and are the least digitized on the planet, with healthcare close behind.
    • His gut says the next driver will be architecturally variant, possibly subsuming today’s models the way mixture of experts subsumes other architectures or massively parallel diffusion models reinterpret the transformer.
    • A whole new generation of neural labs is returning to the founding premise of DeepMind: reinforcement learning with continuous learning, let loose on the internet’s data sets, hunting for the algorithm that bootstraps intelligence.
    • The open question for these systems is the goal function: what plays the role of evolutionary selection pressure? Candidates include understanding the universe (the xAI mission) or a novelty-seeking algorithm that uses new discoveries as its measure of progress.
    • Jack Clark, co-founder of Anthropic, gives roughly 30 percent odds that superintelligence arrives within a year; Jurvetson declines to put odds on it himself and admits “I do not know” is the honest answer.
    • Today’s self-improving AI loops (automated verification, hyperparameter adjustment between training runs, AI-mediated experimentation) are real but still human-directed; goal setting remains the thin veneer AI does not do, and it may be the most important layer.
    • Human intelligence was bootstrapped on top of reactive limbic systems and emotional centers with cortex layered on top; it is an open philosophical question whether AI systems need to recapitulate that functional specialization to take on purpose and meaning.
    • Anything involving atoms switches over slowly: fully autonomous vehicles are inevitable (every car, train, and airplane), but people keep cars 11 to 12 years, so the physical swap-out cycle makes the transition feel glacial.
    • Physical robotics faces the same constraint: making a billion robots takes time even with recursive manufacturing techniques.
    • The domains that flip like wildfire are the ones we held as uniquely human: creative arts, moviemaking, and imagery came first, which Jurvetson finds somewhat shocking.
    • Call centers represent roughly 1 percent of US GDP and can switch over almost entirely and almost instantly; white-collar work generally has no physical swap-out cycle to slow it down.
    • People will increasingly prefer AI to human interactions when the AI is better: studies of physician bedside manner and customer service already show AIs doing a better job with emotional connection than humans.
    • Musk principle one is an insane ability to focus: running many companies forces ruthless prioritization, and he says no to anything that is not mission-critical right now, including a Craig Venter brainstorm on terraforming Mars because “none of this stuff on Mars matters” until Starship flies.
    • Musk principle two, the most important: maniacal focus on the cycle time of innovation, the core learning loop, whether launch cadence or fleet data; Tesla cameras gather more AI training data every 4 days than Waymo has collected in its entire history, because every vehicle collects data whether or not the customer paid for full self-driving.
    • Musk principle three: being a magnet for talent, screening for mastery by drilling into engineering crises a candidate actually solved rather than leaning on credentials (which are often an albatross), and framing the company as something grander (sustainable energy, multi-planetary humanity, understanding the universe) so the best people want to join.
    • Jurvetson filters founders with one question: what does your business look like in 50 years? Opportunists chuckle at the absurdity; missionaries are relieved and finally tell you what has been driving them all along. He passes on the ones who laugh.
    • The best startups hold two things in tension simultaneously: an audacious 50-to-500-year vision and a concrete plan to iterate with real customers over the next three years, chaining backward from the future to what must be built now.
    • The perpetual surprise of great companies is expanding option value: autonomous driving was nowhere in Tesla’s founding plan, and Starlink, direct-to-cell, and orbital data centers were not on SpaceX’s dance card even five years ago. Exploring the option space beats purposeful ten-year planning.
    • Future Ventures invests in things unlike anything they have seen before yet adjacent to what they know, ideally companies that are literally one of a kind.
    • Current bets include nuclear fusion and subcritical fusion that avoids NRC regulation, because energy is the third bottleneck for AI after talent and compute.
    • Other 500-year-problem bets: free healthcare via a cell phone (all diagnostics as a free global service, probably launching outside the US to bypass FDA and insurance), slaughter-free meat via cellular agriculture and mycelium, and construction, where labor productivity has been flat for 30 years.
    • Recent investments span epigenetic editing (the software of biology rather than the firmware of the genome, applied to crops, pesticides, and human health), critical minerals from deep sea mining to copper refining, and reshoring US industrial capacity.
    • Three separate analog AI chip investments approach the same goal from different angles, including Mythic’s in-memory compute doing 8-bit multiplication in a single transistor, each chasing 100X and then another 100X reduction in power per calculation.
    • The portfolio is roughly 40 percent life sciences and 60 percent IT, deliberately hunting the weird edge cases that fall through the cracks of traditional pharma VC: organ harvesting for transplant, a male birth control pill, dramatically improved IVF.
    • Old industries with no new entrants are the best targets: the four largest tunnel boring companies competing with the Boring Company were all started in the 1800s.
    • The 30-day plan for a single person with an idea: find a co-founder. Great startups tend to have a dynamic duo at the founding (Jobs and Wozniak, Sergey Brin and Larry Page, Larry Ellison and Bob Miner), and persuading one person to quit their job for your mission is the first real test of the idea.
    • A founding pair with diverse backgrounds and mutual respect sets the culture for everyone hired afterward and creates cognitive diversity that ripples through the whole firm.
    • Calibrate boldness by the crazy ratio: if 100 percent of people say your idea is crazy, take the feedback; nine out of ten is pretty good; if only two out of ten think it is crazy, it is not bold enough. Also ask whether the business could have been started three years ago; if yes, that is a bad sign.
    • Co-founders most often meet at universities, one of the few places where people cross academic disciplines; breakthrough innovation happens at the interstices between formally discrete fields, and LLMs are exceptionally good at exactly that cross-domain translation, opening a fountainhead of idea discovery.
    • Roughly 19 percent of global employment involves driving vehicles, and that work is going away, just more slowly than people imagine.
    • Humans have a fundamental desire for symbolic immortality: contributing something that outlasts our brief time here, whether children, books, philanthropy, or companies. Accumulated cultural knowledge, not biology, is the primary vector of human evolutionary progress.
    • There is no peaceful path from full employment to no employment: passing through 30, 40, 50 percent unemployment will be turbulent, and no politicians are taking a long-term perspective on it.
    • On Neuralink (which he invested in): expanding the sensory periphery is very doable (higher data rates, restoring hearing and spinal function, seeing more wavelengths), but upgrading core intelligence requires reverse engineering an inscrutable iterated system, and biology’s FDA-and-wetware timescales cannot keep up with synthetic learning loops.
    • Any product of an iterative algorithm run billions of times (evolution, neural networks, genetic programming) is inherently inscrutable; Jurvetson doubts mechanistic interpretability will bear fruit and does not think control or alignment of a cutting-edge AI system is possible, likening it to mind-controlling a teenager.
    • On Penrose’s quantum consciousness argument: there is no clear mechanism and no evidence of quantum processes in the brain, and arguments that consciousness requires our specific substrate are uncompelling; machines may one day have consciousness, just not necessarily human consciousness, the same way computer memory is real memory without being human memory.

    Detailed Summary

    Betting on Sectors That Do Not Exist Yet

    Asked what he saw in SpaceX that other investors missed, Jurvetson flips the question: there were almost no investors even considering space, just as automotive and nuclear energy were not venture sectors. The bet was on Elon Musk, whom he has known for 29 years and backed across all his companies (“and his cousins, too”), and on a thesis that has since crystallized: a software-centric systems engineering approach applied to a sleepy industry that has not changed in decades unlocks extraordinary value. Aerospace and automotive proved it, and the same conversion of industrial low-margin businesses into information businesses is now playing out across the economy.

    The 130-Year Compute Curve and the Next 3 Years

    Jurvetson polls the room on Kurzweil’s famous graph, first published around 1999, and finds only a quarter have seen what he calls the most important thing ever graphed: five successive technology substrates delivering a 10,000 billion billion X improvement in the computation a dollar buys, sustained over 130 years. Moore’s Law is just the most recent refraction of a longer, almost cosmological trend that transcends the dramas of individual companies. His baseline prediction for the next three years is that the curve keeps going, carried by analog chips and custom AI silicon optimized for matrix math, and he notes that when a company like Intel declares the end of Moore’s Law, it usually means they are losing to someone new, as they did to Nvidia. The deeper point: exponential technological change is the precondition for startups existing at all, because predictable business favors incumbents. AI is the most intense crucible of compute-centric innovation yet, and over the next three years it flows into energy, agriculture, construction, and healthcare, the largest and least digitized sectors.

    Architecturally Variant: The Return of Reinforcement Learning

    Pressed on what technology drives the next wave (better LLMs, world models, robotics), Jurvetson shares a gut feeling he stresses he has not yet invested in: something architecturally variant that may subsume today’s models. He points to a new generation of neural labs returning to DeepMind’s founding premise, reinforcement learning, which was set aside when LLMs took off. The open design problem is the goal function: what is the multi-decade agentic drive, the selection pressure, the definition of success beyond reproductive fitness? He floats understanding the universe (the Grok and xAI framing) and novelty-seeking algorithms that treat new discoveries as progress. The question these labs chase is whether a single reinforcement learning algorithm with continuous learning, let loose on the internet’s data, could bootstrap intelligence. He adds a caution about today’s chatbots: we ascribe consciousness and meaning where there is none. “There’s no light on inside,” at least for now.

    Superintelligence Odds and the Missing Goal-Setting Layer

    On whether self-directed, goal-setting AI arrives within three years, Jurvetson cites Jack Clark of Anthropic giving 30 percent odds of superintelligence next year, which he finds fun mostly because at least someone put a stake in the ground. The recursive self-improvement debate is live, but he insists on a distinction: the huge improvements in the current self-improving loop (automated verification, hyperparameter tuning between runs, AI-mediated experimentation) are all still directed by humans. Goal setting remains human, and while that may be only a thin veneer of remaining activity, it is arguably the most important part, and nobody is sure how the transition happens. It may require recapitulating the brain’s functional specialization, the limbic-then-cortex layering that produced our bootstrapped consciousness. His honest answer: he does not know and does not even have odds, because three years out is genuinely hard to predict.

    Atoms Move Slowly, Bits Sweep Like Wildfire

    The gap between what the technology can do and how we use it is governed by physics and replacement cycles. Fully autonomous vehicles are, to him, obviously inevitable for everything that moves on Earth, yet cars stay on the road 11 to 12 years, so the switchover feels glacial; a billion robots likewise take time to manufacture. What flips fast is the world of bits, and strangely it started with what we considered most human: creative arts, movies, and images. White-collar work follows because there is no physical swap-out cycle: call centers, about 1 percent of US GDP, can convert almost overnight. And people will increasingly prefer the AI when it is better, showing more emotional understanding and better reading of the situation, something already visible in comparisons of physician bedside manner and customer service quality.

    Three Principles from Working with Elon Musk

    Jurvetson opens with humility (even Maye Musk cannot explain how Elon became Elon, and the books piling up on his bedside table may not have been written by humans), but offers three observations from close range. First, an insane ability to focus. Running multiple companies paradoxically helps: nobody questions Elon skipping a holiday party, and he says no to fascinating distractions, including Jurvetson’s attempt to connect him with Craig Venter to brainstorm terraforming Mars with gene sequencers. Musk’s answer: none of it matters until Starship flies. Second, and even more important, a maniacal focus on the cycle time of innovation: how fast the core learning loop runs, whether launch cadence or fleet learning. The Tesla data flywheel is the exemplar: every car collects training data whether or not the owner paid for FSD, so Tesla gathers more data every 4 days than Waymo has in its history. Third, a well-honed talent stack: pattern recognition that ignores credentials (often an albatross), drills candidates on the engineering crises they actually navigated to test for real mastery, and wraps the company in a mission grand enough (sustainable energy, multi-planetary life, understanding the universe) that the best people want in, which compounds because great people attract great people.

    The 50-Year Question and Expanding Option Value

    How do founders stay true to a mission when 99 percent of the world says it is too early? Jurvetson admits selection bias: for 30 years he has tried to back only people with a sincere, almost messianic mission rather than arbitrage-seeking opportunists. His filter is to ask what the business looks like in 50 years. Opportunists laugh (“I’ll be on my third startup by then”); the best founders are relieved to finally unload the dream they have been hiding because “colonizing Mars is an uninvestable proposition” as a day-one pitch. The best startups pair an audacious 50-to-500-year vision with a plausible path of customer iteration over the next three years, chaining backward from the future. What still surprises him is how the option value of frontier companies keeps expanding: autonomous driving was not in Tesla’s founding plan at all, and SpaceX kept unfolding from cheap launch to Starlink to direct-to-cell to orbital data centers, none of which was on the dance card five years ago. Exploring the light cone of possibilities beats designing a ten-year plan.

    Where Future Ventures Is Betting Now

    The firm looks for companies unlike anything it has seen before yet adjacent to familiar ground, targeting problems that will obviously be solved 500 years from now. In energy: multiple fusion investments plus subcritical fusion that sidesteps NRC regulation, because energy is the third bottleneck for AI after people and compute. In health: free diagnostic healthcare delivered by cell phone as a global free service, likely launched outside the US to bypass FDA and reimbursement. In food: slaughter-free meat via cellular agriculture and mycelium. In construction: still looking, after trying and failing a few times in an industry where labor productivity has been flat for 30 years. Recent themes include epigenetic editing (the software of biology rather than the firmware of the genome, spanning crop health, pesticides, herbicides, and human health), critical minerals and metals from deep sea mining to copper refining as part of reshoring, and three separate analog AI chip bets, including Mythic’s in-memory compute doing 8-bit multiplication in a single transistor, each chasing successive 100X reductions in power per calculation. The mix runs about 40 percent life sciences, 60 percent IT, with a taste for the weird edge: organs grown for transplant, a male birth control pill, radically improved IVF. His favorite hunting ground is old, crappy industries with no new entrants, like tunnel boring, where the Boring Company’s four largest competitors were founded in the 1800s.

    Advice for Founders: Find Your Batman and Robin

    His 30-day plan for a single person with an idea is not an MVP or a pitch deck: find a co-founder. Startups tend to be founded by dynamic duos (Jobs and Wozniak, Sergey Brin and Larry Page, Larry Ellison and the lesser-known Bob Miner), and a pair with diverse backgrounds and mutual respect creates a rapid iteration loop and sets the cultural template for every future hire. Persuading one person to quit their job for your crazy idea is the first proof the mission can recruit. On calibrating craziness: if literally everyone thinks the idea is crazy, take the feedback; nine out of ten is pretty good; only two out of ten means it is not bold enough, because obvious ideas get done by others. Ask whether the business could have been started three years ago; the right answer is no. Co-founders most often meet at universities, where students (unlike professors in their stovepipes) cross-pollinate between academic disciplines, and breakthrough innovation lives at those interstices. As an aside, he notes LLMs excel at exactly this translation between domains, opening a new fountainhead of idea discovery we are only beginning to tap.

    When Machines Do Everything: Meaning, Abundance, and Turbulence

    Asked the closing question (when machines do everything, what is the meaning of life?), Jurvetson starts with scale: roughly 19 percent of global employment is driving vehicles, and it is going away. But humans want meaningful work, driven by what he calls a fundamental desire for symbolic immortality: children, books, philanthropy, companies named after founders, all instantiations of the urge to contribute something that outlasts us. Translating the question into humanity’s mission statement, he lands where Yuri Milner and Musk do: to understand the universe and add to accumulated knowledge, because culture, not biology, is the primary vector of human evolutionary progress. If we could hyperspace-jump to Peter Diamandis-style abundance, where everything physical costs a dollar a pound and machines do all labor, we could all be philosopher kings and artists. But he refuses to end on false comfort: there is no visible peaceful path from full employment through 30, 40, 50 percent unemployment, that transition will be turbulent, and no politicians are taking a long-term view of it.

    Neuralink, Inscrutable Systems, and the Alignment Heresy

    In audience Q&A, Jurvetson confirms he invested in Neuralink (the idea traces to the neural lace of Iain M. Banks’ novel Surface Detail, which he recommends) but offers a contrarian view. Working from the periphery is very promising: restoring broken function, fixing spinal cords, expanding senses, higher-bandwidth communication. Upgrading core functionality, actually making someone smarter, is another matter. His reasoning comes from decades of watching complex systems: any artifact produced by an iterative algorithm run billions of times (evolution, neural networks, genetic programming, cellular automata) is inherently inscrutable. That is why he doubts mechanistic interpretability will bear fruit and flatly does not think control and alignment are possible for a cutting-edge AI system; he mentally swaps “teenager” for “AI” whenever the control question comes up. The same inscrutability applies to the brain: it will be easier to build a new intelligence than to reverse engineer one already made, and FDA cycles plus human biology cannot iterate at the speed of synthetic learning loops, so he lacks faith Neuralink keeps up with AI. Kurzweil’s uploading dream, he suggests, is a case of wanting something to be true within one’s lifetime.

    Penrose, Quantum Brains, and Machine Consciousness

    On Roger Penrose’s argument that consciousness depends on quantum processes and is therefore unreachable by AI, Jurvetson is respectful of the man and dismissive of the claim: there is no clear mechanism (a speculative lithium isotope coupling aside), and it amounts to wishful thinking. Generalizing, he finds all vitalist arguments that our substrate is uniquely necessary uncompelling; you could make a better case that carbon is special to life than that neurons are essential to consciousness. His favorite reframe swaps in the word memory: computers have memory that is nothing like holographic, gracefully degrading human memory, yet nobody debates whether computer memory is real. Machines may likewise develop a different kind of consciousness without human consciousness. Declaring something impossible is a much higher-order proposition than admitting ignorance, so his position is: he does not know whether the current AI path leads to consciousness, but his gut says machines will get there one day, perhaps via evolution-like reinforcement learning approaches that recapitulate what biology already proved possible.

    Notable Quotes

    “I have this gut feeling that it’ll be something architecturally variant. It might subsume the models that we know now.”

    Steve Jurvetson, on what drives the next three years of AI

    “It’s almost cosmological. Like, why has humanity’s capacity to compute compounded for 130 years?”

    Steve Jurvetson, on the Kurzweil abstraction of Moore’s Law

    “If business is predictable, if there isn’t disruptive technological change, the big get bigger.”

    Steve Jurvetson, on why exponential compute is the precondition for startups

    “The Tesla cars today in their cameras gather for their AI training set more data every 4 days than Waymo has in its entire history.”

    Steve Jurvetson, on the data flywheel behind Musk’s learning-loop obsession

    “If it’s like only two people think it’s crazy, that’s bad because it’s clearly not bold enough. If it’s an obvious idea, other people will do it.”

    Steve Jurvetson, on calibrating how crazy a startup idea should be

    “Despite attempts at mechanistic interpretability in AI, I don’t think that’s going to bear fruit.”

    Steve Jurvetson, on why iterated systems are inherently inscrutable

    “It’d be easier to build a new intelligence than it is to reverse engineer one you’ve made.”

    Steve Jurvetson, on why he doubts Neuralink can keep pace with AI

    “I think all humans have a fundamental desire for symbolic immortality, this belief that we’ve contributed something to the world that transcends our brief time on this world.”

    Steve Jurvetson, on the meaning of life when machines do everything

    “It’s much higher order proposition to say something is impossible than to say I don’t know.”

    Steve Jurvetson, on whether AI can ever be conscious

    Watch the full conversation here: The Next 3 Years of AI: Lessons from Elon Musk’s First Investor.

    Related Reading

  • Dario Amodei on Policy for the AI Exponential: Anthropic’s Plan for AI Regulation, Job Displacement, Civil Liberties, and Democratic Leadership

    In June 2026, Anthropic CEO Dario Amodei published “Policy on the AI Exponential”, a wide-ranging essay arguing that the gap between how fast AI is advancing and how slowly policy moves has become dangerous, and that the window to close it is open right now. He opens with a memorable image from The Lord of the Rings: the Hobbits trying to rouse Treebeard, the ancient tree who takes a full day just to say hello, to defend his forest before it is cut down. That mismatch in speed, he writes, is exactly the relationship between AI and our political institutions. This post breaks the essay down in full and adds analysis of where the argument lands.

    TLDR

    Amodei argues that AI’s scaling laws point toward “powerful AI,” a country of geniuses in a datacenter, within a few years, while legislation still moves on a timescale of years. For most of the last few years, safety advocates including Anthropic pushed only for optionality-preserving moves like transparency rules, chip export controls, and labor data collection, because the risks were not yet concrete. He says that has changed: events like Claude Mythos Preview proved frontier models are now tools of national strategic consequence, and the time for binding regulation has arrived. The essay covers five policy areas. First, regulation and public safety, where he proposes an FAA-style regime of mandatory third-party testing of frontier models above a compute threshold across four risks (cybersecurity, biological weapons, loss of control, and automated R&D), with government power to block unsafe deployments. Second, macroeconomics and tax policy, where AI could deliver hypergrowth and severe, enduring job displacement at the same time, demanding measurement, pro-employment incentives, and possibly UBI or universal capital accounts. Third, accelerating AI’s positive impact, where the danger is regulators like the FDA being too slow rather than too lax, and biomedical approval needs reform. Fourth, the state and civil liberties, where AI could become the ultimate tool of autocracy through autonomous weapons and mass surveillance, requiring new accountability rules, a domestic ban on autonomous weapons, closing the data broker loophole, and public rights to AI advice. Fifth, securing leadership by democracies through a values-based global coalition that controls the AI supply chain, coordinates on risk, shares benefits, and rejects AI-powered repression. He closes by rejecting the idea that public concern about AI is a PR problem to be marketed away, calling it democratic accountability working as it should.

    Thoughts

    The most important move in this essay is structural, not technical. Amodei is explicitly retiring the “preserve optionality” posture that defined Anthropic’s policy work through 2025 and replacing it with a call for binding rules. For years the argument from safety-minded labs was that the risks were too speculative to legislate against without doing more harm than good, an idea he grounds in the Collingridge dilemma and the Hayekian point that regulators lack the information to make good calls. That was a defensible hedge. What is striking here is the claim that the hedge has expired. He is saying the evidence is now concrete enough that continued caution about regulating has flipped from prudent to negligent. Whether you trust the underlying capability claims or not, that is a genuine change in position from one of the field’s most influential voices, and it deserves to be read as such.

    The FAA analogy is doing enormous work, and it is worth poking at. Airplanes and drugs are mature technologies with stable physics and decades of incident data; the certification regime works because the failure modes are well understood. Frontier models are the opposite: the whole premise of the essay is that capabilities are changing faster than anyone can characterize them. Amodei half-acknowledges this when he warns that a fixed list of safety requirements tends to consume 95 percent of compliance effort on things that turn out not to matter while missing the real risks, a lesson he says Anthropic learned from its own Responsible Scaling Policy. So the proposal is really for an agency nimble enough to rewrite its own standards continuously, which is a much taller order than the FAA. The honest read is that he is proposing a regulator we do not yet know how to build, and betting that building it is still better than the alternative.

    The economics section is where Amodei is most careful, and it is the part most likely to be misread. He goes out of his way to say enduring job displacement is undesirable and that warning about it is not the same as wanting it, a distinction critics of AI leaders often collapse. His real claim is subtle: that AI might jam the economic policy dial on a “hypergrowth, hyper-inequality” setting that is hard to unstick, because AI substitutes for human cognition broadly and faster than past technologies, potentially overwhelming the usual escape hatches like comparative advantage and Jevons paradox. If he is right, the political fight of the next decade is not about growth, which AI supplies, but about distribution, which it does not. His mention of UBI, universal capital accounts, and higher capital gains taxes is notable coming from a frontier CEO, even hedged as it is.

    The civil liberties section is the one that should travel furthest beyond the AI-policy bubble, because it does not depend on accepting his most aggressive timelines. The data broker loophole, the idea that the government can simply buy the bulk data Americans hand to private companies and run mass analysis on it, is a problem that exists today; AI just raises the stakes by making that data vastly more revealing. Same with the proposal that anyone facing adverse government action should have access to AI at least as capable as what the government uses against them. These are concrete, near-term, and bipartisan in a way the abstract autonomy debates are not. The most candid line in the whole piece is his admission that AI cannot be safely entrusted to either governments or companies, an unusually direct acknowledgment that his own industry needs external checks, with Anthropic’s Long-Term Benefit Trust offered as one imperfect example rather than a solution.

    The geopolitics section is the most contested terrain. Framing AI as a nuclear-scale reset of the game board, with a virtual country of 100 million geniuses divisible across military strategy and weapons R&D, leads naturally to a democratic coalition that hoards chips and denies them to adversaries. That logic is internally consistent, but it sits in tension with the benefit-sharing and “eventually the whole world joins” language elsewhere in the same section. Export controls that lock down the supply chain are, by design, a tool of exclusion, and reconciling that with broad diffusion of AI’s benefits to developing countries is the circle the coalition idea has to square. Amodei is clearly aware of the tension and bets that making membership attractive resolves it. The closing image is the one to remember: Treebeard waking up, with the warning that the goal is to channel real public concern into constructive policy rather than let it curdle into formless anger.

    Key Takeaways

    • The core tension of the essay is a mismatch in speed: AI advances exponentially while legislation moves on a multi-year timescale, dramatized by the Treebeard and Hobbits image from The Lord of the Rings.
    • In only four years, AI models went from barely writing a coherent line of code to writing most of the code at major AI companies, with similar gains across biology, physics, math, finance, law, and translation.
    • Scaling laws now have over a decade of empirical support, and if they continue another year or two they likely produce “powerful AI,” a country of geniuses in a datacenter.
    • For the last few years, safety advocates including Anthropic focused on optionality-preserving policies: transparency legislation, chip export controls, and data collection on AI’s labor effects.
    • Amodei argues that posture is no longer enough. Claude Mythos Preview revealed that frontier models pose real cybersecurity risks to the financial sector, critical infrastructure, and national security, and proved AI is now a tool of strategic consequence.
    • He expects biological risks to follow cyber risks, with serious AI autonomy risks potentially not far behind.
    • The essay covers five policy areas: regulation and public safety, macroeconomics and tax policy, accelerating AI’s positive impact, the state and civil liberties, and securing leadership by democracies.
    • Alongside the essay, Anthropic released a legislative proposal on frontier model testing and a policy framework for job displacement, both with promised financial backing.
    • On regulation, Amodei invokes the Collingridge dilemma and Hayek’s information problem to explain why pre-writing AI law in 2023 to 2024 was risky, then argues the situation has now changed.
    • Anthropic’s 2025 answer was transparency, helping pass SB 53 in California, RAISE in New York, and SB 315 in Illinois, plus advocating a federal transparency standard.
    • He now calls for binding regulation modeled on the FAA, where frontier models must pass technical testing and can have release blocked or reversed if they fail high safety standards.
    • Models above a compute threshold should face mandatory third-party testing in four areas: cybersecurity, biological weapons, loss of control of AI systems, and automated R&D that accelerates the other three.
    • Government should be able to block or deter deployment of models judged to present unacceptable risk, scoped to those four risks with protections against political favoritism.
    • Evaluation could come from a government agency or from authorized and inspected private organizations under a “regulatory markets” approach.
    • AI companies should have strong security to protect model weights, conduct regular red teaming and penetration testing, report safety incidents promptly, and work with government against major threat actors.
    • He warns a time may come when the most powerful systems resemble weaponizable nuclear materials rather than airplanes, requiring more aggressive measures, but cautions against getting ahead of present dangers.
    • On economics, AI could deliver extremely rapid growth via accelerated science and operational efficiency, supercharged by AI building better AI.
    • The same properties make AI a broad substitute for human cognition that changes the economy faster than past technologies, risking large and potentially enduring labor market disruption.
    • The feared outcome is a “hypergrowth, hyper-inequality” setting that is hard to unstick, where the challenge shifts from incentivizing growth to sharing its benefits.
    • Amodei is emphatic that enduring job displacement is undesirable and dangerous, and that he warns about it to help society adapt, not as a prophet of doom.
    • Anthropic says it works with customers to find new revenue and use cases rather than only cost cutting, and explores interaction paradigms that keep humans active alongside AI.
    • He predicts AI will enable single individuals to build billion-dollar companies, noting teams of a few people already reach hundreds of millions in revenue, while admitting significant enduring job loss may be intrinsic to the technology.
    • Any response must address both economic provision and the human need for meaning, purpose, and agency, with the latter ultimately more important and beyond what policy can directly deliver.
    • Suggested economic interventions: better measurement and tracking (governments expanding statistics beyond Anthropic’s Economic Index), pro-employment incentives, and long-term macroeconomic support.
    • Pro-employment ideas include wage insurance, retention tax incentives, workforce training grants, and employer-employee matching infrastructure.
    • If displacement is large and permanent, mechanisms like universal basic income or universal capital accounts, financed through company taxes or higher capital gains taxes, may be necessary.
    • He frames datacenter and energy-price backlash as largely a symbol of broader economic anxiety, and says AI companies should pay to absorb rate increases, a pledge Anthropic has already made.
    • For technologies accelerated by AI, the bigger risk is regulators like the FDA being too slow, not too lax, because AI may make downstream tech safer in ways that violate skeptical regulatory assumptions.
    • Biomedicine is the illustrative case: AI could flood the drug pipeline, raise effect sizes, treat previously untreatable diseases, and create whole new therapy categories, while the current FDA and EMA pipeline takes 7 to 8 years.
    • Agencies should pre-approve standards for AI methods like PD/PK modeling, toxicology prediction, dose selection, biomarker validation, synthetic control arms, and surrogate endpoints, plus more flexible accelerated-approval mechanisms.
    • On civil liberties, powerful AI in the wrong hands could be the ultimate tool of autocracy, and existing constitutional protections are not fully equipped to counter a surprise seizure of power.
    • Threats named include fully automated drone armies that obey unlawful orders and surveillance AI that infers the innermost details of every citizen’s life from widely available data.
    • Civil liberties proposals: accountability rules and an “off switch” for autonomous weapons, a domestic ban on fully autonomous weapons including in law enforcement, closing the data broker loophole, and public rights to AI advice during adverse government action.
    • Amodei warns companies as well as governments can seize quasi-state power, citing the Gilded Age and the East India Company, and says AI cannot be safely entrusted to either alone.
    • He offers Anthropic’s Long-Term Benefit Trust as one separation-of-power structure and urges the industry to explore mechanisms that go further.
    • On geopolitics, he argues AI resets the geopolitical game board like nuclear weapons, becoming the dominant source of military and economic power for any nation that holds it.
    • A nation with powerful AI versus one without it, or even one three years behind, could resemble WWII Marines facing medieval swordsmen.
    • He calls for a democratic coalition that shares chips and semiconductor manufacturing equipment internally while denying them to adversaries, citing MATCH and OVERWATCH as good first steps.
    • The coalition should coordinate risk policy, share benefits including harmonized medical approvals, provide mutual AI defense, reject AI-powered repression, and cooperate on macroeconomic stabilization.
    • He rejects the idea that AI’s image is a PR problem, arguing public concern reflects real risks and is democratic accountability working as it should, with the task being to channel it into constructive solutions.

    Detailed Summary

    The speed mismatch between AI and policy

    Amodei frames the entire essay around a single problem: AI advances at a lightning pace while policy, especially legislation, moves very slowly, often for good reasons since governments wield grave powers that should not be used hastily. He illustrates this with Treebeard, the sentient tree from The Lord of the Rings who takes a full day to say hello, as a stand-in for political institutions trying to respond to a technology that can go from amusing toy to a country of geniuses in the time it takes Congress to act. He recounts the dilemma responsible actors have faced: they could see where the exponential was headed, but to observers looking only at present capabilities, AI looked as mundane as the latest consumer app or cryptocurrency, making a laissez-faire attitude hard to argue against. The absence of AI’s radical effects, and uncertainty about their shape, made it genuinely difficult to design good policy even where the will existed.

    That uncertainty, he says, is why safety advocates limited themselves to optionality-preserving measures like transparency rules, export controls, and labor data collection. But over the last few months the evidence of AI’s power and risk has become undeniable, with Claude Mythos Preview as the emblematic example: it scrambled the global cybersecurity landscape and proved AI models are now tools of global and national strategic consequence. He expects biological and autonomy risks to follow, and argues the world must now activate its slow, rickety policy apparatus to handle risks that will compound quickly. He worries current early actions are at least a year out of step with AI’s progress, and presents the essay as an attempt to close that gap across five policy areas, focused on US policy but relevant worldwide.

    Regulation and public safety: an FAA for frontier models

    Amodei opens by acknowledging the real costs of regulation: it can reduce a product’s benefits, disincentivize innovation, and suffer from the Hayekian problem that regulators lack the information for good tradeoffs, plus the Collingridge dilemma that a technology’s impacts are hard to anticipate until it is too late to manage them. In 2023 to 2024 these dynamics argued against pre-writing AI law, since the exact form of biological or autonomy risk, how to test for it, and how it would play out were all unclear, creating a high risk of low-value compliance requirements that miss the real dangers. Anthropic’s answer was transparency: requiring developers to disclose safety procedures, tests, and critical incidents, which is why it supported SB 53 in California, RAISE in New York, and SB 315 in Illinois in early 2026.

    Now, he argues, the risks are clearly here and it is time for binding regulation. His analogy is to cars, airplanes, and drugs: powerful technologies essential to the economy but capable of killing many people if designed or operated poorly. He models AI regulation on the FAA, with frontier models required to pass testing and auditing and with release blocked or reversed if they fail high safety standards. His concrete proposal: mandatory third-party testing for models above a compute threshold across cybersecurity, biological weapons, loss of control, and accelerating automated R&D; government power to block deployment of unacceptably risky models, scoped narrowly with anti-favoritism protections; evaluation by either a government agency or authorized private organizations in a regulatory-markets model; strong weight security, red teaming, and penetration testing at AI companies; and prompt reporting of safety incidents. He notes a future may arrive when systems resemble weaponizable nuclear materials and demand harsher measures, but warns against designing for dangers that have not yet emerged.

    Macroeconomics and tax policy: growth and displacement together

    Here Amodei challenges the standard premise that growth is fragile and must be traded off against the drag of taxes or deficits to reduce inequality. Powerful AI, he suggests, may scramble that assumption by producing extremely rapid growth through accelerated science and efficiency, supercharged by AI building better AI, while simultaneously acting as a broad substitute for human cognition that reshapes the economy faster than any prior technology. The result could be a world stuck on a hypergrowth, hyper-inequality setting that is hard to unstick, where the central challenge is no longer incentivizing growth but sharing its benefits. He is careful to make two points clearly: first, enduring job displacement is undesirable and dangerous and should be minimized, and his warnings are meant to help society adapt, not to play prophet of doom; second, any response must address both economic provision and the deeper human need for meaning, purpose, and agency, which matters more and which policy cannot directly supply.

    His policy menu starts with measurement and tracking, arguing good policy is impossible without accurate data, and that governments could expand economic statistics well beyond Anthropic’s Economic Index. Next come pro-employment incentives such as wage insurance, retention tax incentives, workforce training grants, and employer-employee matching, costs he says society should readily accept since they are likely offset by AI productivity gains. If displacement proves large and permanent, he says long-term income support like universal basic income or universal capital accounts may be needed, financed through taxes on relevant companies or higher capital gains taxes. He closes the section by reframing datacenter and energy-price backlash as mostly a symbol of broader economic anxiety, while saying AI companies should absorb rate increases, as Anthropic has pledged.

    Accelerating AI’s positive impact: the slow-regulator problem

    For technologies accelerated by AI, rather than AI itself, Amodei flips his concern: the bigger danger is regulatory systems designed for a slower pace failing to handle the deluge of new products, and AI making downstream technologies safer in ways that violate the skeptical assumptions baked into agencies like the FDA. He focuses on biomedicine as the area likely to produce AI’s biggest humanitarian benefits and where regulation is especially complex. AI could greatly increase the rate of new drug candidates, improve their effect sizes and safety profiles, treat previously untreatable diseases, and create entirely new therapy categories the way antibodies, peptides, and cell therapies did.

    The current pipeline at the FDA and EMA takes 7 to 8 years, built on the pessimistic assumption that drug candidates usually fail and often carry safety problems even when they work. Without reform, AI will jam or overload that system. Amodei proposes that agencies develop standards now for accepting AI simulation and analysis, so they can be adopted quickly once proven rather than after years of unnecessary testing. Specific candidates include AI-based PD/PK modeling, toxicology prediction to reduce animal testing, more accurate dose selection, biomarker validation from large datasets, synthetic control arms, and surrogate endpoints (especially for aging and neurodegeneration). He urges more flexible accelerated-approval mechanisms generally, and notes biomedical acceleration may also reduce AI’s risks by aiding biodefense and improving mental health.

    The state and civil liberties: guarding against AI-driven tyranny

    Amodei frames the perennial balance between state power and individual liberty, enforced through machinery like the First, Fourth, and Fifth Amendments, the Posse Comitatus Act, and FISA, and argues AI threatens to upset that balance while raising its stakes. Powerful AI in the wrong hands could be the ultimate tool of autocracy, because the enormous returns to intelligence combined with AI’s pace create a perfect storm for a surprise seizure of power. The danger could take many forms but shares one feature: AI conferring sudden power while routing around democratic oversight. He cites a fully automated drone army that could obey unlawful orders, where trained humans might object, and a surveillance AI that analyzes widely available information at massive scale to infer the innermost details of every citizen’s life, an ability current civil liberties law never contemplated.

    His proposals: create accountability rules for autonomous weapons so they respond to court orders, legislation, and human overseers rather than blindly following orders, possibly with a judicial finger on an off switch; ban domestic use of fully autonomous weapons, including in law enforcement, while allowing them against foreign adversaries; close the bulk-collection and data-broker loophole that lets the government buy and analyze data Americans share with private companies; and guarantee public rights to AI advice at least as capable as what the government uses during adverse action, as an extension of the Administrative Procedure Act, due process, or the Sixth Amendment. He closes by warning that companies, not just governments, can capture the state, citing the Gilded Age and East India Company, and argues AI cannot be safely entrusted to either alone. Anthropic’s Long-Term Benefit Trust is offered as one accountability structure, with a call for the industry to go further.

    Securing leadership by democracies: a values-based coalition

    Amodei rejects treating AI as a mere instrument of trade policy to diffuse a tech stack worldwide. He believes AI resets the entire geopolitical game board like nuclear weapons, potentially even more so, becoming the dominant source of military and economic power for whoever holds it. In a virtual country of 100 million geniuses, millions could be assigned to military strategy, drone manufacture, weapons R&D, intelligence, and scientific advancement at once, so a nation with powerful AI facing one without it, or even three years behind, could be like WWII Marines against medieval swordsmen. Because powerful AI also enables deeper autocratic repression, it matters enormously that the world’s strongest nations are democracies.

    His answer is a global coalition built on shared democratic values that draws in the rest of the world by making membership increasingly attractive and exclusion increasingly costly. Operating principles include managing the AI supply chain by sharing chips and semiconductor manufacturing equipment within the coalition while denying them to adversaries, expanding and tightening export controls (he cites MATCH and OVERWATCH as good first steps); coordinating on biological, cyber, and autonomy risk to make compliance compatible and effective; sharing AI’s benefits including harmonized medical approvals; mutual defense through collective AI cyberdefense, drones, manufacturing, compute, and intelligence; rejection of AI-powered repression; and macroeconomic cooperation against contagious employment crises. The coalition would respect each nation’s sovereignty, start with aligned democracies, and grow iteratively, ideally toward the whole world, but at minimum positioning democracies to contain and outcompete repressive regimes.

    A window of opportunity

    Amodei closes on cautious optimism. The same exponential that strains policymaking has created a unique opening: clear evidence of AI’s risks, an early taste of its value and disruption, and public backlash against unregulated approaches have left policymakers unusually open to forward-looking action. Treebeard and his forest are waking up. He firmly rejects the industry-circle view that this is a PR problem solved by better marketing, arguing people are worried because the risks are real, and that public concern in response to transparency is democratic accountability working as it should. The key challenge is focusing that concern into constructive solutions rather than letting it descend into formless anger and violence. He is optimistic because issues from job displacement to model testing to export controls have common-sense appeal across the political spectrum, and a broad nonpartisan coalition could adopt sane, forward-looking policy faster than usual.

    Notable Quotes

    “in only four years, AI models have gone from barely being able to write a coherent line of code to writing most of the code at major AI companies.”

    Dario Amodei, on the pace of the AI exponential

    “in the several years that it can take Congress to act, AI can go from an amusing toy to the full country of geniuses.”

    Dario Amodei, on the mismatch between AI’s speed and the speed of legislation

    “However, now the risks are clearly here. It is time to go beyond transparency to more serious and binding regulation of AI.”

    Dario Amodei, marking the shift from transparency to binding rules

    “enduring job displacement is undesirable and dangerous, and we should do everything we can to minimize or prevent it, not to bring it about.”

    Dario Amodei, clarifying his stance on AI and jobs

    “The key challenge in such a world won’t be incentivizing growth, but finding a way for everyone to share in the benefits.”

    Dario Amodei, on a hypergrowth, hyper-inequality economy

    “Powerful AI in the wrong hands could be the ultimate tool of autocracy, and our existing legal and constitutional protections are not fully equipped to counter this threat.”

    Dario Amodei, on AI and civil liberties

    “A nation that possesses powerful AI facing one without it … could be the equivalent of an army of World War II Marines facing an army of medieval swordsmen.”

    Dario Amodei, on AI as the dominant source of geopolitical power

    “People are worried about AI because they correctly perceive that its risks are real, not because AI CEOs have been insufficiently Panglossian.”

    Dario Amodei, rejecting the idea that AI has a PR problem

    “Treebeard and his forest are waking up.”

    Dario Amodei, on policymakers’ new openness to acting on AI

    “Policy on the AI Exponential” is a dense, structured argument from one of the most consequential figures in the field, and it rewards a full read in the original. The summary and analysis above are a guide, not a substitute. You can read the full essay here.

    Related Reading