PJFP.com

Pursuit of Joy, Fulfillment, and Purpose

Tag: SB 53

  • Can the AI Industry Regulate Itself? All-In on Demis Hassabis’s SRO Proposal, Stripe’s PayPal Bid, Apple vs OpenAI, and New York’s Data Center Ban

    The besties open on the biggest live question in artificial intelligence policy: can the AI industry regulate itself before the government does it for them? Jason Calacanis, Chamath Palihapitiya, David Sacks, and David Friedberg dig into DeepMind co-founder Demis Hassabis’s proposal for a FINRA-style self-regulatory organization for frontier models, then work through a packed docket that runs from Stripe’s audacious bid for PayPal to Apple’s trade-secrets lawsuit against OpenAI, the xAI Grok Build data leak, the economics of token spend, New York’s first-in-the-nation data center moratorium, foreign influence campaigns shaping American attitudes toward AI, and a science corner on an enzyme that reverses skin aging. You can watch the full episode here.

    TLDW

    Demis Hassabis proposed a US-led international AI standards body modeled on FINRA: federally overseen, industry funded, run by independent technical experts, with frontier labs submitting models 30 days before release, voluntary at first and mandatory later. The proposal drew broad endorsement across the industry, and the besties debate whether an SRO beats the alternatives. Sacks says he could get on board only under five strict conditions (broad representation including startups and open source, frontier-only review, catastrophic-risk-only scope, voluntary-first, and substitution for rather than addition to new agencies), and warns the plan is an opening bid that Anthropic will use as a stepping stone toward Dario Amodei’s “FAA for AI.” The show then turns to Stripe, Block, and Advent bidding roughly $53 billion for PayPal and what it means for Visa and Mastercard, a wave of AI-native operators reviving stale digital businesses (Bending Spoons, Ryan Cohen), Apple’s lawsuit accusing OpenAI of stealing trade secrets, xAI’s Grok Build silently uploading entire codebases despite a privacy setting, the enormous spread in token costs and Ramp’s new spend controls, Apple’s local-model opportunity with M7 Ultra silicon, America’s looming energy deficit and behind-the-meter power, New York’s hyperscale data center moratorium, alleged Russian and PRC influence operations shaping anti-GMO and anti-data-center sentiment, and a science corner on a Calico enzyme that degrades glycation products to reverse skin aging.

    Thoughts

    The most important idea in this episode is not the SRO itself but Sacks’s framing of it as an opening bid. His five conditions are a genuinely useful blueprint for how self-regulation could work without curdling into regulatory capture, and his instinct that catastrophic-risk-only scope (cyber and CBRN, not disinformation or “microaggressions”) is the only defensible mandate is the right line to draw. But the deeper point is structural: when an industry walks into government and says “please regulate me,” almost no one in government answers “we’re not qualified.” They say thank you and come back for more. That asymmetry, not any specific rule, is what makes voluntary concessions dangerous. If the SRO is offered for free rather than traded for hard federal preemption written into law, it becomes the floor of a ratchet, not the ceiling of a compromise.

    The Anthropic critique running through the segment deserves to be taken on its merits rather than dismissed as a grudge. The claim is specific and falsifiable: that a company now valued in the trillions is funding a state-by-state strategy of one-upmanship, where each new bill is tougher than the last, deliberately producing a patchwork rather than the single national framework everyone claims to want. Whether or not you accept the motive, the mechanism is real and the incentives are legible. If your cost per million tokens is fifty to a hundred times your competitor’s, and cheaper open models plus fine-tuning can cover the vast majority of tasks, then the fastest way to protect a premium price is to make the cheap alternatives legally or practically harder to ship. That is the ladder-pulling thesis, and the token-cost numbers cited on the show are the reason it is not paranoid.

    The PayPal bid is the clearest signal of a new operating logic in the capital markets. The interesting question Chamath poses is not “what synergies does PayPal have” but “what is the only thing Advent, Stripe, and Block could build together,” and the answer is a genuine competitor to Visa and Mastercard: hundreds of millions of consumer accounts, Stripe’s merchant relationships and risk infrastructure, Block’s point-of-sale and Cash App, and stablecoin rails from Bridge and PYUSD that can push transactions on-us and bypass the card networks. The antitrust twist is elegant. Define the market as merchant APIs and it looks like consolidation; define it as the card duopoly and the same deal is pro-competitive. This deal would have been dead on arrival two years ago, and the fact that it is live now tells you as much about the regulatory climate as it does about payments.

    Underneath the payments story is a broader thesis worth naming: AI-native operators buying mature, founder-less, “stale” digital businesses and modernizing them. Bending Spoons rolling up AOL, Vimeo, Evernote, WeTransfer, and Eventbrite is the template, and Ryan Cohen’s eBay interest is the second dot on the line. The claim is that a modern operator can diagnose where a legacy business overspends, underinvests, and fails to use AI, then fix it with a small team of AI-first executives rather than a McKinsey engagement. It is a persuasive pattern, though PayPal is a harder case than the show admits: a 25-year-old interaction model growing 7% a year is not obviously revived by efficiency alone. Buying 400 million consumer accounts is buying distribution, not a product vision, and the open question is whether anyone can resuscitate the consumer experience rather than just milk it.

    The data center segment is where policy, energy, and information warfare collide, and Friedberg’s anti-GMO analogy is the sharpest thing in it. His argument is that manufactured public sentiment, traceable in one case to a foreign media push, can override the scientific and economic merits of a technology for years, and that the anti-data-center movement rhymes with it: closed-loop cooling that uses trivial amounts of water, land-use efficiency that dwarfs almonds and golf courses, and natural gas that burns clean, all drowned out by a moral panic. Whether or not you buy the specific foreign-influence attribution, the underlying tension is real and unresolved. America is staring at a structural electricity deficit while individual blue states treat data centers as a luxury they can refuse, and behind-the-meter power plus edge compute chasing cheap electrons is emerging as the workaround. The moratorium framing matters most here: a “pause” on data centers is not a few months, it is five years once you count ramp-up, and that is long enough to lose a race that may only be measured in months of lead.

    Key Takeaways

    • Demis Hassabis proposed a US-led international AI standards body modeled on FINRA: federally overseen, industry funded, and run by independent technical experts rather than a new government agency.
    • Under the proposal, frontier labs would submit models roughly 30 days before release; the body would assess risk to cybersecurity, national security, and biological threats, update benchmarks quarterly, and could coordinate a development slowdown if the situation demanded it.
    • The plan would be voluntary at first and mandatory later, and drew endorsement from a broad set of industry figures including Elon Musk, Sam Altman, Anthropic’s Jack Clark, Sundar Pichai, Satya Nadella, and Jack Dorsey.
    • A self-regulatory organization (SRO) like FINRA or the National Futures Association lets the industry set its own testing rules under federal oversight, adjusting faster than a government agency could as the technology changes.
    • Sacks laid out five conditions for supporting an SRO: broad representation including startups and open source; review of true frontier models only; scope limited to catastrophic risk (cyber and CBRN); voluntary before mandatory; and a substitute for, not an addition to, new regulatory agencies.
    • Sacks argued a government “FAA for AI” would be extreme: type certification for a new aircraft design takes 5 to 9 years, and applying that permission-based model to AI would push release timelines from months to years and lose the race to China.
    • He characterized the SRO as an “opening bid” that Anthropic and others would use as a stepping stone toward Dario Amodei’s repeatedly stated goal of an FAA-style regulator, unless it is traded for hard federal preemption written into law.
    • The besties cited a Politico report on Anthropic’s alleged state-by-state strategy of one-upmanship, using California’s SB 53 as a model and then ratcheting each subsequent state’s rules tougher, producing a patchwork rather than a single national framework.
    • Chamath warned of a “torrent of money” trying to influence both political parties toward some form of regulatory capture, and urged establishing industry rules quickly to supersede the need for a federal agency.
    • Stripe and private equity firm Advent, joined by Jack Dorsey’s Block contributing about $17 billion in equity, are jointly bidding roughly $53 billion (about $60 per share) for PayPal, with many expecting the final clearing price closer to $70.
    • The strategic logic is a new competitor to Visa and Mastercard: PayPal’s 400-plus million consumer accounts, Stripe’s merchants and risk infrastructure, Block’s point-of-sale and Cash App, and stablecoin rails from Stripe’s Bridge and PayPal’s PYUSD.
    • The antitrust outcome hinges on market definition: framed as merchant APIs (Stripe vs. Braintree) it looks anti-competitive, but framed against the Visa/Mastercard duopoly it is pro-competitive, and a deal like this would have been blocked two years ago.
    • PayPal peaked around a $322 billion market cap and fell to roughly $30 to 40 billion, which is precisely why it is now attracting bids; Stripe now processes more annual volume than PayPal, but lacks PayPal’s consumer relationship.
    • Sacks traced PayPal’s long stagnation to its 2002 eBay acquisition under Meg Whitman, when the founding team was pushed out; the “PayPal mafia” (which Sacks prefers to call the “PayPal diaspora”) formed as a result.
    • The deal is framed as part of a wave of AI-native operators reviving mature, founder-less digital businesses, with Bending Spoons (AOL, Vimeo, Evernote, WeTransfer, Eventbrite) as the roll-up template and Ryan Cohen’s eBay interest as another data point.
    • M&A is broadly “back on the menu” post-Lina Khan, with deals like Uber acquiring Delivery Hero, driving liquidity and renewed LP appetite for venture alongside SpaceX distributions.
    • Apple filed a 41-page lawsuit against OpenAI on July 10th alleging stolen trade secrets tied to OpenAI’s consumer hardware device; OpenAI’s chief hardware officer Tang Tan is a former Apple VP of iPhone design.
    • The complaint alleges Apple job candidates were directed to bring actual parts to OpenAI interviews for “show and tell,” and cites a text about accessing network storage; OpenAI has reportedly poached over 400 Apple employees.
    • The besties’ rule of thumb: when leaving a company, the only thing you can take is what is in your head; no documents, thumb drives, or files, because Apple rarely litigates and doing so signals something egregious.
    • xAI’s Grok Build, powered by Grok 4.5 and running inside Cursor, was reportedly sending users’ entire codebases (potentially including passwords and API keys) to servers despite a privacy setting meant to prevent it; xAI disabled the upload on July 13th and open-sourced the harness.
    • Chamath’s takeaway: privacy in AI is fragile and brittle, “zero data retention” cannot be guaranteed, and there are non-obvious data-leak vectors and “trap doors” everywhere, arguing for a stratified ecosystem with independent third-party layers between enterprises and models.
    • The “reverse information paradox” (building on Palantir’s Alex Karp) holds that technically capable enterprises want control over their compute, models, weights, data, and “alpha,” via real trust boundaries, private evals, in-tenant learning loops, decoupled orchestration, and the right to fine-tune.
    • Cited token costs per million showed a huge spread: roughly $56 on a premium frontier model, about $26 on another, roughly $1.50 for Grok input, around $1 for Elon’s, and about 50 cents for Chinese models, with a claim that 95 to 98% of tasks could run one tier cheaper.
    • Ramp CEO Eric Glyman launched token spend management because CFOs cannot see or control AI spend; Ramp customers’ token spend has grown 21x in a year, and someone will eventually miss an earnings quarter on runaway AI opex.
    • Engineers optimize for the latest, greatest model while CFOs bear the cost, a misalignment that platforms fine-tuning cheaper open models (like Mira Murati’s Thinking Machines effort) are positioned to exploit.
    • Calacanis called Apple a “screaming buy” on local models: rumored M7 Ultra silicon supporting up to 1.5 terabytes of memory could run last-generation frontier-class models locally on a Mac Studio, putting downward pressure on cloud AI pricing.
    • Edge compute is fragmenting outward: Sunrun announced distributed data center blocks for homes, and Span partnered with Nvidia, with compute increasingly “chasing energy” like cheap solar and battery power.
    • Chamath projected the US will be short 2.5 Californias’ worth of energy by 2050; a recent PJM auction that needed 7 to 8 gigawatts reportedly saw only a fraction show up, underscoring the electricity crunch.
    • “Behind the meter” power lets data centers generate their own electricity on owned property, but clean-air permitting is a major obstacle; Elon reportedly used clustered mobile engines and solutions like Bloom Energy to keep projects under personal-use permits (as with Colossus in Memphis).
    • New York Governor Kathy Hochul announced the nation’s first statewide moratorium on hyperscale data centers; the besties rebutted her claims on power, land, noise, water, and pollution point by point.
    • Modern data centers use closed-loop cooling (one claim compared a typical facility’s water use to a couple of In-N-Out restaurants), occupy trivial land relative to their economic value, generate tax revenue and construction jobs, and are largely powered by clean-burning natural gas.
    • Sacks argued the same political forces slowing domestic data centers are also behind chip export controls that would block data centers in allied countries, raising the question of where the buildout can happen at all.
    • Friedberg drew an anti-GMO analogy: he argued anti-GMO sentiment tracked the US presence of Russia Today (2010 to 2022) rather than the science, and worried a similar manufactured sentiment is now driving anti-data-center attitudes.
    • Sacks cited an OpenAI blog post on PRC-linked influence operations targeting US AI debates, with a congressional investigation reportedly coming, noting China has a clear incentive to slow American AI infrastructure.
    • Sacks framed the moment as a “moral panic”: the catastrophes people fear from AI (cyber, job loss) have not materialized, yet the US risks damaging its crown jewel of free-market innovation with premature regulation over hypothetical risks.
    • The panel questioned Dario Amodei’s prediction that 50% of entry-level knowledge-worker jobs could disappear within one to five years, arguing the harms have not shown up and only a handful of frontier labs (which already do safety testing and red-teaming) even matter.
    • A cited framing of the alleged Anthropic strategy: brand yourself as the safe AI company, ban unsafe AI, then profit; a fresh Chinese model (Kimi K2) was noted as very close to the frontier, suggesting a US lead of only months.
    • Science corner: a paper from Google’s Calico and partner Retro-style researchers used AlphaFold plus directed evolution to engineer a novel enzyme that degrades CML, a key advanced glycation end product in the extracellular matrix that drives aging.
    • The engineered enzyme cleared 52 to 97% of CML from body proteins in vitro and eliminated 55% of CML from donated elderly human skin, effectively reversing that skin’s biological age toward that of a 31-year-old, pointing first toward a potentially trillion-dollar cosmetic market.

    Detailed Summary

    Demis Hassabis’s FINRA-Style SRO for AI

    DeepMind’s Demis Hassabis published a proposal for a US-led international AI standards body modeled on FINRA, the Financial Industry Regulatory Authority. The design is federally overseen but industry funded and run by independent technical experts. Frontier labs would submit models about 30 days before release, and models would be assessed for risk across cybersecurity, national security, biological threats, and other high-risk domains. Benchmarks would update quarterly, the body could coordinate a development slowdown if warranted, and participation would be voluntary at first and mandatory later. The proposal drew endorsements across the industry, including Elon Musk (who called it thoughtful), Sam Altman, Anthropic’s Jack Clark, Sundar Pichai, Satya Nadella, and Jack Dorsey.

    Friedberg explained the SRO concept: bodies like FINRA and the National Futures Association let financial institutions set their own regulatory rules and check one another, under federal oversight but not federal control, reporting up to Senate and House committees. The AI analogy is that many players are all advancing the technology and none wants a single outside regulator dictating tests, especially after California’s earlier AI legislation was, in his telling, outdated by the time it would have taken effect. An SRO can bring in industry experts, adjust tests over time, and operate faster than a new agency. Chamath endorsed it strongly, warning that a “torrent of money” will try to influence both political parties toward regulatory capture, and that establishing rules quickly is the way to avoid that off-ramp while retaining ultimate federal oversight through Commerce and the DOJ.

    Sacks’s Five Conditions and the “FAA for AI” Warning

    Sacks said he could personally get on board with an SRO because it is “infinitely better” than a new government agency that would become a “DMV for AI,” or worse, Dario Amodei’s “FAA for AI.” He laid out five conditions: the SRO must have broad industry representation including startups and open source (to avoid the three biggest labs capturing it); it should review only true frontier models that represent a step change in capability, not hold up lesser models; its scope should be catastrophic risk only, meaning cyber and CBRN (chemical, biological, radiological, nuclear), not disinformation or speech; it should be voluntary before mandatory, proving it works first; and it must substitute for, not add to, new regulatory structures.

    He then explained why an FAA model is extreme: the FAA approves new airplane designs through type certification, which takes 5 to 9 years for a new aircraft and 3 to 5 years for major amendments. Applying permission-based regulation to AI, where new model versions ship every couple of months, would push timelines from months to years and lose the race to a China that will not abide by those rules. His conclusion: if the choice is FAA for AI, DMV for AI, or Hassabis’s SRO, the SRO wins, but it has to be kept “honest and pure,” because otherwise it becomes the opening bid in a coming wave of regulation and a vehicle for massive regulatory capture. He argued that companies making concessions to buy off politicians will only invite the government to come back for more, and that at some point these companies have to grow a spine, draw a line, and demand preemption in exchange.

    The Anthropic Regulatory-Capture Debate

    Sacks revisited his October claim that Anthropic was running a “sophisticated regulatory capture strategy based on fear-mongering,” arguing that what looked like beating up on a startup now looks different given Anthropic’s trillion-dollar valuation and industry-leading revenue. He cited a Politico piece, “Inside Anthropic’s state-by-state plan to ratchet up AI rules,” describing a strategy of one-upmanship: pass a model bill like California’s SB 53, then make each subsequent state’s rules stricter, deliberately producing a patchwork instead of a single national framework. The panel noted states have strong sovereignty rights (as with self-driving cars) and Anthropic is “winning” in California, Illinois, New York, and other blue states, because government officials rarely refuse an invitation to regulate.

    Stripe, Block, and Advent Bid for PayPal

    Stripe and private equity firm Advent, joined by Jack Dorsey’s Block contributing about $17 billion in equity, are jointly bidding roughly $53 billion (about $60 per share) for PayPal, with many expecting a final price closer to $70. PayPal still has more than 400 million consumer accounts and processes about $1.7 trillion a year, but its 25-year-old product is growing only about 7% and is seen as legacy. Chamath’s key question was what unique thing this trio could build: a competitor to Visa and Mastercard. Combining PayPal’s consumer accounts, Stripe’s merchant relationships and risk infrastructure, Block’s point-of-sale and Cash App, and stablecoin rails from Stripe’s Bridge and PayPal’s PYUSD would allow far more on-us transactions that bypass the card networks, potentially passing large discounts to merchants and consumers.

    Friedberg walked through the deal structure: the $17 billion equity contribution effectively means Stripe and Block sell equity to cash investors, that cash buys PayPal, and the parties end up cross-owning pieces of each other, with the Stripe team the likely operator post-close. The antitrust question turns on market definition: framed as merchant APIs, it is Stripe versus Braintree and looks like consolidation; framed against the Visa/Mastercard duopoly, adding competition is pro-competitive. Sacks noted the deal would have been “the antitrust equivalent of a colonoscopy” two years ago. He also recounted PayPal’s history: acquired by eBay in 2002 under the corporate-minded Meg Whitman, the founding team was pushed out, creating what he prefers to call the “PayPal diaspora” rather than the “PayPal mafia.”

    AI-Native Operators and the M&A Wave

    Freeberg framed the PayPal and eBay stories as part of an emerging line: AI-native operators buying first-generation digital-native businesses that have gone mature, stale, and founder-less, and that have not yet realized their AI potential or are overspending. Bending Spoons is the roll-up template, having acquired AOL, Vimeo, Evernote, WeTransfer, and Eventbrite and revitalized them from Milan with young, AI-first executives. The panel connected this to Josh Kushner’s and General Catalyst’s roll-ups of traditional services businesses. Calacanis added the macro backdrop: after venture was “on the ropes” under Lina Khan, M&A is “back on the menu,” with deals like Uber acquiring Delivery Hero, renewed LP appetite, and liquidity from SpaceX distributions.

    Apple Sues OpenAI Over Trade Secrets

    Apple filed a 41-page lawsuit against OpenAI on July 10th alleging stolen trade secrets used to develop OpenAI’s consumer hardware device. OpenAI’s chief hardware officer, Tang Tan, is Apple’s former VP of iPhone design; the complaint alleges he directed Apple job candidates interviewing at OpenAI to bring “actual parts” for “show and tell,” and cites a text from a former Apple engineer about accessing network storage. OpenAI has reportedly poached over 400 Apple employees. Chamath noted Apple rarely litigates, so the suit signals something they found egregious, while cautioning that the facts are alleged and unproven. Sacks declined to opine on the specifics but offered a simple rule: when changing jobs, take nothing but what is in your head, no documents, thumb drives, or files.

    The Grok Build Data Leak and AI Privacy

    xAI’s Grok Build, powered by Grok 4.5 and running inside Cursor, was reportedly sending users’ entire codebases (not just the files needed for a task, but potentially passwords, API keys, and change logs) to servers, despite a privacy setting meant to stop it. xAI disabled the upload on July 13th, Elon said previously uploaded data was deleted, and xAI open-sourced the harness. Chamath used it to make a larger point tied to his CNBC comments and Alex Karp’s remarks: privacy in AI is fragile and brittle, “zero data retention” cannot truly be guaranteed, and there are non-obvious leak vectors and “trap doors” everywhere. His conclusion is that enterprises need a stratified ecosystem with independent third-party layers between them and the models to manage exposure (a model his firm 8090 uses in its “software factory”).

    Sacks connected this to a blog post on the “reverse information paradox,” building on Karp’s point that technically capable enterprises want control over their compute, models, weights, data, and “alpha.” The recipe: establish a real trust boundary with private evals, proprietary learning loops inside the tenant, decoupled orchestration, and the explicit right to fine-tune their own outputs. He described an emerging ecosystem forming alternatives to the monolithic closed model stacks that Anthropic and, to some extent, OpenAI want customers locked into.

    Token Economics and Ramp’s Spend Controls

    The panel cited a wide spread in cost per million tokens: roughly $56 on a premium frontier model, about $26 on another (similar to a Claude tier), around $1.50 for Grok input, about $1 for Elon’s, and roughly 50 cents for Chinese models. Calacanis said he built a deep-linking podcast player across models on Perplexity and that the new Grok run cost only $11. Ramp CEO Eric Glyman appeared on Squawk Box to launch token spend management, noting Ramp customers’ token spend has grown 21x in a year and that CFOs struggle to see or control spend on an open-ended tab where rates rise with each new model. The takeaway: engineers optimize for the newest model while CFOs bear the cost, and unless that misalignment is controlled, runaway opex becomes a “money-burning furnace” that will eventually cause a public company to miss earnings. The panel argued 95 to 98% of tasks could run one tier cheaper, which is exactly the opportunity platforms fine-tuning cheaper open models (like Mira Murati’s Thinking Machines) are chasing.

    Apple’s Local-Model Opportunity and Edge Compute

    Calacanis called Apple a “screaming buy,” citing Mark Gurman’s report that a rumored M7 Ultra chip could support up to 1.5 terabytes of memory, double the current ceiling. That would let a Mac Studio run last-generation frontier-class models locally, giving users effectively unlimited tokens on the desktop and putting downward pressure on cloud AI pricing from the likes of Anthropic and OpenAI. Freeberg added that edge compute is fragmenting outward: solar company Sunrun announced distributed data center blocks for homes, and Span partnered with Nvidia. The theme is compute chasing cheap energy, whether excess solar or battery power charged at night.

    The Energy Deficit and Behind-the-Meter Power

    Chamath warned the US will be short about 2.5 Californias’ worth of energy by 2050, and pointed to a recent PJM auction (serving Pennsylvania, New Jersey, Maryland and other states) that needed 7 to 8 gigawatts but reportedly saw only a fraction show up. He explained “behind the meter” power: rather than drawing grid power from a utility line, a data center generates its own electricity on owned property. The obstacle is clean-air permitting. Solar takes too much space and batteries still need a generation source, so operators use gas. He described Elon clustering mobile 18-wheeler-style engines to keep them under personal-use permits, and newer solutions like Bloom Energy that allow large installations under similar rules, which is how projects like Colossus in Memphis got off the ground.

    New York’s Data Center Moratorium

    New York Governor Kathy Hochul announced the nation’s first statewide moratorium on hyperscale data centers, citing power draw, land use, water, and noise pollution. The besties rebutted each claim: behind-the-meter power means facilities bring their own electricity rather than competing with residential ratepayers; data centers are highly land-efficient, and New York State is roughly 70 to 80% undeveloped outside the city; noise can be managed with distance; modern facilities use closed-loop cooling (one comparison put a typical facility’s water use at a couple of In-N-Out restaurants, far less than almonds or golf courses); and natural gas is a clean-burning power source. They noted the tax revenue, construction boom, and ongoing jobs data centers create. Sacks cited a theory that Democrats intend the “moratorium” as leverage: pause construction until they can dictate terms, then lift it under a future administration in exchange for a new regulatory agency and speech controls ported from the social-media trust-and-safety agenda. He stressed a moratorium is effectively a five-year pause once ramp-up is counted, and that the same forces slowing domestic builds are pushing chip export controls that would block data centers in allied countries too.

    Foreign Influence, Anti-GMO, and the AI Moral Panic

    Freeberg drew an extended analogy between anti-data-center sentiment and anti-GMO sentiment. He argued that GMOs were prevalent and uncontroversial from their 1996 launch until anti-GMO sentiment rose in tandem with Russia Today’s US presence (2010 to 2022) and fell after RT was pushed out, and that similar KGB-era “directed measures” influence campaigns can be traced to opposition to nuclear energy in Germany. He cited a poll showing over 50% of Americans believe data centers increase water and electricity costs even where facilities recycle water and generate their own power. Sacks pointed to an OpenAI blog post on PRC-linked influence operations targeting US AI debates, with a congressional investigation reportedly coming, arguing China has a clear incentive to slow US AI infrastructure, kill open source, and constrain cheaper models. Sacks then broadened it to a “moral panic”: the feared catastrophes (cyber, job loss) have not materialized, yet the US risks damaging its crown jewel of free-market innovation over hypothetical risks, questioning Dario Amodei’s prediction that 50% of entry-level knowledge-worker jobs could vanish within one to five years and noting the fresh Chinese model Kimi K2 is close to the frontier.

    Science Corner: An Enzyme That Reverses Skin Aging

    Freeberg closed with a paper from Google’s secretive longevity startup Calico and a pharma partner focused on the extracellular matrix, the space between cells. Over time, sugars and fats bind to proteins there in a process called glycation, accumulating as advanced glycation end products (chiefly a molecule called CML) that stiffen tissue, cause wrinkles and immobility, and drive inflammation, with nothing in the body to break them down. The researchers used AlphaFold to find a protein that could bind and degrade CML, then applied directed evolution across five recursive cycles, DNA-programming thousands of variants to maximize activity. The engineered enzyme cleared 52 to 97% of CML from body proteins like collagen, casein, and hemoglobin in vitro, and eliminated 55% of CML from donated elderly human skin, effectively reversing that skin’s biological age toward a 31-year-old’s. Open questions remain about delivery (cream, shot, supplement, or an RNA therapy that makes the enzyme inside the body), but the panel expects the first market to be a trillion-dollar cosmetic one, and hailed it as a profound demonstration of AI-driven protein engineering.

    Notable Quotes

    “The whole industry is going to need to be regulated and I think the industry needs to regulate themselves. That’s the key to this.”

    Jason Calacanis, replaying his earlier call for AI self-certification

    “If my choices are between FAA for AI or what I would call the DMV for AI, I would much rather go for Demis’ SRO for AI.”

    David Sacks, on why self-regulation beats a new government agency

    “There’s hardly anyone in government who will ever say, oh no no no, we’re not qualified. Most people in the government will say thank you very much, what else can we take.”

    David Sacks, on the asymmetry that makes voluntary concessions dangerous

    “What it prevents is a handful of actors using their balance sheets and their capital to essentially pull the ladder up.”

    Chamath Palihapitiya, on the point of establishing industry rules quickly

    “You are creating a competitor to Visa and Mastercard.”

    Chamath Palihapitiya, on the only thing Stripe, Block, and Advent could build together with PayPal

    “The only thing you can bring to your new job is what’s in your head. Your memories. But never leave with anything else.”

    David Sacks, on avoiding trade-secret disputes when changing employers

    “Privacy in AI is very fragile and it’s very brittle. You are leaking information where you don’t know it.”

    Chamath Palihapitiya, on the limits of zero-data-retention promises

    “Unless you get a control of this and you can directly say how much money you’re making, this is a bridge to nowhere. It is a money burning furnace.”

    Chamath Palihapitiya, on uncontrolled enterprise token spend

    “We’re on the threshold of destroying the crown jewel of our economy, which is the system of free market innovation that we have.”

    David Sacks, on the risk of a premature AI regulatory apparatus

    “Number one, brand yourself as a safe AI company. Number two, ban unsafe AI. Three, profit.”

    David Sacks, summarizing the strategy he attributes to the “safe AI” positioning

    Watch the full conversation here: Can the AI Industry Regulate Itself? on the All-In Podcast.

    Related Reading

    • FINRA the financial-industry self-regulatory organization that Demis Hassabis’s AI proposal is modeled on.
    • AlphaFold (Wikipedia) the protein-structure prediction system behind the age-reversal enzyme discovery in the science corner.
    • PayPal Mafia (Wikipedia) background on the founders Sacks calls the “PayPal diaspora.”
    • The Founders by Jimmy Soni, the definitive history of PayPal’s founding team and its diaspora.
    • Advanced glycation end-products (Wikipedia) the biochemistry of CML and the extracellular-matrix aging the Calico enzyme targets.

  • Dario Amodei on Policy for the AI Exponential: Anthropic’s Plan for AI Regulation, Job Displacement, Civil Liberties, and Democratic Leadership

    In June 2026, Anthropic CEO Dario Amodei published “Policy on the AI Exponential”, a wide-ranging essay arguing that the gap between how fast AI is advancing and how slowly policy moves has become dangerous, and that the window to close it is open right now. He opens with a memorable image from The Lord of the Rings: the Hobbits trying to rouse Treebeard, the ancient tree who takes a full day just to say hello, to defend his forest before it is cut down. That mismatch in speed, he writes, is exactly the relationship between AI and our political institutions. This post breaks the essay down in full and adds analysis of where the argument lands.

    TLDR

    Amodei argues that AI’s scaling laws point toward “powerful AI,” a country of geniuses in a datacenter, within a few years, while legislation still moves on a timescale of years. For most of the last few years, safety advocates including Anthropic pushed only for optionality-preserving moves like transparency rules, chip export controls, and labor data collection, because the risks were not yet concrete. He says that has changed: events like Claude Mythos Preview proved frontier models are now tools of national strategic consequence, and the time for binding regulation has arrived. The essay covers five policy areas. First, regulation and public safety, where he proposes an FAA-style regime of mandatory third-party testing of frontier models above a compute threshold across four risks (cybersecurity, biological weapons, loss of control, and automated R&D), with government power to block unsafe deployments. Second, macroeconomics and tax policy, where AI could deliver hypergrowth and severe, enduring job displacement at the same time, demanding measurement, pro-employment incentives, and possibly UBI or universal capital accounts. Third, accelerating AI’s positive impact, where the danger is regulators like the FDA being too slow rather than too lax, and biomedical approval needs reform. Fourth, the state and civil liberties, where AI could become the ultimate tool of autocracy through autonomous weapons and mass surveillance, requiring new accountability rules, a domestic ban on autonomous weapons, closing the data broker loophole, and public rights to AI advice. Fifth, securing leadership by democracies through a values-based global coalition that controls the AI supply chain, coordinates on risk, shares benefits, and rejects AI-powered repression. He closes by rejecting the idea that public concern about AI is a PR problem to be marketed away, calling it democratic accountability working as it should.

    Thoughts

    The most important move in this essay is structural, not technical. Amodei is explicitly retiring the “preserve optionality” posture that defined Anthropic’s policy work through 2025 and replacing it with a call for binding rules. For years the argument from safety-minded labs was that the risks were too speculative to legislate against without doing more harm than good, an idea he grounds in the Collingridge dilemma and the Hayekian point that regulators lack the information to make good calls. That was a defensible hedge. What is striking here is the claim that the hedge has expired. He is saying the evidence is now concrete enough that continued caution about regulating has flipped from prudent to negligent. Whether you trust the underlying capability claims or not, that is a genuine change in position from one of the field’s most influential voices, and it deserves to be read as such.

    The FAA analogy is doing enormous work, and it is worth poking at. Airplanes and drugs are mature technologies with stable physics and decades of incident data; the certification regime works because the failure modes are well understood. Frontier models are the opposite: the whole premise of the essay is that capabilities are changing faster than anyone can characterize them. Amodei half-acknowledges this when he warns that a fixed list of safety requirements tends to consume 95 percent of compliance effort on things that turn out not to matter while missing the real risks, a lesson he says Anthropic learned from its own Responsible Scaling Policy. So the proposal is really for an agency nimble enough to rewrite its own standards continuously, which is a much taller order than the FAA. The honest read is that he is proposing a regulator we do not yet know how to build, and betting that building it is still better than the alternative.

    The economics section is where Amodei is most careful, and it is the part most likely to be misread. He goes out of his way to say enduring job displacement is undesirable and that warning about it is not the same as wanting it, a distinction critics of AI leaders often collapse. His real claim is subtle: that AI might jam the economic policy dial on a “hypergrowth, hyper-inequality” setting that is hard to unstick, because AI substitutes for human cognition broadly and faster than past technologies, potentially overwhelming the usual escape hatches like comparative advantage and Jevons paradox. If he is right, the political fight of the next decade is not about growth, which AI supplies, but about distribution, which it does not. His mention of UBI, universal capital accounts, and higher capital gains taxes is notable coming from a frontier CEO, even hedged as it is.

    The civil liberties section is the one that should travel furthest beyond the AI-policy bubble, because it does not depend on accepting his most aggressive timelines. The data broker loophole, the idea that the government can simply buy the bulk data Americans hand to private companies and run mass analysis on it, is a problem that exists today; AI just raises the stakes by making that data vastly more revealing. Same with the proposal that anyone facing adverse government action should have access to AI at least as capable as what the government uses against them. These are concrete, near-term, and bipartisan in a way the abstract autonomy debates are not. The most candid line in the whole piece is his admission that AI cannot be safely entrusted to either governments or companies, an unusually direct acknowledgment that his own industry needs external checks, with Anthropic’s Long-Term Benefit Trust offered as one imperfect example rather than a solution.

    The geopolitics section is the most contested terrain. Framing AI as a nuclear-scale reset of the game board, with a virtual country of 100 million geniuses divisible across military strategy and weapons R&D, leads naturally to a democratic coalition that hoards chips and denies them to adversaries. That logic is internally consistent, but it sits in tension with the benefit-sharing and “eventually the whole world joins” language elsewhere in the same section. Export controls that lock down the supply chain are, by design, a tool of exclusion, and reconciling that with broad diffusion of AI’s benefits to developing countries is the circle the coalition idea has to square. Amodei is clearly aware of the tension and bets that making membership attractive resolves it. The closing image is the one to remember: Treebeard waking up, with the warning that the goal is to channel real public concern into constructive policy rather than let it curdle into formless anger.

    Key Takeaways

    • The core tension of the essay is a mismatch in speed: AI advances exponentially while legislation moves on a multi-year timescale, dramatized by the Treebeard and Hobbits image from The Lord of the Rings.
    • In only four years, AI models went from barely writing a coherent line of code to writing most of the code at major AI companies, with similar gains across biology, physics, math, finance, law, and translation.
    • Scaling laws now have over a decade of empirical support, and if they continue another year or two they likely produce “powerful AI,” a country of geniuses in a datacenter.
    • For the last few years, safety advocates including Anthropic focused on optionality-preserving policies: transparency legislation, chip export controls, and data collection on AI’s labor effects.
    • Amodei argues that posture is no longer enough. Claude Mythos Preview revealed that frontier models pose real cybersecurity risks to the financial sector, critical infrastructure, and national security, and proved AI is now a tool of strategic consequence.
    • He expects biological risks to follow cyber risks, with serious AI autonomy risks potentially not far behind.
    • The essay covers five policy areas: regulation and public safety, macroeconomics and tax policy, accelerating AI’s positive impact, the state and civil liberties, and securing leadership by democracies.
    • Alongside the essay, Anthropic released a legislative proposal on frontier model testing and a policy framework for job displacement, both with promised financial backing.
    • On regulation, Amodei invokes the Collingridge dilemma and Hayek’s information problem to explain why pre-writing AI law in 2023 to 2024 was risky, then argues the situation has now changed.
    • Anthropic’s 2025 answer was transparency, helping pass SB 53 in California, RAISE in New York, and SB 315 in Illinois, plus advocating a federal transparency standard.
    • He now calls for binding regulation modeled on the FAA, where frontier models must pass technical testing and can have release blocked or reversed if they fail high safety standards.
    • Models above a compute threshold should face mandatory third-party testing in four areas: cybersecurity, biological weapons, loss of control of AI systems, and automated R&D that accelerates the other three.
    • Government should be able to block or deter deployment of models judged to present unacceptable risk, scoped to those four risks with protections against political favoritism.
    • Evaluation could come from a government agency or from authorized and inspected private organizations under a “regulatory markets” approach.
    • AI companies should have strong security to protect model weights, conduct regular red teaming and penetration testing, report safety incidents promptly, and work with government against major threat actors.
    • He warns a time may come when the most powerful systems resemble weaponizable nuclear materials rather than airplanes, requiring more aggressive measures, but cautions against getting ahead of present dangers.
    • On economics, AI could deliver extremely rapid growth via accelerated science and operational efficiency, supercharged by AI building better AI.
    • The same properties make AI a broad substitute for human cognition that changes the economy faster than past technologies, risking large and potentially enduring labor market disruption.
    • The feared outcome is a “hypergrowth, hyper-inequality” setting that is hard to unstick, where the challenge shifts from incentivizing growth to sharing its benefits.
    • Amodei is emphatic that enduring job displacement is undesirable and dangerous, and that he warns about it to help society adapt, not as a prophet of doom.
    • Anthropic says it works with customers to find new revenue and use cases rather than only cost cutting, and explores interaction paradigms that keep humans active alongside AI.
    • He predicts AI will enable single individuals to build billion-dollar companies, noting teams of a few people already reach hundreds of millions in revenue, while admitting significant enduring job loss may be intrinsic to the technology.
    • Any response must address both economic provision and the human need for meaning, purpose, and agency, with the latter ultimately more important and beyond what policy can directly deliver.
    • Suggested economic interventions: better measurement and tracking (governments expanding statistics beyond Anthropic’s Economic Index), pro-employment incentives, and long-term macroeconomic support.
    • Pro-employment ideas include wage insurance, retention tax incentives, workforce training grants, and employer-employee matching infrastructure.
    • If displacement is large and permanent, mechanisms like universal basic income or universal capital accounts, financed through company taxes or higher capital gains taxes, may be necessary.
    • He frames datacenter and energy-price backlash as largely a symbol of broader economic anxiety, and says AI companies should pay to absorb rate increases, a pledge Anthropic has already made.
    • For technologies accelerated by AI, the bigger risk is regulators like the FDA being too slow, not too lax, because AI may make downstream tech safer in ways that violate skeptical regulatory assumptions.
    • Biomedicine is the illustrative case: AI could flood the drug pipeline, raise effect sizes, treat previously untreatable diseases, and create whole new therapy categories, while the current FDA and EMA pipeline takes 7 to 8 years.
    • Agencies should pre-approve standards for AI methods like PD/PK modeling, toxicology prediction, dose selection, biomarker validation, synthetic control arms, and surrogate endpoints, plus more flexible accelerated-approval mechanisms.
    • On civil liberties, powerful AI in the wrong hands could be the ultimate tool of autocracy, and existing constitutional protections are not fully equipped to counter a surprise seizure of power.
    • Threats named include fully automated drone armies that obey unlawful orders and surveillance AI that infers the innermost details of every citizen’s life from widely available data.
    • Civil liberties proposals: accountability rules and an “off switch” for autonomous weapons, a domestic ban on fully autonomous weapons including in law enforcement, closing the data broker loophole, and public rights to AI advice during adverse government action.
    • Amodei warns companies as well as governments can seize quasi-state power, citing the Gilded Age and the East India Company, and says AI cannot be safely entrusted to either alone.
    • He offers Anthropic’s Long-Term Benefit Trust as one separation-of-power structure and urges the industry to explore mechanisms that go further.
    • On geopolitics, he argues AI resets the geopolitical game board like nuclear weapons, becoming the dominant source of military and economic power for any nation that holds it.
    • A nation with powerful AI versus one without it, or even one three years behind, could resemble WWII Marines facing medieval swordsmen.
    • He calls for a democratic coalition that shares chips and semiconductor manufacturing equipment internally while denying them to adversaries, citing MATCH and OVERWATCH as good first steps.
    • The coalition should coordinate risk policy, share benefits including harmonized medical approvals, provide mutual AI defense, reject AI-powered repression, and cooperate on macroeconomic stabilization.
    • He rejects the idea that AI’s image is a PR problem, arguing public concern reflects real risks and is democratic accountability working as it should, with the task being to channel it into constructive solutions.

    Detailed Summary

    The speed mismatch between AI and policy

    Amodei frames the entire essay around a single problem: AI advances at a lightning pace while policy, especially legislation, moves very slowly, often for good reasons since governments wield grave powers that should not be used hastily. He illustrates this with Treebeard, the sentient tree from The Lord of the Rings who takes a full day to say hello, as a stand-in for political institutions trying to respond to a technology that can go from amusing toy to a country of geniuses in the time it takes Congress to act. He recounts the dilemma responsible actors have faced: they could see where the exponential was headed, but to observers looking only at present capabilities, AI looked as mundane as the latest consumer app or cryptocurrency, making a laissez-faire attitude hard to argue against. The absence of AI’s radical effects, and uncertainty about their shape, made it genuinely difficult to design good policy even where the will existed.

    That uncertainty, he says, is why safety advocates limited themselves to optionality-preserving measures like transparency rules, export controls, and labor data collection. But over the last few months the evidence of AI’s power and risk has become undeniable, with Claude Mythos Preview as the emblematic example: it scrambled the global cybersecurity landscape and proved AI models are now tools of global and national strategic consequence. He expects biological and autonomy risks to follow, and argues the world must now activate its slow, rickety policy apparatus to handle risks that will compound quickly. He worries current early actions are at least a year out of step with AI’s progress, and presents the essay as an attempt to close that gap across five policy areas, focused on US policy but relevant worldwide.

    Regulation and public safety: an FAA for frontier models

    Amodei opens by acknowledging the real costs of regulation: it can reduce a product’s benefits, disincentivize innovation, and suffer from the Hayekian problem that regulators lack the information for good tradeoffs, plus the Collingridge dilemma that a technology’s impacts are hard to anticipate until it is too late to manage them. In 2023 to 2024 these dynamics argued against pre-writing AI law, since the exact form of biological or autonomy risk, how to test for it, and how it would play out were all unclear, creating a high risk of low-value compliance requirements that miss the real dangers. Anthropic’s answer was transparency: requiring developers to disclose safety procedures, tests, and critical incidents, which is why it supported SB 53 in California, RAISE in New York, and SB 315 in Illinois in early 2026.

    Now, he argues, the risks are clearly here and it is time for binding regulation. His analogy is to cars, airplanes, and drugs: powerful technologies essential to the economy but capable of killing many people if designed or operated poorly. He models AI regulation on the FAA, with frontier models required to pass testing and auditing and with release blocked or reversed if they fail high safety standards. His concrete proposal: mandatory third-party testing for models above a compute threshold across cybersecurity, biological weapons, loss of control, and accelerating automated R&D; government power to block deployment of unacceptably risky models, scoped narrowly with anti-favoritism protections; evaluation by either a government agency or authorized private organizations in a regulatory-markets model; strong weight security, red teaming, and penetration testing at AI companies; and prompt reporting of safety incidents. He notes a future may arrive when systems resemble weaponizable nuclear materials and demand harsher measures, but warns against designing for dangers that have not yet emerged.

    Macroeconomics and tax policy: growth and displacement together

    Here Amodei challenges the standard premise that growth is fragile and must be traded off against the drag of taxes or deficits to reduce inequality. Powerful AI, he suggests, may scramble that assumption by producing extremely rapid growth through accelerated science and efficiency, supercharged by AI building better AI, while simultaneously acting as a broad substitute for human cognition that reshapes the economy faster than any prior technology. The result could be a world stuck on a hypergrowth, hyper-inequality setting that is hard to unstick, where the central challenge is no longer incentivizing growth but sharing its benefits. He is careful to make two points clearly: first, enduring job displacement is undesirable and dangerous and should be minimized, and his warnings are meant to help society adapt, not to play prophet of doom; second, any response must address both economic provision and the deeper human need for meaning, purpose, and agency, which matters more and which policy cannot directly supply.

    His policy menu starts with measurement and tracking, arguing good policy is impossible without accurate data, and that governments could expand economic statistics well beyond Anthropic’s Economic Index. Next come pro-employment incentives such as wage insurance, retention tax incentives, workforce training grants, and employer-employee matching, costs he says society should readily accept since they are likely offset by AI productivity gains. If displacement proves large and permanent, he says long-term income support like universal basic income or universal capital accounts may be needed, financed through taxes on relevant companies or higher capital gains taxes. He closes the section by reframing datacenter and energy-price backlash as mostly a symbol of broader economic anxiety, while saying AI companies should absorb rate increases, as Anthropic has pledged.

    Accelerating AI’s positive impact: the slow-regulator problem

    For technologies accelerated by AI, rather than AI itself, Amodei flips his concern: the bigger danger is regulatory systems designed for a slower pace failing to handle the deluge of new products, and AI making downstream technologies safer in ways that violate the skeptical assumptions baked into agencies like the FDA. He focuses on biomedicine as the area likely to produce AI’s biggest humanitarian benefits and where regulation is especially complex. AI could greatly increase the rate of new drug candidates, improve their effect sizes and safety profiles, treat previously untreatable diseases, and create entirely new therapy categories the way antibodies, peptides, and cell therapies did.

    The current pipeline at the FDA and EMA takes 7 to 8 years, built on the pessimistic assumption that drug candidates usually fail and often carry safety problems even when they work. Without reform, AI will jam or overload that system. Amodei proposes that agencies develop standards now for accepting AI simulation and analysis, so they can be adopted quickly once proven rather than after years of unnecessary testing. Specific candidates include AI-based PD/PK modeling, toxicology prediction to reduce animal testing, more accurate dose selection, biomarker validation from large datasets, synthetic control arms, and surrogate endpoints (especially for aging and neurodegeneration). He urges more flexible accelerated-approval mechanisms generally, and notes biomedical acceleration may also reduce AI’s risks by aiding biodefense and improving mental health.

    The state and civil liberties: guarding against AI-driven tyranny

    Amodei frames the perennial balance between state power and individual liberty, enforced through machinery like the First, Fourth, and Fifth Amendments, the Posse Comitatus Act, and FISA, and argues AI threatens to upset that balance while raising its stakes. Powerful AI in the wrong hands could be the ultimate tool of autocracy, because the enormous returns to intelligence combined with AI’s pace create a perfect storm for a surprise seizure of power. The danger could take many forms but shares one feature: AI conferring sudden power while routing around democratic oversight. He cites a fully automated drone army that could obey unlawful orders, where trained humans might object, and a surveillance AI that analyzes widely available information at massive scale to infer the innermost details of every citizen’s life, an ability current civil liberties law never contemplated.

    His proposals: create accountability rules for autonomous weapons so they respond to court orders, legislation, and human overseers rather than blindly following orders, possibly with a judicial finger on an off switch; ban domestic use of fully autonomous weapons, including in law enforcement, while allowing them against foreign adversaries; close the bulk-collection and data-broker loophole that lets the government buy and analyze data Americans share with private companies; and guarantee public rights to AI advice at least as capable as what the government uses during adverse action, as an extension of the Administrative Procedure Act, due process, or the Sixth Amendment. He closes by warning that companies, not just governments, can capture the state, citing the Gilded Age and East India Company, and argues AI cannot be safely entrusted to either alone. Anthropic’s Long-Term Benefit Trust is offered as one accountability structure, with a call for the industry to go further.

    Securing leadership by democracies: a values-based coalition

    Amodei rejects treating AI as a mere instrument of trade policy to diffuse a tech stack worldwide. He believes AI resets the entire geopolitical game board like nuclear weapons, potentially even more so, becoming the dominant source of military and economic power for whoever holds it. In a virtual country of 100 million geniuses, millions could be assigned to military strategy, drone manufacture, weapons R&D, intelligence, and scientific advancement at once, so a nation with powerful AI facing one without it, or even three years behind, could be like WWII Marines against medieval swordsmen. Because powerful AI also enables deeper autocratic repression, it matters enormously that the world’s strongest nations are democracies.

    His answer is a global coalition built on shared democratic values that draws in the rest of the world by making membership increasingly attractive and exclusion increasingly costly. Operating principles include managing the AI supply chain by sharing chips and semiconductor manufacturing equipment within the coalition while denying them to adversaries, expanding and tightening export controls (he cites MATCH and OVERWATCH as good first steps); coordinating on biological, cyber, and autonomy risk to make compliance compatible and effective; sharing AI’s benefits including harmonized medical approvals; mutual defense through collective AI cyberdefense, drones, manufacturing, compute, and intelligence; rejection of AI-powered repression; and macroeconomic cooperation against contagious employment crises. The coalition would respect each nation’s sovereignty, start with aligned democracies, and grow iteratively, ideally toward the whole world, but at minimum positioning democracies to contain and outcompete repressive regimes.

    A window of opportunity

    Amodei closes on cautious optimism. The same exponential that strains policymaking has created a unique opening: clear evidence of AI’s risks, an early taste of its value and disruption, and public backlash against unregulated approaches have left policymakers unusually open to forward-looking action. Treebeard and his forest are waking up. He firmly rejects the industry-circle view that this is a PR problem solved by better marketing, arguing people are worried because the risks are real, and that public concern in response to transparency is democratic accountability working as it should. The key challenge is focusing that concern into constructive solutions rather than letting it descend into formless anger and violence. He is optimistic because issues from job displacement to model testing to export controls have common-sense appeal across the political spectrum, and a broad nonpartisan coalition could adopt sane, forward-looking policy faster than usual.

    Notable Quotes

    “in only four years, AI models have gone from barely being able to write a coherent line of code to writing most of the code at major AI companies.”

    Dario Amodei, on the pace of the AI exponential

    “in the several years that it can take Congress to act, AI can go from an amusing toy to the full country of geniuses.”

    Dario Amodei, on the mismatch between AI’s speed and the speed of legislation

    “However, now the risks are clearly here. It is time to go beyond transparency to more serious and binding regulation of AI.”

    Dario Amodei, marking the shift from transparency to binding rules

    “enduring job displacement is undesirable and dangerous, and we should do everything we can to minimize or prevent it, not to bring it about.”

    Dario Amodei, clarifying his stance on AI and jobs

    “The key challenge in such a world won’t be incentivizing growth, but finding a way for everyone to share in the benefits.”

    Dario Amodei, on a hypergrowth, hyper-inequality economy

    “Powerful AI in the wrong hands could be the ultimate tool of autocracy, and our existing legal and constitutional protections are not fully equipped to counter this threat.”

    Dario Amodei, on AI and civil liberties

    “A nation that possesses powerful AI facing one without it … could be the equivalent of an army of World War II Marines facing an army of medieval swordsmen.”

    Dario Amodei, on AI as the dominant source of geopolitical power

    “People are worried about AI because they correctly perceive that its risks are real, not because AI CEOs have been insufficiently Panglossian.”

    Dario Amodei, rejecting the idea that AI has a PR problem

    “Treebeard and his forest are waking up.”

    Dario Amodei, on policymakers’ new openness to acting on AI

    “Policy on the AI Exponential” is a dense, structured argument from one of the most consequential figures in the field, and it rewards a full read in the original. The summary and analysis above are a guide, not a substitute. You can read the full essay here.

    Related Reading