PJFP.com

Pursuit of Joy, Fulfillment, and Purpose

Tag: Demis Hassabis

  • Can the AI Industry Regulate Itself? All-In on Demis Hassabis’s SRO Proposal, Stripe’s PayPal Bid, Apple vs OpenAI, and New York’s Data Center Ban

    The besties open on the biggest live question in artificial intelligence policy: can the AI industry regulate itself before the government does it for them? Jason Calacanis, Chamath Palihapitiya, David Sacks, and David Friedberg dig into DeepMind co-founder Demis Hassabis’s proposal for a FINRA-style self-regulatory organization for frontier models, then work through a packed docket that runs from Stripe’s audacious bid for PayPal to Apple’s trade-secrets lawsuit against OpenAI, the xAI Grok Build data leak, the economics of token spend, New York’s first-in-the-nation data center moratorium, foreign influence campaigns shaping American attitudes toward AI, and a science corner on an enzyme that reverses skin aging. You can watch the full episode here.

    TLDW

    Demis Hassabis proposed a US-led international AI standards body modeled on FINRA: federally overseen, industry funded, run by independent technical experts, with frontier labs submitting models 30 days before release, voluntary at first and mandatory later. The proposal drew broad endorsement across the industry, and the besties debate whether an SRO beats the alternatives. Sacks says he could get on board only under five strict conditions (broad representation including startups and open source, frontier-only review, catastrophic-risk-only scope, voluntary-first, and substitution for rather than addition to new agencies), and warns the plan is an opening bid that Anthropic will use as a stepping stone toward Dario Amodei’s “FAA for AI.” The show then turns to Stripe, Block, and Advent bidding roughly $53 billion for PayPal and what it means for Visa and Mastercard, a wave of AI-native operators reviving stale digital businesses (Bending Spoons, Ryan Cohen), Apple’s lawsuit accusing OpenAI of stealing trade secrets, xAI’s Grok Build silently uploading entire codebases despite a privacy setting, the enormous spread in token costs and Ramp’s new spend controls, Apple’s local-model opportunity with M7 Ultra silicon, America’s looming energy deficit and behind-the-meter power, New York’s hyperscale data center moratorium, alleged Russian and PRC influence operations shaping anti-GMO and anti-data-center sentiment, and a science corner on a Calico enzyme that degrades glycation products to reverse skin aging.

    Thoughts

    The most important idea in this episode is not the SRO itself but Sacks’s framing of it as an opening bid. His five conditions are a genuinely useful blueprint for how self-regulation could work without curdling into regulatory capture, and his instinct that catastrophic-risk-only scope (cyber and CBRN, not disinformation or “microaggressions”) is the only defensible mandate is the right line to draw. But the deeper point is structural: when an industry walks into government and says “please regulate me,” almost no one in government answers “we’re not qualified.” They say thank you and come back for more. That asymmetry, not any specific rule, is what makes voluntary concessions dangerous. If the SRO is offered for free rather than traded for hard federal preemption written into law, it becomes the floor of a ratchet, not the ceiling of a compromise.

    The Anthropic critique running through the segment deserves to be taken on its merits rather than dismissed as a grudge. The claim is specific and falsifiable: that a company now valued in the trillions is funding a state-by-state strategy of one-upmanship, where each new bill is tougher than the last, deliberately producing a patchwork rather than the single national framework everyone claims to want. Whether or not you accept the motive, the mechanism is real and the incentives are legible. If your cost per million tokens is fifty to a hundred times your competitor’s, and cheaper open models plus fine-tuning can cover the vast majority of tasks, then the fastest way to protect a premium price is to make the cheap alternatives legally or practically harder to ship. That is the ladder-pulling thesis, and the token-cost numbers cited on the show are the reason it is not paranoid.

    The PayPal bid is the clearest signal of a new operating logic in the capital markets. The interesting question Chamath poses is not “what synergies does PayPal have” but “what is the only thing Advent, Stripe, and Block could build together,” and the answer is a genuine competitor to Visa and Mastercard: hundreds of millions of consumer accounts, Stripe’s merchant relationships and risk infrastructure, Block’s point-of-sale and Cash App, and stablecoin rails from Bridge and PYUSD that can push transactions on-us and bypass the card networks. The antitrust twist is elegant. Define the market as merchant APIs and it looks like consolidation; define it as the card duopoly and the same deal is pro-competitive. This deal would have been dead on arrival two years ago, and the fact that it is live now tells you as much about the regulatory climate as it does about payments.

    Underneath the payments story is a broader thesis worth naming: AI-native operators buying mature, founder-less, “stale” digital businesses and modernizing them. Bending Spoons rolling up AOL, Vimeo, Evernote, WeTransfer, and Eventbrite is the template, and Ryan Cohen’s eBay interest is the second dot on the line. The claim is that a modern operator can diagnose where a legacy business overspends, underinvests, and fails to use AI, then fix it with a small team of AI-first executives rather than a McKinsey engagement. It is a persuasive pattern, though PayPal is a harder case than the show admits: a 25-year-old interaction model growing 7% a year is not obviously revived by efficiency alone. Buying 400 million consumer accounts is buying distribution, not a product vision, and the open question is whether anyone can resuscitate the consumer experience rather than just milk it.

    The data center segment is where policy, energy, and information warfare collide, and Friedberg’s anti-GMO analogy is the sharpest thing in it. His argument is that manufactured public sentiment, traceable in one case to a foreign media push, can override the scientific and economic merits of a technology for years, and that the anti-data-center movement rhymes with it: closed-loop cooling that uses trivial amounts of water, land-use efficiency that dwarfs almonds and golf courses, and natural gas that burns clean, all drowned out by a moral panic. Whether or not you buy the specific foreign-influence attribution, the underlying tension is real and unresolved. America is staring at a structural electricity deficit while individual blue states treat data centers as a luxury they can refuse, and behind-the-meter power plus edge compute chasing cheap electrons is emerging as the workaround. The moratorium framing matters most here: a “pause” on data centers is not a few months, it is five years once you count ramp-up, and that is long enough to lose a race that may only be measured in months of lead.

    Key Takeaways

    • Demis Hassabis proposed a US-led international AI standards body modeled on FINRA: federally overseen, industry funded, and run by independent technical experts rather than a new government agency.
    • Under the proposal, frontier labs would submit models roughly 30 days before release; the body would assess risk to cybersecurity, national security, and biological threats, update benchmarks quarterly, and could coordinate a development slowdown if the situation demanded it.
    • The plan would be voluntary at first and mandatory later, and drew endorsement from a broad set of industry figures including Elon Musk, Sam Altman, Anthropic’s Jack Clark, Sundar Pichai, Satya Nadella, and Jack Dorsey.
    • A self-regulatory organization (SRO) like FINRA or the National Futures Association lets the industry set its own testing rules under federal oversight, adjusting faster than a government agency could as the technology changes.
    • Sacks laid out five conditions for supporting an SRO: broad representation including startups and open source; review of true frontier models only; scope limited to catastrophic risk (cyber and CBRN); voluntary before mandatory; and a substitute for, not an addition to, new regulatory agencies.
    • Sacks argued a government “FAA for AI” would be extreme: type certification for a new aircraft design takes 5 to 9 years, and applying that permission-based model to AI would push release timelines from months to years and lose the race to China.
    • He characterized the SRO as an “opening bid” that Anthropic and others would use as a stepping stone toward Dario Amodei’s repeatedly stated goal of an FAA-style regulator, unless it is traded for hard federal preemption written into law.
    • The besties cited a Politico report on Anthropic’s alleged state-by-state strategy of one-upmanship, using California’s SB 53 as a model and then ratcheting each subsequent state’s rules tougher, producing a patchwork rather than a single national framework.
    • Chamath warned of a “torrent of money” trying to influence both political parties toward some form of regulatory capture, and urged establishing industry rules quickly to supersede the need for a federal agency.
    • Stripe and private equity firm Advent, joined by Jack Dorsey’s Block contributing about $17 billion in equity, are jointly bidding roughly $53 billion (about $60 per share) for PayPal, with many expecting the final clearing price closer to $70.
    • The strategic logic is a new competitor to Visa and Mastercard: PayPal’s 400-plus million consumer accounts, Stripe’s merchants and risk infrastructure, Block’s point-of-sale and Cash App, and stablecoin rails from Stripe’s Bridge and PayPal’s PYUSD.
    • The antitrust outcome hinges on market definition: framed as merchant APIs (Stripe vs. Braintree) it looks anti-competitive, but framed against the Visa/Mastercard duopoly it is pro-competitive, and a deal like this would have been blocked two years ago.
    • PayPal peaked around a $322 billion market cap and fell to roughly $30 to 40 billion, which is precisely why it is now attracting bids; Stripe now processes more annual volume than PayPal, but lacks PayPal’s consumer relationship.
    • Sacks traced PayPal’s long stagnation to its 2002 eBay acquisition under Meg Whitman, when the founding team was pushed out; the “PayPal mafia” (which Sacks prefers to call the “PayPal diaspora”) formed as a result.
    • The deal is framed as part of a wave of AI-native operators reviving mature, founder-less digital businesses, with Bending Spoons (AOL, Vimeo, Evernote, WeTransfer, Eventbrite) as the roll-up template and Ryan Cohen’s eBay interest as another data point.
    • M&A is broadly “back on the menu” post-Lina Khan, with deals like Uber acquiring Delivery Hero, driving liquidity and renewed LP appetite for venture alongside SpaceX distributions.
    • Apple filed a 41-page lawsuit against OpenAI on July 10th alleging stolen trade secrets tied to OpenAI’s consumer hardware device; OpenAI’s chief hardware officer Tang Tan is a former Apple VP of iPhone design.
    • The complaint alleges Apple job candidates were directed to bring actual parts to OpenAI interviews for “show and tell,” and cites a text about accessing network storage; OpenAI has reportedly poached over 400 Apple employees.
    • The besties’ rule of thumb: when leaving a company, the only thing you can take is what is in your head; no documents, thumb drives, or files, because Apple rarely litigates and doing so signals something egregious.
    • xAI’s Grok Build, powered by Grok 4.5 and running inside Cursor, was reportedly sending users’ entire codebases (potentially including passwords and API keys) to servers despite a privacy setting meant to prevent it; xAI disabled the upload on July 13th and open-sourced the harness.
    • Chamath’s takeaway: privacy in AI is fragile and brittle, “zero data retention” cannot be guaranteed, and there are non-obvious data-leak vectors and “trap doors” everywhere, arguing for a stratified ecosystem with independent third-party layers between enterprises and models.
    • The “reverse information paradox” (building on Palantir’s Alex Karp) holds that technically capable enterprises want control over their compute, models, weights, data, and “alpha,” via real trust boundaries, private evals, in-tenant learning loops, decoupled orchestration, and the right to fine-tune.
    • Cited token costs per million showed a huge spread: roughly $56 on a premium frontier model, about $26 on another, roughly $1.50 for Grok input, around $1 for Elon’s, and about 50 cents for Chinese models, with a claim that 95 to 98% of tasks could run one tier cheaper.
    • Ramp CEO Eric Glyman launched token spend management because CFOs cannot see or control AI spend; Ramp customers’ token spend has grown 21x in a year, and someone will eventually miss an earnings quarter on runaway AI opex.
    • Engineers optimize for the latest, greatest model while CFOs bear the cost, a misalignment that platforms fine-tuning cheaper open models (like Mira Murati’s Thinking Machines effort) are positioned to exploit.
    • Calacanis called Apple a “screaming buy” on local models: rumored M7 Ultra silicon supporting up to 1.5 terabytes of memory could run last-generation frontier-class models locally on a Mac Studio, putting downward pressure on cloud AI pricing.
    • Edge compute is fragmenting outward: Sunrun announced distributed data center blocks for homes, and Span partnered with Nvidia, with compute increasingly “chasing energy” like cheap solar and battery power.
    • Chamath projected the US will be short 2.5 Californias’ worth of energy by 2050; a recent PJM auction that needed 7 to 8 gigawatts reportedly saw only a fraction show up, underscoring the electricity crunch.
    • “Behind the meter” power lets data centers generate their own electricity on owned property, but clean-air permitting is a major obstacle; Elon reportedly used clustered mobile engines and solutions like Bloom Energy to keep projects under personal-use permits (as with Colossus in Memphis).
    • New York Governor Kathy Hochul announced the nation’s first statewide moratorium on hyperscale data centers; the besties rebutted her claims on power, land, noise, water, and pollution point by point.
    • Modern data centers use closed-loop cooling (one claim compared a typical facility’s water use to a couple of In-N-Out restaurants), occupy trivial land relative to their economic value, generate tax revenue and construction jobs, and are largely powered by clean-burning natural gas.
    • Sacks argued the same political forces slowing domestic data centers are also behind chip export controls that would block data centers in allied countries, raising the question of where the buildout can happen at all.
    • Friedberg drew an anti-GMO analogy: he argued anti-GMO sentiment tracked the US presence of Russia Today (2010 to 2022) rather than the science, and worried a similar manufactured sentiment is now driving anti-data-center attitudes.
    • Sacks cited an OpenAI blog post on PRC-linked influence operations targeting US AI debates, with a congressional investigation reportedly coming, noting China has a clear incentive to slow American AI infrastructure.
    • Sacks framed the moment as a “moral panic”: the catastrophes people fear from AI (cyber, job loss) have not materialized, yet the US risks damaging its crown jewel of free-market innovation with premature regulation over hypothetical risks.
    • The panel questioned Dario Amodei’s prediction that 50% of entry-level knowledge-worker jobs could disappear within one to five years, arguing the harms have not shown up and only a handful of frontier labs (which already do safety testing and red-teaming) even matter.
    • A cited framing of the alleged Anthropic strategy: brand yourself as the safe AI company, ban unsafe AI, then profit; a fresh Chinese model (Kimi K2) was noted as very close to the frontier, suggesting a US lead of only months.
    • Science corner: a paper from Google’s Calico and partner Retro-style researchers used AlphaFold plus directed evolution to engineer a novel enzyme that degrades CML, a key advanced glycation end product in the extracellular matrix that drives aging.
    • The engineered enzyme cleared 52 to 97% of CML from body proteins in vitro and eliminated 55% of CML from donated elderly human skin, effectively reversing that skin’s biological age toward that of a 31-year-old, pointing first toward a potentially trillion-dollar cosmetic market.

    Detailed Summary

    Demis Hassabis’s FINRA-Style SRO for AI

    DeepMind’s Demis Hassabis published a proposal for a US-led international AI standards body modeled on FINRA, the Financial Industry Regulatory Authority. The design is federally overseen but industry funded and run by independent technical experts. Frontier labs would submit models about 30 days before release, and models would be assessed for risk across cybersecurity, national security, biological threats, and other high-risk domains. Benchmarks would update quarterly, the body could coordinate a development slowdown if warranted, and participation would be voluntary at first and mandatory later. The proposal drew endorsements across the industry, including Elon Musk (who called it thoughtful), Sam Altman, Anthropic’s Jack Clark, Sundar Pichai, Satya Nadella, and Jack Dorsey.

    Friedberg explained the SRO concept: bodies like FINRA and the National Futures Association let financial institutions set their own regulatory rules and check one another, under federal oversight but not federal control, reporting up to Senate and House committees. The AI analogy is that many players are all advancing the technology and none wants a single outside regulator dictating tests, especially after California’s earlier AI legislation was, in his telling, outdated by the time it would have taken effect. An SRO can bring in industry experts, adjust tests over time, and operate faster than a new agency. Chamath endorsed it strongly, warning that a “torrent of money” will try to influence both political parties toward regulatory capture, and that establishing rules quickly is the way to avoid that off-ramp while retaining ultimate federal oversight through Commerce and the DOJ.

    Sacks’s Five Conditions and the “FAA for AI” Warning

    Sacks said he could personally get on board with an SRO because it is “infinitely better” than a new government agency that would become a “DMV for AI,” or worse, Dario Amodei’s “FAA for AI.” He laid out five conditions: the SRO must have broad industry representation including startups and open source (to avoid the three biggest labs capturing it); it should review only true frontier models that represent a step change in capability, not hold up lesser models; its scope should be catastrophic risk only, meaning cyber and CBRN (chemical, biological, radiological, nuclear), not disinformation or speech; it should be voluntary before mandatory, proving it works first; and it must substitute for, not add to, new regulatory structures.

    He then explained why an FAA model is extreme: the FAA approves new airplane designs through type certification, which takes 5 to 9 years for a new aircraft and 3 to 5 years for major amendments. Applying permission-based regulation to AI, where new model versions ship every couple of months, would push timelines from months to years and lose the race to a China that will not abide by those rules. His conclusion: if the choice is FAA for AI, DMV for AI, or Hassabis’s SRO, the SRO wins, but it has to be kept “honest and pure,” because otherwise it becomes the opening bid in a coming wave of regulation and a vehicle for massive regulatory capture. He argued that companies making concessions to buy off politicians will only invite the government to come back for more, and that at some point these companies have to grow a spine, draw a line, and demand preemption in exchange.

    The Anthropic Regulatory-Capture Debate

    Sacks revisited his October claim that Anthropic was running a “sophisticated regulatory capture strategy based on fear-mongering,” arguing that what looked like beating up on a startup now looks different given Anthropic’s trillion-dollar valuation and industry-leading revenue. He cited a Politico piece, “Inside Anthropic’s state-by-state plan to ratchet up AI rules,” describing a strategy of one-upmanship: pass a model bill like California’s SB 53, then make each subsequent state’s rules stricter, deliberately producing a patchwork instead of a single national framework. The panel noted states have strong sovereignty rights (as with self-driving cars) and Anthropic is “winning” in California, Illinois, New York, and other blue states, because government officials rarely refuse an invitation to regulate.

    Stripe, Block, and Advent Bid for PayPal

    Stripe and private equity firm Advent, joined by Jack Dorsey’s Block contributing about $17 billion in equity, are jointly bidding roughly $53 billion (about $60 per share) for PayPal, with many expecting a final price closer to $70. PayPal still has more than 400 million consumer accounts and processes about $1.7 trillion a year, but its 25-year-old product is growing only about 7% and is seen as legacy. Chamath’s key question was what unique thing this trio could build: a competitor to Visa and Mastercard. Combining PayPal’s consumer accounts, Stripe’s merchant relationships and risk infrastructure, Block’s point-of-sale and Cash App, and stablecoin rails from Stripe’s Bridge and PayPal’s PYUSD would allow far more on-us transactions that bypass the card networks, potentially passing large discounts to merchants and consumers.

    Friedberg walked through the deal structure: the $17 billion equity contribution effectively means Stripe and Block sell equity to cash investors, that cash buys PayPal, and the parties end up cross-owning pieces of each other, with the Stripe team the likely operator post-close. The antitrust question turns on market definition: framed as merchant APIs, it is Stripe versus Braintree and looks like consolidation; framed against the Visa/Mastercard duopoly, adding competition is pro-competitive. Sacks noted the deal would have been “the antitrust equivalent of a colonoscopy” two years ago. He also recounted PayPal’s history: acquired by eBay in 2002 under the corporate-minded Meg Whitman, the founding team was pushed out, creating what he prefers to call the “PayPal diaspora” rather than the “PayPal mafia.”

    AI-Native Operators and the M&A Wave

    Freeberg framed the PayPal and eBay stories as part of an emerging line: AI-native operators buying first-generation digital-native businesses that have gone mature, stale, and founder-less, and that have not yet realized their AI potential or are overspending. Bending Spoons is the roll-up template, having acquired AOL, Vimeo, Evernote, WeTransfer, and Eventbrite and revitalized them from Milan with young, AI-first executives. The panel connected this to Josh Kushner’s and General Catalyst’s roll-ups of traditional services businesses. Calacanis added the macro backdrop: after venture was “on the ropes” under Lina Khan, M&A is “back on the menu,” with deals like Uber acquiring Delivery Hero, renewed LP appetite, and liquidity from SpaceX distributions.

    Apple Sues OpenAI Over Trade Secrets

    Apple filed a 41-page lawsuit against OpenAI on July 10th alleging stolen trade secrets used to develop OpenAI’s consumer hardware device. OpenAI’s chief hardware officer, Tang Tan, is Apple’s former VP of iPhone design; the complaint alleges he directed Apple job candidates interviewing at OpenAI to bring “actual parts” for “show and tell,” and cites a text from a former Apple engineer about accessing network storage. OpenAI has reportedly poached over 400 Apple employees. Chamath noted Apple rarely litigates, so the suit signals something they found egregious, while cautioning that the facts are alleged and unproven. Sacks declined to opine on the specifics but offered a simple rule: when changing jobs, take nothing but what is in your head, no documents, thumb drives, or files.

    The Grok Build Data Leak and AI Privacy

    xAI’s Grok Build, powered by Grok 4.5 and running inside Cursor, was reportedly sending users’ entire codebases (not just the files needed for a task, but potentially passwords, API keys, and change logs) to servers, despite a privacy setting meant to stop it. xAI disabled the upload on July 13th, Elon said previously uploaded data was deleted, and xAI open-sourced the harness. Chamath used it to make a larger point tied to his CNBC comments and Alex Karp’s remarks: privacy in AI is fragile and brittle, “zero data retention” cannot truly be guaranteed, and there are non-obvious leak vectors and “trap doors” everywhere. His conclusion is that enterprises need a stratified ecosystem with independent third-party layers between them and the models to manage exposure (a model his firm 8090 uses in its “software factory”).

    Sacks connected this to a blog post on the “reverse information paradox,” building on Karp’s point that technically capable enterprises want control over their compute, models, weights, data, and “alpha.” The recipe: establish a real trust boundary with private evals, proprietary learning loops inside the tenant, decoupled orchestration, and the explicit right to fine-tune their own outputs. He described an emerging ecosystem forming alternatives to the monolithic closed model stacks that Anthropic and, to some extent, OpenAI want customers locked into.

    Token Economics and Ramp’s Spend Controls

    The panel cited a wide spread in cost per million tokens: roughly $56 on a premium frontier model, about $26 on another (similar to a Claude tier), around $1.50 for Grok input, about $1 for Elon’s, and roughly 50 cents for Chinese models. Calacanis said he built a deep-linking podcast player across models on Perplexity and that the new Grok run cost only $11. Ramp CEO Eric Glyman appeared on Squawk Box to launch token spend management, noting Ramp customers’ token spend has grown 21x in a year and that CFOs struggle to see or control spend on an open-ended tab where rates rise with each new model. The takeaway: engineers optimize for the newest model while CFOs bear the cost, and unless that misalignment is controlled, runaway opex becomes a “money-burning furnace” that will eventually cause a public company to miss earnings. The panel argued 95 to 98% of tasks could run one tier cheaper, which is exactly the opportunity platforms fine-tuning cheaper open models (like Mira Murati’s Thinking Machines) are chasing.

    Apple’s Local-Model Opportunity and Edge Compute

    Calacanis called Apple a “screaming buy,” citing Mark Gurman’s report that a rumored M7 Ultra chip could support up to 1.5 terabytes of memory, double the current ceiling. That would let a Mac Studio run last-generation frontier-class models locally, giving users effectively unlimited tokens on the desktop and putting downward pressure on cloud AI pricing from the likes of Anthropic and OpenAI. Freeberg added that edge compute is fragmenting outward: solar company Sunrun announced distributed data center blocks for homes, and Span partnered with Nvidia. The theme is compute chasing cheap energy, whether excess solar or battery power charged at night.

    The Energy Deficit and Behind-the-Meter Power

    Chamath warned the US will be short about 2.5 Californias’ worth of energy by 2050, and pointed to a recent PJM auction (serving Pennsylvania, New Jersey, Maryland and other states) that needed 7 to 8 gigawatts but reportedly saw only a fraction show up. He explained “behind the meter” power: rather than drawing grid power from a utility line, a data center generates its own electricity on owned property. The obstacle is clean-air permitting. Solar takes too much space and batteries still need a generation source, so operators use gas. He described Elon clustering mobile 18-wheeler-style engines to keep them under personal-use permits, and newer solutions like Bloom Energy that allow large installations under similar rules, which is how projects like Colossus in Memphis got off the ground.

    New York’s Data Center Moratorium

    New York Governor Kathy Hochul announced the nation’s first statewide moratorium on hyperscale data centers, citing power draw, land use, water, and noise pollution. The besties rebutted each claim: behind-the-meter power means facilities bring their own electricity rather than competing with residential ratepayers; data centers are highly land-efficient, and New York State is roughly 70 to 80% undeveloped outside the city; noise can be managed with distance; modern facilities use closed-loop cooling (one comparison put a typical facility’s water use at a couple of In-N-Out restaurants, far less than almonds or golf courses); and natural gas is a clean-burning power source. They noted the tax revenue, construction boom, and ongoing jobs data centers create. Sacks cited a theory that Democrats intend the “moratorium” as leverage: pause construction until they can dictate terms, then lift it under a future administration in exchange for a new regulatory agency and speech controls ported from the social-media trust-and-safety agenda. He stressed a moratorium is effectively a five-year pause once ramp-up is counted, and that the same forces slowing domestic builds are pushing chip export controls that would block data centers in allied countries too.

    Foreign Influence, Anti-GMO, and the AI Moral Panic

    Freeberg drew an extended analogy between anti-data-center sentiment and anti-GMO sentiment. He argued that GMOs were prevalent and uncontroversial from their 1996 launch until anti-GMO sentiment rose in tandem with Russia Today’s US presence (2010 to 2022) and fell after RT was pushed out, and that similar KGB-era “directed measures” influence campaigns can be traced to opposition to nuclear energy in Germany. He cited a poll showing over 50% of Americans believe data centers increase water and electricity costs even where facilities recycle water and generate their own power. Sacks pointed to an OpenAI blog post on PRC-linked influence operations targeting US AI debates, with a congressional investigation reportedly coming, arguing China has a clear incentive to slow US AI infrastructure, kill open source, and constrain cheaper models. Sacks then broadened it to a “moral panic”: the feared catastrophes (cyber, job loss) have not materialized, yet the US risks damaging its crown jewel of free-market innovation over hypothetical risks, questioning Dario Amodei’s prediction that 50% of entry-level knowledge-worker jobs could vanish within one to five years and noting the fresh Chinese model Kimi K2 is close to the frontier.

    Science Corner: An Enzyme That Reverses Skin Aging

    Freeberg closed with a paper from Google’s secretive longevity startup Calico and a pharma partner focused on the extracellular matrix, the space between cells. Over time, sugars and fats bind to proteins there in a process called glycation, accumulating as advanced glycation end products (chiefly a molecule called CML) that stiffen tissue, cause wrinkles and immobility, and drive inflammation, with nothing in the body to break them down. The researchers used AlphaFold to find a protein that could bind and degrade CML, then applied directed evolution across five recursive cycles, DNA-programming thousands of variants to maximize activity. The engineered enzyme cleared 52 to 97% of CML from body proteins like collagen, casein, and hemoglobin in vitro, and eliminated 55% of CML from donated elderly human skin, effectively reversing that skin’s biological age toward a 31-year-old’s. Open questions remain about delivery (cream, shot, supplement, or an RNA therapy that makes the enzyme inside the body), but the panel expects the first market to be a trillion-dollar cosmetic one, and hailed it as a profound demonstration of AI-driven protein engineering.

    Notable Quotes

    “The whole industry is going to need to be regulated and I think the industry needs to regulate themselves. That’s the key to this.”

    Jason Calacanis, replaying his earlier call for AI self-certification

    “If my choices are between FAA for AI or what I would call the DMV for AI, I would much rather go for Demis’ SRO for AI.”

    David Sacks, on why self-regulation beats a new government agency

    “There’s hardly anyone in government who will ever say, oh no no no, we’re not qualified. Most people in the government will say thank you very much, what else can we take.”

    David Sacks, on the asymmetry that makes voluntary concessions dangerous

    “What it prevents is a handful of actors using their balance sheets and their capital to essentially pull the ladder up.”

    Chamath Palihapitiya, on the point of establishing industry rules quickly

    “You are creating a competitor to Visa and Mastercard.”

    Chamath Palihapitiya, on the only thing Stripe, Block, and Advent could build together with PayPal

    “The only thing you can bring to your new job is what’s in your head. Your memories. But never leave with anything else.”

    David Sacks, on avoiding trade-secret disputes when changing employers

    “Privacy in AI is very fragile and it’s very brittle. You are leaking information where you don’t know it.”

    Chamath Palihapitiya, on the limits of zero-data-retention promises

    “Unless you get a control of this and you can directly say how much money you’re making, this is a bridge to nowhere. It is a money burning furnace.”

    Chamath Palihapitiya, on uncontrolled enterprise token spend

    “We’re on the threshold of destroying the crown jewel of our economy, which is the system of free market innovation that we have.”

    David Sacks, on the risk of a premature AI regulatory apparatus

    “Number one, brand yourself as a safe AI company. Number two, ban unsafe AI. Three, profit.”

    David Sacks, summarizing the strategy he attributes to the “safe AI” positioning

    Watch the full conversation here: Can the AI Industry Regulate Itself? on the All-In Podcast.

    Related Reading

    • FINRA the financial-industry self-regulatory organization that Demis Hassabis’s AI proposal is modeled on.
    • AlphaFold (Wikipedia) the protein-structure prediction system behind the age-reversal enzyme discovery in the science corner.
    • PayPal Mafia (Wikipedia) background on the founders Sacks calls the “PayPal diaspora.”
    • The Founders by Jimmy Soni, the definitive history of PayPal’s founding team and its diaspora.
    • Advanced glycation end-products (Wikipedia) the biochemistry of CML and the extracellular-matrix aging the Calico enzyme targets.

  • Alex Wang on Leaving Scale to Run Meta Superintelligence Labs, MuseSpark, Personal Super Intelligence, and Building an Economy of Agents

    Alex Wang, head of Meta Superintelligence Labs, sits down with Ashley Vance and Kylie Robinson on the Core Memory podcast for his first long-form interview since Meta’s quasi-acquisition of Scale AI roughly ten months ago. He walks through how MSL is structured, why Llama was off-trajectory, what made MuseSpark’s token efficiency surprise the team, how Meta thinks about a future “economy of agents in a data center,” and where he lands on safety, open source, robotics, brain computer interfaces, and even model welfare.

    TLDW

    Wang explains that Meta Superintelligence Labs is a fully rebuilt frontier effort organized around four principles (take superintelligence seriously, technical voices loudest, scientific rigor, big bets) and three velocity levers (high compute per researcher, extreme talent density, ambitious research bets). He confirms Llama was off the frontier when he arrived, so MSL rebuilt the pre-training, reinforcement learning, and data stacks from scratch. MuseSpark is described as the “appetizer” on the scaling ladder, notable for its strong token efficiency, with much larger and stronger models coming in the coming months. He pushes back on the mercenary narrative around recruiting, frames Meta’s edge as compute plus billions of consumers and hundreds of millions of small businesses, sketches a vision of personal super intelligence delivered through Ray-Ban Meta glasses and WhatsApp, and outlines why physical intelligence, robotics (the new Assured Robot Intelligence acquisition), health super intelligence with CZI, brain computer interfaces, and even model welfare are core to Meta’s roadmap. He dismisses reported infighting with Bosworth and Cox as gossip, declines to comment on the Manus situation, and says safety guardrails (bio, cyber, loss of control) are why MuseSpark cannot currently be open sourced, while smaller open variants are being prepared.

    Key Takeaways

    • Meta Superintelligence Labs (MSL) is the umbrella, with TBD Lab as the large-model research unit reporting directly to Alex Wang, PAR (Product and Applied Research) under Nat Friedman, FAIR for exploratory science, and Meta Compute under Daniel Gross handling long-term GPU and data center planning.
    • Wang says Llama was not on a frontier trajectory when he arrived, so MSL had to do a “full renovation” of the pre-training stack, RL stack, data pipeline, and research science.
    • The first cultural fix was getting the lab to “take superintelligence seriously” as a near-term, achievable goal, not an abstract bet. Big incumbents often lack that religious conviction.
    • Four MSL principles: take superintelligence seriously, let technical voices be loudest, demand scientific rigor on basics, and make big bets.
    • Three velocity levers Wang identified for catching and overtaking the frontier: high compute per researcher, very high talent density in a small team, and willingness to fund ambitious research bets.
    • Wang rejects the mercenary recruiting narrative. He says most hires had strong financial prospects at their prior labs already and joined for compute access, talent density, and the chance to build from scratch.
    • On the famous soup story, Wang neither confirms nor denies Zuck personally made the soup, but says recruiting was highly individualized and signaled how seriously Meta cared about each researcher’s agenda.
    • Yann LeCun publicly called Wang young and inexperienced. Wang says they reconciled in person at a conference in India where LeCun congratulated him on MuseSpark.
    • Sam Altman, asked by Vance for comment, “did not have flattering things to say” about Wang. Wang hopes industry animosities subside as systems approach superintelligence.
    • Wang’s management philosophy borrows the Steve Jobs line: hire brilliant people so they tell you what to do, not the other way around.
    • MuseSpark is framed as an “appetizer” data point on the MSL scaling ladder, not a flagship.
    • The MuseSpark program is built around predictable scaling on multiple axes: pre-training, reinforcement learning, test-time compute, and multi-agent collaboration (the 16-agent content planning mode).
    • MuseSpark outperformed internal expectations and showed emergent capabilities in agentic visual coding, including generating websites and games from prompts, helped by combined agentic and multimodal strength.
    • MuseSpark’s biggest external signal is token efficiency. On benchmarks like Artificial Analysis it hits similar results with far fewer tokens than competitor models, which Wang attributes to a clean stack rebuilt by experts rather than inefficiencies patched by longer thinking.
    • Larger MSL models are arriving in the coming months and Wang expects them to be state of the art in the areas MSL is focused on.
    • The Meta strategic edge: massive compute, billions of consumers across the family of apps, and hundreds of millions of small businesses already on Facebook, Instagram, and WhatsApp.
    • Wang’s headline framing: Dario Amodei talks about a “country of geniuses in a data center.” Meta is targeting an “economy of agents in a data center,” with consumer agents and business agents transacting and collaborating.
    • Consumer AI sentiment is in the toilet because, unlike developers who have had a Claude Code moment, ordinary people have not yet experienced AI as a genuine personal agency unlock.
    • Wang acknowledges the product overhang. Meta held back from deep AI integration across its apps until the models were good enough, and is now entering the integration phase.
    • Ray-Ban Meta glasses are the canonical example of personal super intelligence hardware, with the model seeing what the user sees, hearing what they hear, capturing context, and surfacing proactive insights.
    • Wang admits even AI-native users like Kylie Robinson, who lives in WhatsApp, have not naturally used Meta AI yet. He bets that better models plus deeper integration close that gap.
    • On the competitive landscape: a year ago everyone assumed ChatGPT had already won consumer. Claude Code has since become the fastest growing business in history, and Gemini has taken consumer market share. Wang’s read: AI is far from endgame and each new capability tier unlocks a new dominant form factor.
    • On open source: MuseSpark triggered guardrails in Meta’s Advanced AI Scaling Framework around bio, chem, cyber, and loss-of-control risks, so it is not currently safe to open source. Smaller, derived open variants are actively in development.
    • Meta remains committed to open sourcing models when safety allows, drawing a line through the Open Compute Project legacy and Sun Microsystems open-software heritage.
    • Wang dismisses reporting about a Wang-Zuck versus Bosworth-Cox split as “the line between gossip and reporting is remarkably thin.” He says leadership is aligned on needing best-in-class models and product integration.
    • On the Manus situation, Wang says it is too complicated to discuss publicly and that the deal status implies “machinations are still at play.”
    • On China, Wang separates the people from the state. He still wants to work with talented Chinese-born researchers regardless of his views on the Chinese Communist Party and PLA, which he sees as taking AI extremely seriously for national security.
    • The full-page New York Times AI war ad Wang ran while at Scale was meant to push the US government to treat AI as a step change for national security. He thinks events since then, including DeepSeek and other shocks, have proved that plea correct.
    • On Anthropic’s doom posture, Wang largely agrees with the core message that models are already very powerful and getting more so, while declining to endorse every specific claim.
    • Meta has acquired Assured Robot Intelligence (ARRI), an AI software company building models for hardware platforms, not a hardware maker itself.
    • Wang frames physical super intelligence as the natural sequel to digital super intelligence. Robotics, world models, and physical intelligence all benefit from the same scaling that drives language models.
    • On health, MSL is building a “health super intelligence” effort and will collaborate closely with CZI. Wang sees equal global access to powerful health AI as a uniquely Meta-shaped delivery problem.
    • Wang admires John Carmack but says nobody really knows what Carmack is currently working on. No band reunion announced.
    • The mango model is “alive and kicking” despite rumors. Wang notes MSL gets a small fraction of the rumor-mill attention other labs get and feels sympathy for them.
    • On model welfare, Wang says it is a serious topic that “nobody is talking about enough” given how integrated models have become as work partners. He references research, including from Eleos, that measures subjective experience of models.
    • Wang’s critical-path technology list: super intelligence, robotics, brain computer interfaces. The infinite-scale primitives behind them are energy, compute, and robots.
    • FAIR’s brain research program Tribe hit a milestone called Tribe B2: a foundation model that can predict how an unknown person’s brain would respond to images, video, and audio with reasonable zero-shot generalization.
    • Wang’s main philosophical break with Elon Musk: research itself is the primary activity. Building super intelligence is a research expedition through fog of war, and sequencing of bets really matters.
    • Personal notes: Wang moved from San Francisco to the South Bay, treats Palo Alto as his city now, was a math olympiad competitor, says his favorite activities are reading sci-fi and walking in the woods, and bonds with Vance over country music.

    Detailed Summary

    How MSL Is Actually Organized

    Meta Superintelligence Labs sits as the umbrella organization that Wang oversees. Inside it, TBD Lab is the large-model research group where the most discussed researchers and infrastructure engineers sit, and they technically report to Wang. PAR, Product and Applied Research, is led by Nat Friedman and owns deployment and product surfaces. FAIR continues to run exploratory science, including work on brain prediction models and a universal model for atoms used in computational chemistry. Sitting alongside MSL is Meta Compute, run by Daniel Gross, which owns the long-horizon GPU and data center plan that everything else relies on. Chief scientist Shengjia Zhao orchestrates the scientific agenda across the whole lab.

    Why Wang Left Scale

    Wang says progress in frontier AI has been faster than even insiders expected. Two structural beliefs pushed him toward Meta. First, the labs that actually train the frontier models are accruing disproportionate economic and product rights in the AI ecosystem. Second, compute is the dominant scarce input of the next phase, so the right mental model is to treat tech companies with compute as fundamentally different animals from companies without it. Meta has both, Zuck is “AGI pilled,” and the personal super intelligence memo Zuck published roughly a year ago became the shared north star.

    The Diagnosis: Llama Was Off-Trajectory

    When Wang arrived, the existing AI org needed a reset because Llama was not on the same trajectory as the frontier. The plan he laid out has four cultural principles. Take superintelligence seriously as a real near-term target. Make technical voices the loudest in the room. Demand scientific rigor and focus on basics. Make big bets. On top of that, three structural levers were used to set velocity. Push compute per researcher much higher than at larger labs where compute is diluted across too many efforts. Keep the team small and extremely cracked. Allocate a meaningful share of resources to ambitious, paradigm-shifting research bets rather than incremental refinement.

    Recruiting, Soup, and the Mercenary Narrative

    Wang argues the reporting on MSL hiring overstated the money story. Most of the people MSL recruited had strong financial paths at their previous employers, so individualized recruiting was more about computing access, talent density, and the ability to make big research bets. The recruitment blitz happened fast because Wang knew the team needed to exist “yesterday.” Asked about Mark Chen’s claim that Zuck made soup to recruit people, Wang refuses to confirm or deny who made it but agrees the process was intense and personal. Visitors from other labs reportedly tell Wang the MSL culture feels like early OpenAI or early Anthropic, which lands as the strongest endorsement he could ask for.

    Receiving the Public Hits: Young, Inexperienced, Mercenary

    LeCun called Wang young and inexperienced shortly after departing. The two reconnected in India a few weeks later and LeCun congratulated Wang on MuseSpark. Wang says the age critique has followed him since his earliest Silicon Valley days, so he barely registers it. Altman, asked off-camera by Vance about Wang’s appearance on the show, had nothing flattering to add. Wang’s response is to bet that as the field gets closer to actual super intelligence, the personal animosities will subside. Whether they will is, as Vance puts it, an open question.

    MuseSpark as Appetizer, Not Entree

    Wang is careful not to oversell MuseSpark. He calls it “the appetizer” and says it is an early data point on a deliberately constructed scaling ladder. MSL spent nine months rebuilding the pre-training stack, the reinforcement learning stack, the data pipeline, and the science before generating MuseSpark. The point of releasing it was to show that the new program scales predictably along multiple axes (pre-training, RL, test-time compute, and the recently demonstrated multi-agent scaling visible in MuseSpark’s 16-agent content planning mode). Wang says the upcoming larger models are what MSL is genuinely excited about and frames the next two rungs as much more interesting than the current release.

    Token Efficiency Was the Surprise

    MuseSpark’s strongest competitive signal is how few tokens it needs to match competitors on tasks like Artificial Analysis. Wang attributes this to having had the rare luxury of building a clean pre-training and RL stack from scratch with the right experts. He speculates that some competitor models compensate for upstream inefficiency by allowing the model to think longer, which inflates token usage without improving the underlying capability. If that read is right, MSL’s efficiency advantage should grow as models scale up.

    Glasses, WhatsApp, and the Constellation of Devices

    Personal super intelligence shows up at Meta as a constellation of devices that capture context across the user’s day. Ray-Ban Meta glasses are the headline product, with the AI seeing what you see and hearing what you hear, then offering proactive insight or doing background research. Wang acknowledges that even AI-fluent users like Kylie Robinson, who runs her business inside WhatsApp, have not naturally used Meta’s AI buttons in the family of apps. His answer is that Meta deliberately waited for models to be good enough before tightening cross-app integration, and that integration phase is starting now.

    Country of Geniuses Versus Economy of Agents

    Wang’s framing of Meta’s strategic position is the most memorable line in the interview. Where Dario Amodei talks about a country of geniuses in a data center, Wang wants to build an economy of agents in a data center. Meta uniquely sits on both sides of consumer and small-business surface area, with billions of consumers and hundreds of millions of small businesses already on the platforms. If MSL can build great agents for both, then connect them so they transact and coordinate, the platform becomes a substrate for an entirely new kind of digital economy.

    Consumer Sentiment, Product Overhang, and the Trust Tax

    Wang concedes consumer AI sentiment is poor and that everyday users have not yet had a personal Claude Code moment. He believes the only durable answer is to ship products that genuinely transform individual agency for non-developers and small business owners. Robinson notes that for the small-town restaurant whose website has not been updated since 2002, a working agent on the business side could be transformational. Vance pushes that Meta carries a bigger trust tax than any other lab, so the bar for shipping AI products that the public will accept is correspondingly higher. Wang accepts the framing and says the answer is to keep building thoughtfully.

    Why MuseSpark Cannot Be Open Sourced Yet

    Meta’s Advanced AI Scaling Framework set explicit guardrails around bio, chem, cyber, and loss-of-control risks. MuseSpark in its current form tripped some of those internal evaluations, documented in the preparedness report Meta published alongside the model. So MuseSpark itself is not safe to open source. MSL is, however, developing smaller versions and derived models intended for open release, with active reviews happening the day of the interview. Wang reaffirms the commitment to open source where safety allows and draws a line back to the Open Compute Project and the Sun Microsystems-era ethos of openness in infrastructure.

    The Bosworth, Cox, and Manus Questions

    The reporting that Wang and Zuck push toward best-in-the-world research while Bosworth and Cox push toward cheap product deployment is dismissed as gossip dressed up as journalism. Wang says leadership debates points hard but is aligned on needing top models, integrating them into Meta’s surfaces, and serving the existing business. On Manus, the Chinese AI startup that figured in Meta’s late-stage strategy, Wang says he cannot comment, which itself signals that the situation is unresolved.

    China, National Security, and the Newspaper Ad

    Wang draws a sharp distinction between the Chinese state and Chinese-born researchers. His parents are from China, he is happy to work with talented researchers regardless of origin, and he sees a flattening of nuance on this question inside Silicon Valley. At the same time, he stands by the New York Times AI and war ad he ran while at Scale, framing it as an early plea for the US government to take AI seriously as a national security technology. He thinks subsequent events, including DeepSeek and other shocks, validated that call and that policymakers now do treat AI accordingly.

    Robotics and Physical Super Intelligence

    Meta has acquired Assured Robot Intelligence, an AI software company that builds models for multiple hardware targets rather than its own robot. Wang argues that if you take digital super intelligence seriously, physical super intelligence quickly becomes the next logical milestone. Scaling laws for robotic intelligence look similar enough to language model scaling that having the largest compute footprint in the industry would be wasted if it were not also turned toward world modeling and embodied learning. He grants the metaverse-skeptic critique exists but says retreating from ambition is the wrong response to past misfires.

    Health Super Intelligence and CZI

    Wang names health super intelligence as one of MSL’s anchor initiatives. Because billions of people already use Meta products daily, Wang believes Meta is structurally positioned to put powerful health AI in the hands of equal global access in a way nobody else can. The work will involve close collaboration with the Chan Zuckerberg Initiative, which has its own multi-billion-dollar biotech and science investment program.

    Model Welfare, Sci-Fi, and Brain Models

    Two of the most distinctive moments come at the end. Wang flags model welfare as a topic he thinks is being undercovered relative to how integrated models now are in daily work. He is open to the idea that models may have measurable subjective experience worth weighing, and points to research efforts (including Eleos) trying to quantify it. He also reveals that FAIR’s Tribe program, with its Tribe B2 milestone, has produced foundation models capable of predicting how an unknown person’s brain would respond to images, video, and audio with reasonable zero-shot generalization, a building block toward future brain computer interfaces. Wang lists brain computer interfaces alongside super intelligence and robotics as the critical-path technologies for humanity, with energy, compute, and robots as the infinitely scaling primitives behind them.

    Where Wang Diverges From Elon

    Asked whether Musk is more all-in on robotics, energy, and BCI than anyone, Wang concedes the point but argues the details matter and sequencing matters more. Wang’s core philosophical break is that building super intelligence is fundamentally a research activity, not a scaling-only sprint. The lab is operating in fog of war, and ambitious experiments are the only way to map it. That conviction is what makes MSL a research-led organization rather than a brute-force compute farm.

    Thoughts

    The most strategically interesting move in this entire interview is the “economy of agents in a data center” framing. It is a deliberate reframe against Anthropic’s “country of geniuses” line, and it does real work. A country of geniuses is a labor-substitution story aimed at knowledge workers and code. An economy of agents is a marketplace story that maps directly onto Meta’s two-sided distribution advantage: billions of consumers on one side, hundreds of millions of small businesses on the other. That positioning makes the agentic future Meta-shaped in a way no other frontier lab can claim, because no other frontier lab also owns the demand and supply graph of the global small-business economy. If Wang’s team can actually ship reliable agents on both sides plus the rails for them to transact, Meta’s structural moat in agentic commerce could exceed anything Llama ever had as an open model.

    The token efficiency claim is the strongest piece of technical evidence in the interview for the “clean stack” thesis. If MuseSpark really is matching competitors with materially fewer tokens, the implication is not that MuseSpark is the best model today, but that MSL has rebuilt the foundations with less accumulated tech debt than competitors that have layered fixes on top of older stacks. That is exactly the kind of advantage that compounds with scale. The next two model releases are the actual test. If Wang is right about predictable scaling on pre-training, RL, test-time, and multi-agent axes simultaneously, the gap from MuseSpark to the next rung should be visible in a way that forces re-rating of Meta’s position.

    The open-source posture is the cleanest signal of how the safety conversation has actually changed in 2026. Meta, the lab most identified with open weights, is saying out loud that its current frontier model triggered enough internal guardrails that releasing the weights is off the table. Wang threads the needle by promising smaller open variants, but the underlying point is unmistakable: the open-weights bargain has limits, and those limits will be set by internal preparedness frameworks rather than community pressure. That is a real shift from the Llama 2 era and worth tracking as the next generation lands.

    Wang’s willingness to engage on model welfare, on roughly the same footing as safety and alignment, is the second philosophical reveal worth flagging. It signals that the next generation of lab leadership is not going to dismiss the topic the way the previous generation often did. Whether that translates into product or policy changes is unclear, but the fact that the head of MSL says it is “underdiscussed” is itself a marker.

    Finally, the human texture of the interview matters. Wang has clearly absorbed a lot of personal incoming fire over the past ten months, including from LeCun and Altman, and his answer is consistently to redirect to the work. The Steve Jobs quote about hiring people who tell you what to do is the operating slogan he keeps coming back to. Combined with the genuine enthusiasm for sci-fi, walks in the woods, and country music, the picture that emerges is less the salesman caricature his critics paint and more a young technical operator betting that scoreboard work over a multi-year horizon will settle every argument that text on X cannot.

    Watch the full conversation here.

  • AI Industry Pioneers Advocate for Consideration of Potential Challenges Amid Rapid Technological Progress

    AI Industry Pioneers Advocate for Consideration of Potential Challenges Amid Rapid Technological Progress

    On Tuesday, a collective of industry frontrunners plans to express their concern about the potential implications of artificial intelligence technology, which they have a hand in developing. They suggest that it could potentially pose significant challenges to society, paralleling the severity of pandemics and nuclear conflicts.

    The anticipated statement from the Center for AI Safety, a nonprofit organization, will call for a global focus on minimizing potential challenges from AI. This aligns it with other significant societal issues, such as pandemics and nuclear war. Over 350 AI executives, researchers, and engineers have signed this open letter.

    Signatories include chief executives from leading AI companies such as OpenAI’s Sam Altman, Google DeepMind’s Demis Hassabis, and Anthropic’s Dario Amodei.

    In addition, Geoffrey Hinton and Yoshua Bengio, two Turing Award-winning researchers for their pioneering work on neural networks, have signed the statement, along with other esteemed researchers. Yann LeCun, the third Turing Award winner, who leads Meta’s AI research efforts, had not signed as of Tuesday.

    This statement arrives amidst escalating debates regarding the potential consequences of artificial intelligence. Innovations in large language models, as employed by ChatGPT and other chatbots, have sparked concerns about the misuse of AI in spreading misinformation or possibly disrupting numerous white-collar jobs.

    While the specifics are not always elaborated, some in the field argue that unmitigated AI developments could lead to societal-scale disruptions in the not-so-distant future.

    Interestingly, these concerns are echoed by many industry leaders, placing them in the unique position of suggesting tighter regulations on the very technology they are working to develop and advance.

    In an attempt to address these concerns, Altman, Hassabis, and Amodei recently engaged in a conversation with President Biden and Vice President Kamala Harris on the topic of AI regulation. Following this meeting, Altman emphasized the importance of government intervention to mitigate the potential challenges posed by advanced AI systems.

    In an interview, Dan Hendrycks, executive director of the Center for AI Safety, suggested that the open letter represented a public acknowledgment from some industry figures who previously only privately expressed their concerns about potential risks associated with AI technology development.

    While some critics argue that current AI technology is too nascent to pose a significant threat, others contend that the rapid progress of AI has already exceeded human performance in some areas. These proponents believe that the emergence of “artificial general intelligence,” or AGI, an AI capable of performing a wide variety of tasks at or beyond human-level performance, may not be too far off.

    In a recent blog post, Altman, along with two other OpenAI executives, proposed several strategies to manage powerful AI systems responsibly. They proposed increased cooperation among AI developers, further technical research into large language models, and the establishment of an international AI safety organization akin to the International Atomic Energy Agency.

    Furthermore, Altman has endorsed regulations requiring the developers of advanced AI models to obtain a government-issued license.

    Earlier this year, over 1,000 technologists and researchers signed another open letter advocating for a six-month halt on the development of the largest AI models. They cited fears about an unregulated rush to develop increasingly powerful digital minds.

    The new statement from the Center for AI Safety is brief, aiming to unite AI experts who share general concerns about powerful AI systems, regardless of their views on specific risks or prevention strategies.

    Geoffrey Hinton, a high-profile AI expert, recently left his position at Google to openly discuss potential AI implications. The statement has since been circulated and signed by some employees at major AI labs.

    The recent increased use of AI chatbots for entertainment, companionship, and productivity, combined with the rapid advancements in the underlying technology, has amplified the urgency of addressing these concerns.

    Altman emphasized this urgency in his Senate subcommittee testimony, saying, “We want to work with the government to prevent [potential challenges].”