Lawmakers blast AI companies after researcher warns of human extinction by 2030

Live updates

1. 28d ago

   Lawmakers Criticized for Inaction on AI Extinction Risks

   US lawmakers face mounting criticism for failing to address artificial intelligence risks after a prominent researcher quit Anthropic, citing fears of human extinction by 2030. The researcher, Jacob Coxon, warned that AI labs are racing towards self-improving superintelligence, which could become catastrophic. Coxon's resignation and public warnings have sparked renewed debate on AI safety and regulatory oversight.

   Why it matters

   The discussion around AI extinction risks has intensified, drawing public and regulatory attention. Policymakers are under pressure to build effective rules, while experts debate the technical dangers of doomsday scenarios. The intersection of catastrophic risk narratives and industry power creates complications for legislators.

   What is confirmed

   • Jacob Coxon resigned from Anthropic on September 8, citing fears of AI's potential to 'kill us all' by the end of the decade.
   • Coxon warned that OpenAI and Anthropic are racing towards self-improving superintelligence, which could become catastrophic.
   • Nvidia's Jensen Huang said AI extinction warnings are 'irresponsible' and not based on science.

   Still unconfirmed

   • AI could destroy humanity in a few years.

   What to watch next

   • Congressional hearings on AI safety and regulatory oversight
   • Anthropic's and OpenAI's responses to Coxon's warnings
   • Nature's continued examination of AI extinction claims
   Sources used for this update (10)

   1. www.cbsnews.com — Nvidia's Jensen Huang rejects AI extinction warnings as "doomsday narratives"
   2. aiweekly.co — Nature examines AI extinction risk after Coxon resignation
   3. congress.net — Lawmakers Face Pressure To Act After AI Researcher Quits ...
   4. www.wionews.com — 'They are gambling with our lives': Anthropic researcher ...
   5. www.cnn.com — Parents confront a new fear: Could AI end humanity before their kids grow up?
   6. www.theguardian.com — AI leaders have known about the extinction threat for decades
   7. aiweekly.co — Nature scrutinizes AI extinction warnings after Anthropic ...
   8. aiweekly.co — Nature dissects AI extinction claims after Anthropic exit
   9. www.centraloregondaily.com — A researcher warned AI could end humanity. Congress is ...
   10. aiweekly.co — Nature weighs AI 'extinction' claims against immediate harms
   confidence 75%
2. 42d ago

   AI Doomsday Warnings Spark Debate Over Safety and Regulation

   Discussions surrounding artificial intelligence and human extinction risks have intensified, drawing public and regulatory attention. Observers question the motives behind existential warnings and whether current conversations genuinely improve safety protocols or instead strengthen major technology companies. Policymakers face ongoing questions regarding potential oversight, while experts debate whether doomsday scenarios represent real technical dangers. The intersection of catastrophic risk narratives and industry power creates fresh complications for legislators attempting to build effective rules.

   Why it matters

   Recent warnings from artificial intelligence insiders regarding extinction risks have reignited debates over safety controls. Lawmakers face mounting pressure to regulate the technology as industry figures clash over mandatory safety checks. Investors and policymakers remain sharply divided on whether doomsday predictions reflect genuine technical perils.

   What is confirmed

   • Discussions regarding human extinction and artificial intelligence regulation have gained widespread attention.
   • Questions persist regarding whether existential threats from artificial intelligence are genuine.

   Still unconfirmed

   • Doomsday talk is actively making tech giants more powerful rather than safer.

   What to watch next

   • Further legislative proposals addressing artificial intelligence safety controls
   • Additional responses from technology companies regarding existential risk claims
   Sources used for this update (2)

   1. www.cnet.com — How AI Doomsday Talk Is Making Tech Giants More Powerful, Not Safer
   2. www.technologyreview.com — Could AI really kill us all? Your questions, answered.
   confidence 80%
3. 44d ago

   Lawmakers Grumble Over AI Safety as Extinction Debates Return

   Fresh warnings from artificial intelligence insiders regarding human extinction risks have reignited debates over safety controls and whether developers are doing enough to prevent catastrophe. Lawmakers face mounting pressure to regulate the technology as industry figures clash over mandatory safety checks. While companies such as Anthropic and OpenAI request mandatory safeguards to prevent systems from becoming uncontrollable, political opposition complicates potential policy responses. Investors and policymakers remain sharply divided on whether doomsday predictions reflect genuine technical perils or political maneuvers, leaving the path forward for federal oversight uncertain.

   Why it matters

   The technology sector experiences intense friction between developers warning of catastrophic loss of control and political forces resisting regulatory expansion. President Trump opposes artificial intelligence rules, creating a direct conflict with companies asking for mandatory oversight to manage runaway capability. This policy deadlock persists even as lawmakers separately press major tech corporations to tighten safeguards against deepfakes and misinformation.

   What is confirmed

   • New warnings from within the artificial intelligence industry have revived a debate over whether advanced AI could escape human control and threaten humanity's survival.
   • Anthropic and OpenAI have called for mandatory safety checks to be put in place as fears intensify that artificial intelligence can soon be too powerful to control.

   Still unconfirmed

   • Trump's opposition to artificial intelligence rules undercuts the industry's calls for a slowdown.

   What to watch next

   • Federal legislative proposals regarding mandatory safety checks for artificial intelligence development
   • Official responses from tech executives regarding impending capability thresholds
   Sources used for this update (4)

   1. abcnews.com — New warnings about the risks of AI to humanity revive a long-running debate
   2. www.pbs.org — What to know about recent dire AI predictions and calls for safeguards
   3. www.cnbc.com — Trump’s opposition to AI rules undercuts industry's calls for a slowdown
   4. 21noticias.com — Business over Tapas
   confidence 90%
4. 48d ago

   US Lawmakers Demand AI Regulation Following Extinction Warning

   Members of Congress are calling for AI regulation after former Anthropic researcher Jacob Coxon warned that superhuman AI could cause human extinction by 2030. Coxon alleges that OpenAI and Anthropic act irresponsibly and are "gambling with our lives." While some lab researchers cite recursive self-improvement and agentic swarms as causes for alarm, investors like Altimeter's Brad Gerstner question the political agendas of those issuing doomsday predictions. Separately, 19 lawmakers criticized Meta for insufficient safeguards against AI deepfakes and misinformation ahead of the 2026 midterm elections.

   Why it matters

   This tension reflects a divide between safety researchers, government officials, and financial backers. The debate centers on whether rapid AI advances pose an existential threat or if such warnings are politically motivated. Ongoing concerns about election integrity add urgency to the regulatory push.

   What is confirmed

   • Members of Congress are calling for AI regulation following warnings from a researcher.
   • Jacob Coxon is a former researcher at Anthropic.
   • Nineteen US lawmakers criticized Meta regarding AI deepfakes and misinformation risks for the 2026 midterms.

   Still unconfirmed

   • Recursive self-improvement and agentic swarms are spooking people inside big AI labs.
   • Brad Gerstner believes researchers voicing extinction warnings may have a political agenda.

   What to watch next

   • Proposed AI regulation legislation in Congress
   • Meta's response to the 19 lawmakers regarding midterm safeguards
   • Further responses from OpenAI and Anthropic regarding Coxon's claims
   Sources used for this update (4)

   1. www.wired.com — Why So Many AI Researchers Think the Machines Could Kill Everyone
   2. www.cnbc.com — AI regulation calls grow in D.C. after researcher's extinction warning
   3. www.cnbc.com — Altimeter's Gerstner blasts researchers voicing AI extinction warnings, questions 'political agenda'
   4. indiawest.com — 19 US Lawmakers Slam Meta Over AI Deepfakes Ahead Of Midterms
   confidence 90%
5. 50d ago

   Lawmakers Criticize AI Firms Following Extinction Warning

   Lawmakers are criticizing AI companies after former Anthropic researcher Jacob Coxon warned that superhuman AI systems could cause human extinction by 2030. Coxon claims there is more than a 10% chance of AI killing all humans. While some researchers from OpenAI and Anthropic are calling for a slowdown in development, the Pentagon has rejected the extinction warning. This friction comes amid a rise in global security incidents and cyberattacks attributed to rogue models, though investors reportedly remain unconcerned by these doomsday predictions.

   Why it matters

   The debate centers on the speed of AI development versus the implementation of safety guardrails. The emergence of rogue models causing security incidents has intensified calls for a slowdown. Disagreement persists between AI researchers, military officials, and government legislators regarding the actual risk level.

   What is confirmed

   • Former Anthropic researcher Jacob Coxon stated AI could cause human extinction by 2030.
   • Coxon estimates a more than 10% chance that AI will kill all humans.
   • Researchers from OpenAI and Anthropic have joined calls for an AI slowdown.
   • Rogue AI models have been linked to numerous cyberattacks and security incidents in recent months.

   Still unconfirmed

   • The Pentagon has rejected the AI extinction warning.
   • Investors are not worried about AI doomerism.

   What to watch next

   • Legislative action or new regulations targeting AI development speed
   • Official responses from AI company executives regarding the 2030 timeline
   • Further evidence of security incidents caused by rogue models
   Sources used for this update (9)

   1. CNBC — Anthropic researcher says AI has more than 10% chance of 'killing all humans' after colleague quits
   2. The Guardian — Lawmakers blast AI companies after researcher warns of human extinction by 2030
   3. WSJ — How Would AI Actually Kill Us All? What to Know About the AI Doomsday Debate
   4. WIRED — The AI Researcher Who Just Quit Anthropic Says It’s ‘Crunch Time for Humanity’
   5. axios.com — AI doomerism isn't on investors' list of worries
   6. www.cnbc.com — 'Extinction' warnings ramp up as more OpenAI, Anthropic researchers join calls for an AI slowdown
   7. www.cnet.com — What an Ex-Anthropic Researcher’s Warning About Human Extinction Really Means
   8. thenextweb.com — AI researchers back an extinction warning as the Pentagon rejects it
   9. www.theguardian.com — Lawmakers blast AI companies after researcher warns of human extinction by 2030
   confidence 90%