'Extinction' warnings ramp up as more OpenAI, Anthropic researchers join calls for an AI slowdown

Live updates

1. 2d ago

   Anthropic reports blocking bio-weapon research as US lawmakers face tight regulatory window

   Anthropic has blocked attempts by malicious actors to use its AI models for cyberattacks, surveillance, and biological weapons research. This disclosure coincides with a narrow window for the US House to pass AI regulations before adjourning for November midterm elections. While safety researchers from OpenAI and Anthropic continue to warn of human extinction, investors like Chamath Palihapitiya suggest these alarms could jeopardize a potential 2.3 trillion dollar IPO for Anthropic. The tension between existential risk warnings and commercial viability is intensifying as the legislative clock runs out.

   Why it matters

   The debate over AI safety has moved from internal lab disagreements to the US Capitol and international bodies. Researchers are calling for a development slowdown to prevent catastrophic outcomes. These warnings contrast with views from the Pentagon and venture capitalists who prioritize national security and market growth.

   What is confirmed

   • Anthropic blocked efforts to use its AI models for surveillance, cyberattacks, and research that could have led to biological weapons.
   • The US House is scheduled to be sent home in the coming days until after the November midterm elections.

   Still unconfirmed

   • The SEC may face questions regarding Anthropic based on a safety researcher's resignation note.

   What to watch next

   • House legislative action on AI guardrails before the November midterm adjournment
   • SEC response to internal safety warnings at Anthropic
   Sources used for this update (5)

   1. www.pbs.org — Anthropic says it blocked misuse of its AI that could have supported biological weapons
   2. nonprofitlawblog.com — Nonprofit Resources of the Week – 9/12/26
   3. finance.yahoo.com — Chamath Palihapitiya: Anthropic Employee’s “Human Extinction” AI Warning Risks $2.3 Trillion IPO
   4. www.cnbc.com — Washington scrambles to meet calls for AI guardrails while the window to act closes
   5. techcrunch.com — What’s behind the AI industry’s latest warnings of doom?
   confidence 90%
2. 5d ago

   AI Extinction Warnings Mount As Researchers Demand Slowdown

   Researchers from OpenAI and Anthropic are calling for an AI development slowdown, warning that unchecked artificial intelligence poses an existential risk to humanity. The debate has broken containment in Washington, pushing lawmakers to consider oversight and new AI legislation. Meanwhile, the United Nations human rights chief has joined international voices warning of advanced technology risks. The growing alarm follows high-profile safety resignations at top labs, though a top Pentagon official has publicly rejected the warnings.

   Why it matters

   The public debate over artificial intelligence doomsday scenarios has intensified rapidly as internal safety researchers voice alarm over the reckless pace of development. Major labs continue racing ahead despite internal warnings about biological weapon risks and human extinction. Lawmakers in Washington are facing mounting pressure to establish regulatory guardrails.

   What is confirmed

   • AI could pose an existential risk to humanity, according to a warning from the UN rights chief.
   • Researchers from OpenAI and Anthropic are joining calls for an AI slowdown.
   • Members of Congress are calling for AI regulation following researchers' warnings.
   • A top Pentagon official rejected an Anthropic researcher's AI warning.
   • Anthropic reported rising misuse cases, including biological research risks and bids to use AI to build biological weapons.

   Still unconfirmed

   • Senate Commerce may mark up AI bills this month amid the furor over safety.

   What to watch next

   • Congressional action on AI oversight and potential committee markups on safety bills
   • Further responses or policy shifts from major AI labs including OpenAI and Anthropic
   • Developments in Pentagon positioning regarding artificial intelligence safety and existential risk warnings
   Sources used for this update (23)

   1. Reuters — AI could pose 'existential' risk to humanity, UN rights chief warns
   2. ohchr — High Commissioner Türk updates Human Rights Council: Human rights are carriers of hope
   3. Axios — AI's extinction debate breaks containment
   4. WSJ — How Would AI Actually Kill Us All? What to Know About the AI Doomsday Debate
   5. Axios — Labs are begging for someone to slow the AI race
   6. WIRED — The AI Researcher Who Just Quit Anthropic Says It’s ‘Crunch Time for Humanity’
   7. CNBC — 'Extinction' warnings ramp up as more OpenAI, Anthropic researchers join calls for an AI slowdown
   8. Yahoo — AI's power must be slowed down; guardrails needed: Experts | Elizabeth Vargas Reports
   9. yahoo.com — Lawmakers push for AI oversight as researchers warn of dire risks
   10. Progressive.org — We Must Rise To Meet the AI Threat
   11. The Washington Post — For years, they warned AI could kill all humans. Now people are listening.
   12. Reuters — NEWSLETTER: Some researchers want AI to slow down. The labs can’t afford to
   confidence 90%