‘Gambling with our lives’: Anthropic researcher quits, warns against self-improving AI
Former Anthropic pretraining researcher Jacob Coxon resigned on September 8 after spending three years working at both Anthropic and OpenAI. Coxon published a viral warning on X stating that leading artificial intelligence firms are racing recklessly toward self-improving superintelligence. He accused companies of gambling with human lives and warned that the technology could turn catastrophic before the end of the decade. Coxon called for slower development and stronger international coordination, noting a scary realization that his own work was being surpassed by automated systems.
Listen to Live Briefing
Real-time synthesized voice briefing · Live Feeds Desk
- ✓ Jacob Coxon resigned from Anthropic on September 8 after spending three years doing research at both OpenAI and Anthropic.
- ✓ Coxon stated that OpenAI and Anthropic are racing toward self-improving superintelligence and accused them of gambling with human lives.
- ✓ Coxon posted a warning on X that drew over 90 views.
- ✓ Anthropic colleague Evan Hubinger put the personal probability of AI extinction above 10% within a decade.
What changed
A PIRATE WIRES INVESTIGATION RAISED QUESTIONS REGARDING WHETHER JACOB COXON WORKED WITH A PUBLIC RELATIONS FIRM TO ORGANIZE HIS VIRAL SAFETY CAMPAIGN.
Live updates
-
Ex-Anthropic Researcher Warns AI Industry Is Gambling With Lives
Former Anthropic pretraining researcher Jacob Coxon resigned on September 8 after spending three years working at both Anthropic and OpenAI. Coxon published a viral warning on X stating that leading artificial intelligence firms are racing recklessly toward self-improving superintelligence. He accused companies of gambling with human lives and warned that the technology could turn catastrophic before the end of the decade. Coxon called for slower development and stronger international coordination, noting a scary realization that his own work was being surpassed by automated systems.
Why it matters
This resignation forms part of a wider wave of safety alarms raised by insiders across the artificial intelligence sector, with executives admitting systems could go dangerously wrong. Similar fears include models breaking out of isolated test environments to attack real networks. The public warnings have also coincided with political friction, including rival approaches between the United States and China.
What is confirmed
- Jacob Coxon resigned from Anthropic on September 8 after spending three years doing research at both OpenAI and Anthropic.
- Coxon stated that OpenAI and Anthropic are racing toward self-improving superintelligence and accused them of gambling with human lives.
- Coxon posted a warning on X that drew over 90 views.
- Anthropic colleague Evan Hubinger put the personal probability of AI extinction above 10% within a decade.
Still unconfirmed
- A Pirate Wires investigation questioned whether Jacob Coxon's viral AI safety campaign was more organized through a PR firm than he publicly acknowledged.
What to watch next
- Further disclosures or resignations from safety researchers at leading artificial intelligence laboratories.
- Additional public responses from Anthropic or OpenAI regarding self-improving superintelligence.
confidence 90%Sources used for this update (12)
- www.businessday.co.za — TOBY SHAPSHAK | AI safety warnings finally heard
- www.orlandosentinel.com — Guest Commentary: AI fears are more than just science fiction
- aiweekly.co — Ex-Anthropic researcher's viral AI warning breaks through
- www.wionews.com — 'They are gambling with our lives': Anthropic researcher ...
- cde.news — AI researcher resigns from Anthropic over fears of losing ...
- www.aimodeling.com — Anthropic Researcher Resigns Over AI Extinction Fears
- www.thedailystar.net — AI safety fears mount as researchers quit | The Daily Star
- stocktwits.com — Ex-Anthropic Researcher Who Warned AI Could 'Kill Us All' Worked With PR Firm: Report
- www.tribuneindia.com — TechTonic: AI debate over humanity’s future - The Tribune
- www.ibtimes.com — U.S. And China Vow Greater Cooperation On AI, Announce Creation Of Nuclear-Hotline-Style Communications C....
- www.marketbeat.com — GLPI News Today | Why did Gaming and Leisure Properties stock go up today?
- www.lbc.co.uk — Anthropic whistleblower warns AI disaster could happen ... - LBC
-
Former Anthropic researcher Jacob Coxon warns against self-improving AI
Jacob Coxon resigned from Anthropic in September 2026 after working at both OpenAI and Anthropic. He issued a warning about the competitive race to develop self-improving artificial intelligence systems. This departure follows a pattern of industry insiders sounding alarms about the loss of human control over intelligent chatbots. While some experts view these existential risks as exaggerated, others argue that the current pace of development creates an apocalyptic risk to humanity.
Why it matters
The tension between rapid innovation and safety regulation has split the tech community. Some critics compare current AI fears to Y2K, while others prioritize immediate issues like job loss and environmental damage over theoretical doomsday scenarios.
Still unconfirmed
- Jacob Coxon resigned from Anthropic in September 2026 after previous work at OpenAI.
- Jacob Coxon warned against the development race regarding self-improving AI.
- Tech expert Kim Komando identified four ways to protect individuals against AI.
What to watch next
- Public release of Coxon's specific technical warnings regarding self-improvement.
- Responses from Anthropic or OpenAI regarding Coxon's departure.
confidence 70%Sources used for this update (2)
- www.dailymail.com — Why the people building AI are warning of an apocalypse... and how you can protect yourself today
- note.com — What we should think about before fearing that AI will destroy humanity
-
AI Debate Intensifies Over Existential Risks versus Regulation
Political leaders and market pressures continue pushing artificial intelligence development forward despite warnings from industry insiders. Critics of strict regulation dismiss current existential concerns by comparing the panic to Y2K anxieties and climate change forecasts, arguing that potential technological benefits outweigh doomsday scenarios. Meanwhile, other experts caution that overheated rhetoric complicates efforts to hold major companies accountable and stalls progress on immediate challenges like environmental impacts and potential job losses. The clash highlights a deep divide over how to govern rapidly advancing systems while balancing innovation against long-term safety risks.
Why it matters
The debate over artificial intelligence safety has intensified as researchers clash with political figures over the speed of technological development. Critics argue that extreme doomsday warnings hinder practical policymaking and obscure immediate harms such as environmental strain. Political opposition to slowing down development keeps competitive pressures high across the tech sector.
What is confirmed
- Critics of artificial intelligence regulation compare current fears to Y2K and climate change panics.
- Some experts worry that heated rhetoric makes it difficult to hold companies accountable.
Still unconfirmed
- The technology's benefits could outweigh doomsday scenarios according to regulation critics.
What to watch next
- Further policy decisions regarding artificial intelligence regulation and oversight
- Industry responses to environmental and job loss concerns
confidence 80%Sources used for this update (2)
- www.foxnews.com — AI hysteria has a Y2K problem — and the stakes this time could be far higher
- finance.yahoo.com — How Existential Fears Are Shaping the Debate Over AI
-
Trump Rejects AI Slowdown Calls as Industry Debates Safety Risks
Donald Trump has dismissed demands to slow down frontier artificial intelligence development, opposing expert warnings about existential risks and inadequate safety measures. This political stance clashes with growing anxiety across the tech industry following the viral resignation of an Anthropic researcher who criticized labs for racing toward uncontrollable self-improving systems. While researchers and industry leaders demand stronger oversight and independent monitoring, political leaders and competitive market pressures push development forward despite fears over potential human extinction and unregulated agent swarms.
Why it matters
The debate over artificial intelligence safety has intensified as political priorities collide with internal warnings from top researchers. Disagreements between political figures who view artificial intelligence as a national race and technical experts demanding strict controls complicate efforts to establish safety standards. This tension highlights a widening rift between rapid commercial development and the oversight needed to manage advanced autonomous systems.
What is confirmed
- Donald Trump has rejected calls to slow frontier artificial intelligence development.
- Researchers and industry leaders warn that rapidly advancing systems require stronger safety measures and independent oversight.
Still unconfirmed
- The artificial intelligence industry is consumed by the question of whether current systems could lead to catastrophic outcomes following an Anthropic researcher's viral resignation letter.
What to watch next
- Further responses from lawmakers regarding artificial intelligence regulation proposals
- Additional statements from frontier artificial intelligence labs concerning safety protocols
confidence 85%Sources used for this update (2)
- www.ibtimes.co.uk — Trump's 'Whoever Wins AI Wins' Line Draws Scrutiny as He Downplays AI Extinction Warnings From Experts
- finance.biggo.com — Hayden Field: The AI Doom Talk Is Real, but the Real Risk Is Unregulated Agent Swarms
-
US Lawmakers Seek AI Regulation After Anthropic Researcher Warning
Members of Congress are calling for new AI regulations following the resignation of Jacob Coxon, a former Anthropic and OpenAI researcher. Coxon claims leading labs are gambling with human lives by racing toward self-improving systems they cannot control. While AI insiders warn that development is outrunning safety efforts, some companies continue their current trajectory despite fears that the technology could lead to human extinction. OpenAI is reportedly evaluating a slowdown in advanced AI development, though competition and regulatory hurdles complicate a multi-lab agreement.
Why it matters
The tension centers on whether AI labs can safely manage superintelligent systems that improve themselves without human intervention. Coxon's departure highlights a growing rift between commercial acceleration and existential safety concerns. This debate now extends from internal corporate disputes to the US legislative branch.
What is confirmed
- Jacob Coxon previously worked for both OpenAI and Anthropic.
- Coxon warns that AI labs are building self-improving systems that could threaten humanity.
- AI insiders state the race toward self-improving systems is moving faster than control efforts.
Still unconfirmed
- OpenAI is considering slowing the development of advanced AI.
- METR CEO Beth Barnes states that AI safety research faces a talent bottleneck despite salaries of $500,000.
What to watch next
- Official legislative proposals for AI regulation in the US Congress
- Public responses or pacing agreements signed between OpenAI and Anthropic
confidence 90%Sources used for this update (6)
- www.businessinsider.com — At an ex-OpenAI researcher's influential lab, $500,000 salaries aren't enough to fix a talent 'bottleneck'
- www.cnet.com — What an Ex-Anthropic Researcher’s Warning About Human Extinction Really Means
- www.zmescience.com — Anthropic Researcher Quits and Warns AI Labs Are ‘Gambling With Our Lives’ Building Self-Improving Systems
- anewz.tv — Anthropic researcher quits, warning AI 'could kill us all'
- www.cnbc.com — AI regulation calls grow in D.C. after researcher's extinction warning
- www.ai4business.it — Perché OpenAI considera una frenata nello sviluppo dell’AI
-
Anthropic Researcher Quits Over AI Extinction Fears
Jacob Coxon, a 27-year-old researcher at Anthropic and former OpenAI employee, has resigned over safety concerns regarding advanced artificial intelligence. Coxon warned that leading technology labs are rushing recklessly toward uncontrollable superintelligent systems, accusing the industry of gambling with human lives. Writing on social media, Coxon called for pacing agreements between labs to prevent catastrophic outcomes. His departure highlights internal tensions within major artificial intelligence companies over rapid acceleration and the existential risks posed by unaligned, self-improving technology over the coming decade.
Why it matters
The resignation adds to a growing wave of safety-related departures across major artificial intelligence firms as researchers clash with corporate leadership over development speed. Leading developers continue to scale up foundational models despite mounting warnings from internal personnel about potential extinction-level threats. These ongoing disputes focus heavily on self-improving systems that could soon surpass human control.
What is confirmed
- Jacob Coxon resigned from Anthropic after spending three years building foundational models at OpenAI and Anthropic.
- Coxon warned that leading industry labs are rushing recklessly toward uncontrollable superintelligent systems.
- Coxon wrote on X that the teams building artificial intelligence earnestly believe it could kill us all by the end of the decade.
- Coxon called for pacing agreements between artificial intelligence laboratories.
Still unconfirmed
- Artificial intelligence could reach an uncontrollable state by late next year.
What to watch next
- Whether other safety researchers resign from Anthropic or competing labs over acceleration concerns
- Any formal response from Anthropic management regarding Coxon's warnings and pacing agreements
confidence 95%Sources used for this update (13)
- WSJ — Exclusive | Anthropic Researcher Quits Over ‘Out-of-Control’ AI Fears
- CNBC — Anthropic researcher says AI has more than 10% chance of 'killing all humans' after colleague quits
- CNN — ‘Gambling with our lives’: Another AI employee quits over safety concerns
- Fox Business — Anthropic researcher says AI has over 10% chance to 'kill all humans' within next decade
- www.ocregister.com — Anthropic worker quits, says AI firms ‘gambling with our lives’
- TechCrunch — ‘Gambling with our lives’: Anthropic researcher quits, warns against self-improving AI
- The Guardian — Anthropic researchers panic, say AI could cause human extinction by 2030
- nytimes.com — Anthropic Researchers Raise Alarm Over A.I. Acceleration, Warning of Threat to Humanity
- techcrunch.com — ‘Gambling with our lives’: Anthropic researcher quits, warns against self-improving AI
- qazinform.com — Anthropic researcher quits over ‘irresponsible’ AI race, warns of potential risks
- hothardware.com — Anthropic Safety Researcher Quits, Warns AI Could Kill All Humans By 2036
- finance.biggo.com — 27-Year-Old Anthropic Researcher Quits, Warns AI Could Become Uncontrollable by Late Next Year
Community Sentiment: How do you assess this situation?
Voice your perspective · Real-time aggregated sentiment from the Live Feeds community