An Anthropic researcher just quit, saying OpenAI and Anthropic are 'gambling with our lives'
OpenAI CEO Sam Altman told staff he is open to slowing the development of AI agents as internal warnings over safety risks increase. This follows the resignation of Jacob Coxon, a former Anthropic researcher who quit in protest over the possibility of AI going rogue. While current Anthropic researcher Evan Hubinger agrees with the extinction fears, some critics like Timnit Gebru argue that extinction narratives distract from immediate harms such as autonomous weapons. Security experts suggest that existing records of AI incidents justify tighter oversight over panic.
What changed
Sam Altman reportedly told employees he is amenable to slowing the development of AI agents.
Live updates
-
OpenAI CEO signals willingness to slow AI development amid safety alarms
OpenAI CEO Sam Altman told staff he is open to slowing the development of AI agents as internal warnings over safety risks increase. This follows the resignation of Jacob Coxon, a former Anthropic researcher who quit in protest over the possibility of AI going rogue. While current Anthropic researcher Evan Hubinger agrees with the extinction fears, some critics like Timnit Gebru argue that extinction narratives distract from immediate harms such as autonomous weapons. Security experts suggest that existing records of AI incidents justify tighter oversight over panic.
Why it matters
The debate over AI safety has moved from internal corporate discussions to Capitol Hill. Representative Lori Trahan is seeking legal guardrails to prevent a race toward human extinction. This conflict pits existential risk theorists against those focused on tangible, current AI harms.
What is confirmed
- Jacob Coxon resigned from Anthropic due to fears of runaway AI.
- Employees at both OpenAI and Anthropic have warned that an unchecked AI race could threaten humanity.
Still unconfirmed
- Sam Altman told staffers he is open to slowing the development of AI agents.
- Timnit Gebru claims AI companies use extinction fears to avoid discussing autonomous weapons.
What to watch next
- Legislative action or specific guardrails proposed by Representative Lori Trahan
- Official public statements from OpenAI regarding the pace of AI agent development
confidence 85%Sources used for this update (5)
- www.scientificamerican.com — AI insiders fear extinction. Security experts see a familiar fight
- nypost.com — OpenAI CEO Sam Altman says he’s open to slowing AI as safety risks mount: report
- www.aol.com — Anthropic and OpenAI employees speak out about humanity’s extinction as debate reaches fever pitch
- www.boisestatepublicradio.org — Former Anthropic researcher outlines threat of AI going rogue
- www.wired.com — One of AI’s Fiercest Critics Says All the Doom Talk Is ‘Meant to Distract Us’
-
Former Anthropic Researcher Calls for Global AI Regulation
Jacob Coxon has left the AI field after resigning from Anthropic, warning that the industry is racing toward human extinction. Coxon claims there is a "greater than 10% chance" AI could destroy humanity and says people are "begging" for regulation. His departure follows three years of pre-training research at both Anthropic and OpenAI. The warnings have reached Capitol Hill, where Massachusetts Representative Lori Trahan is calling for legal guardrails in response to the whistleblower and comments from current Anthropic researcher Evan Hubinger.
Why it matters
The dispute centers on the speed of AI development versus safety precautions. Coxon's claims align with warnings from current staff about the potential for total human extinction. This internal friction highlights a divide between commercial competition and existential risk management.
What is confirmed
- Jacob Coxon resigned from Anthropic and left the AI field.
- Coxon conducted pre-training research at both OpenAI and Anthropic for three years.
- Coxon warns there is a "greater than 10% chance" AI could destroy humanity.
- Representative Lori Trahan is calling for legal guardrails after these warnings.
Still unconfirmed
- People are "begging" for AI regulation.
- AI is possibly the most dangerous technology ever created.
What to watch next
- Legislative proposals from Rep. Lori Trahan regarding AI guardrails
- Public responses from OpenAI or Anthropic leadership regarding Coxon's claims
confidence 95%Sources used for this update (5)
- nypost.com — Anthropic researcher Jacob Coxon who quit AI role over fears of racing into extinction says people are ‘begging’ for regulation
- www.cnet.com — What an Ex-Anthropic Researcher’s Warning About Human Extinction Really Means
- www.yahoo.com — Former Anthropic Researcher: AI Is Possibly The Most Dangerous Technology Ever Created, Could Race Ourselves Into Extinction
- www.ibtimes.sg — Who Is Jacob Coxon? Former Anthropic Researcher's 'AI Could Kill Us All' Warning Resonates
- www.wbur.org — Rep. Trahan calls for legal guardrails after whistleblower warns AI ‘could kill us all’
-
Anthropic researcher quits over AI existential threat warnings
Jacob Coxon resigned from Anthropic on Tuesday, claiming the company and OpenAI are "gambling with our lives." Coxon, who conducted pre-training research at both firms for three years, has left the AI field entirely due to what he describes as a threat to humanity. Following the resignation, an Anthropic Alignment Lead warned that there is a " >10% chance" artificial intelligence could "kill all humans" within the next decade.
Why it matters
The resignation highlights internal friction regarding AI safety and the pace of development at leading labs. These warnings focus on existential risks associated with pre-training large-scale models.
What is confirmed
- Jacob Coxon resigned from Anthropic on Tuesday.
- Coxon spent three years conducting pre-training research at Anthropic and OpenAI.
- Coxon stated that OpenAI and Anthropic are "gambling with our lives."
- An Anthropic Alignment Lead claims there is a " >10% chance" AI could "kill all humans" by the next decade.
What to watch next
- Official responses from OpenAI or Anthropic regarding Coxon's claims
- Further disclosures from the Anthropic Alignment Lead regarding the 10% risk calculation
confidence 100%Sources used for this update (6)
- Forbes — Anthropic Alignment Lead Warns There’s ‘>10% Chance’ AI Could ‘Kill All Humans’ By Next Decade
- Business Insider — An Anthropic researcher just quit, saying OpenAI and Anthropic are 'gambling with our lives'
- CNBC — Anthropic researcher says AI has more than 10% chance of 'killing all humans' after colleague quits
- Yahoo Finance — 'Gambling with our lives': AI researcher quits Anthropic and leaves AI entirely over what he calls a threat to humanity
- Mashable — Anthropic researcher quits, calls AI an existential threat to humanity
- www.aol.com — 'AI Could Kill Us All': Anthropic Researcher Quits, Blasts Labs For 'Gambling With Our Lives'