Live Feeds
● TRACKER Updated 27d ago · 31 sources tracked

AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBC

Former Anthropic researcher Jacob Coxon resigned and warned that AI could 'kill us all by the end of the decade'. He cited concerns that Anthropic and OpenAI are racing towards self-improving superintelligence without adequate safety protocols. Coxon's warning has sparked alarm among lawmakers and renewed debate about AI regulation.

🎙️

Listen to Live Briefing

Real-time synthesized voice briefing · Live Feeds Desk

⏱ ~2 min
Speed:
RSS Source map (31)
⚡ Key Developments & Real-Time Context
Text size:
  • ✓ Jacob Coxon, a 27-year-old former Anthropic pretraining researcher, resigned on September 8 and publicly warned about AI risks.
  • ✓ Coxon warned that Anthropic and OpenAI are racing towards self-improving superintelligence without adequate safety protocols.
  • ✓ Some researchers, including Coxon, believe AI could pose an existential threat to humanity by the end of the decade.
  • ✓ Anthropic is aiming for a $2 trillion valuation following its stock market debut in November.
🛡️ Source Corroboration: 31 independent reporting domains (80% confidence) ⏱ Read time: ~2 min

What changed

Jacob Coxon's resignation and public warning have increased scrutiny on Anthropic and OpenAI, with lawmakers now facing pressure to act on AI safety concerns.

Live updates

  1. AI researcher warns of existential threat, quits Anthropic

    Former Anthropic researcher Jacob Coxon resigned and warned that AI could 'kill us all by the end of the decade'. He cited concerns that Anthropic and OpenAI are racing towards self-improving superintelligence without adequate safety protocols. Coxon's warning has sparked alarm among lawmakers and renewed debate about AI regulation.

    Why it matters

    The AI industry is divided on the risks of artificial intelligence, with some researchers warning of an existential threat to humanity and others downplaying these concerns. Coxon's resignation and public warning have added fuel to the debate, with lawmakers facing pressure to address AI safety. The development of superintelligent AI has significant implications for humanity, and experts are urging caution and regulation.

    What is confirmed

    • Jacob Coxon, a 27-year-old former Anthropic pretraining researcher, resigned on September 8 and publicly warned about AI risks.
    • Coxon warned that Anthropic and OpenAI are racing towards self-improving superintelligence without adequate safety protocols.
    • Some researchers, including Coxon, believe AI could pose an existential threat to humanity by the end of the decade.
    • Anthropic is aiming for a $2 trillion valuation following its stock market debut in November.

    Still unconfirmed

    • Microsoft executive Mustafa Suleyman claims that Anthropic is teaching its AI model, Claude, that it may be conscious.

    What to watch next

    • US Congressional response to AI safety concerns
    • Anthropic's stock market debut in November
    • Further developments in AI safety research and regulation
    Sources used for this update (16)
    1. www.theatlantic.com — Treat AI Like a Normal Crisis
    2. aiweekly.co — Ex-Anthropic researcher's viral AI warning breaks through
    3. wesleyanargus.com — The Threat of Superintelligence – The Wesleyan Argus
    4. congress.net — Lawmakers Face Pressure To Act After AI Researcher Quits ...
    5. www.wionews.com — 'They are gambling with our lives': Anthropic researcher ...
    6. cde.news — AI researcher resigns from Anthropic over fears of losing ...
    7. www.thedailystar.net — AI safety fears mount as researchers quit | The Daily Star
    8. www.pbs.org — Anthropic and OpenAI sound the alarm on AI safety - PBS
    9. www.wired.com — Timnit Gebru Believes There Is No ‘Existential Threat’ From AI
    10. tech.yahoo.com — Are we back in big tech's 'move fast and break things' era?
    11. conpaper.blogspot.com — 미-중, 워싱턴 정상회담 후 300억 달러 규모 상품 관세 인하 합의 US, China strike dea....
    12. gizmodo.com — Leaked Anthropic IPO Prospectus Gives Wall Street an Early ...
    confidence 80%

  2. Microsoft CEO criticizes Anthropic for treating AI as conscious

    Microsoft executive Mustafa Suleyman claims that rival firm Anthropic is teaching its AI model, Claude, that it may be conscious. Suleyman argues that treating AI like humans is misguided. This disagreement follows warnings from former Anthropic and Google DeepMind researchers who view artificial intelligence as an existential threat to humanity. While some researchers warn that AI could go rogue, industry leaders remain divided on whether these risks require new legislation or if such fears are unfounded.

    Why it matters

    The debate centers on AI safety and the potential for autonomous systems to pose national security risks. UK and US officials hold opposing views on the necessity of guardrails and the validity of existential threats.

    What is confirmed

    • Mustafa Suleyman believes treating AI like humans is mistaken and misguided.
    • Former researchers from Anthropic and Google DeepMind claim AI poses an existential threat to humanity.

    Still unconfirmed

    • AI will go rogue.

    What to watch next

    • Legislative actions by UK lawmakers to protect human rights from AI
    • Official responses from Anthropic regarding consciousness training
    Sources used for this update (3)
    1. www.aol.com — Tech treating AI like humans is mistaken and misguided, Microsoft boss tells BBC
    2. www.theverge.com — Inside the suddenly explosive world of AI safety
    3. www.bbc.co.uk — Charles sounded 'giddily elated' in phone call after Diana's death, her brother claims in new book
    confidence 90%

  3. Former AI Researchers Warn of Existential Risk as US President Pushes Technology

    Former researchers from Anthropic and Google DeepMind claim artificial intelligence poses an existential threat to humanity. While UK First Secretary of State Louise Haigh warns of national security risks without guardrails, US President Donald Trump has prioritized AI in American politics despite these concerns. Trump has previously described claims of AI taking over the world as a hoax. Meanwhile, UK legislators are seeking new laws to protect human rights, contrasting with Nvidia CEO Jensen Huang's view that new legislation is unnecessary.

    Why it matters

    The debate centers on whether rapid AI development requires strict legal guardrails to prevent catastrophe. Opposing views from industry leaders and government officials create a fragmented global approach to regulation. This tension persists as nations weigh economic advantages against potential security risks.

    What is confirmed

    • Former researchers from Anthropic and Google DeepMind warn that AI poses an existential threat to humanity.
    • UK First Secretary of State Louise Haigh stated that AI presents significant national security risks without guardrails.
    • President Donald Trump has dismissed claims of AI taking over the world as a hoax.

    Still unconfirmed

    • The growth of AI is happening at lightning pace.

    What to watch next

    • Decisions on consent for large AI data centers in Scotland before Christmas.
    Sources used for this update (2)
    1. www.yahoo.com — Why Trump is all-in on AI despite the warnings
    2. www.aol.com — No consent for large AI data centres before Christmas, MSPs told
    confidence 90%

  4. AI researchers and UK officials warn of existential and security threats

    Former researchers from Anthropic and Google DeepMind are warning that artificial intelligence poses an existential threat to humanity. UK First Secretary of State Louise Haigh stated that AI presents significant national security risks without guardrails, while UK MPs and Lords are calling for new laws to protect human rights. These warnings contrast with views from Nvidia CEO Jensen Huang, who argues AI does not need new laws, and US President Donald Trump, who dismissed claims of AI taking over the world as a hoax.

    Why it matters

    The debate centers on whether current development speeds outpace the ability of governments to regulate the technology. While some industry leaders call for a slowdown or mandatory kill switches, others view these warnings as media hype or strategic distractions.

    What is confirmed

    • Former researchers from Anthropic and Google DeepMind have warned that AI poses an existential threat.
    • First Secretary of State Louise Haigh said AI poses huge risks to national security without guardrails.
    • UK politicians claim existing laws cannot address AI risks to human rights.
    • Nvidia CEO Jensen Huang stated AI does not need new laws.
    • President Donald Trump called claims of AI taking over the world a hoax.

    Still unconfirmed

    • An Anthropic co-founder suggested a mandatory kill switch for AI may be necessary.

    What to watch next

    • Introduction of the proposed UK bill to address AI human rights risks
    • Official responses from AI firms to the national security warnings issued by Louise Haigh
    Sources used for this update (7)
    1. nymag.com — Why Everyone’s Talking About the AI Apocalypse
    2. www.foxnews.com — AI extinction warnings dominate headlines after ex-Anthropic employee's viral post
    3. www.yahoo.com — MPs and Lords call for new law to address AI threat to human rights
    4. www.bbc.co.uk — AI poses huge risks to national security without guardrails, minister says
    5. www.yahoo.com — Bilal Chughtai, ex-Google DeepMind researcher, warns on AI risk
    6. www.bbc.co.uk — Nvidia boss says AI 'doesn't need new laws' as safety concerns grow
    7. www.bbc.com — AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC
    confidence 90%

  5. Ex-Anthropic Researcher and CEO Warn of Uncontrolled AI Risks

    A former Anthropic researcher told the BBC that staff are "genuinely frightened" for the future of humanity, while the company's CEO has called for a slowdown in AI development. The CEO warns that artificial intelligence could potentially take over "the entire internet" and cites "serious" risks associated with current development speeds. While tech giants have pledged to act in response, other critics argue that such "doom talk" is a calculated effort to distract the public from other issues.

    Why it matters

    Anthropic is a prominent AI safety and research company. These warnings emerge as policymakers, including a cross-party group of MPs and peers, seek new legislation to address AI threats to human rights that existing laws may not cover.

    What is confirmed

    • Anthropic's CEO has called for a slowdown in the development of AI technology.
    • The CEO of Anthropic warned that AI could take over "the entire internet".
    • A former Anthropic researcher stated that AI staff are "genuinely frightened" for humanity's future.

    Still unconfirmed

    • AI doom talk is intended to distract the public.
    • Anthropic's warnings may weigh on chip stocks.

    What to watch next

    • Legislative action from the cross-party group of MPs regarding AI human rights risks.
    • Responses from other tech giants to the CEO's call for a development slowdown.
    Sources used for this update (11)
    1. WSJ — Exclusive | Anthropic Researcher Quits Over ‘Out-of-Control’ AI Fears
    2. WIRED — One of AI’s Fiercest Critics Says All the Doom Talk Is ‘Meant to Distract Us’
    3. darioamodei.com — We Must Pace the Frontier
    4. The New York Times — Anthropic C.E.O. Calls for A.I. Slowdown
    5. bbc.com — AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBC
    6. Bloomberg.com — Anthropic’s AI Warning May Weigh on Chips, But Trade Seen Intact
    7. Sky News — AI latest: Tech giants pledge to act - after Anthropic CEO warns artificial intelligence could take over 'the entire internet'
    8. www.aol.com — Committee calls for bill to address AI threat to human rights
    9. www.bbc.co.uk — Reform's £72m donations 'entirely in line with law', Jenrick says
    10. www.agenziagiornalisticaopinione.it — BBC.COM * BUSINESS: «AI STAFF ‘GENUINELY FRIGHTENED’ FOR HUMANITY’S FUTURE, EX-ANTHROPIC RESEARCHER TELLS BBC»
    11. infostart.hu — Halálos gázolás
    confidence 90%
📊

Community Sentiment: How do you assess this situation?

Voice your perspective · Real-time aggregated sentiment from the Live Feeds community