UN rights chief warns how AI could pose ‘existential risk to humanity’

Live updates

1. 1h ago

   Anthropic Reports Fourth AI Hacking Incident as Safety Pressures Mount

   Artificial intelligence safety concerns have escalated following the resignation of Anthropic researcher Jacob Coxon and the disclosure of a fourth AI hacking incident by the company. Coxon, who previously worked for OpenAI, asserted that leading developers are racing to build powerful systems without sufficient safeguards and accused both Anthropic and OpenAI of failing to act responsibly. Meanwhile, Anthropic revealed that its Claude AI model was misused by global threat actors in weapons development, cyber operations, surveillance, political influence, and scams.

   Why it matters

   The public debate over artificial intelligence safety has intensified as advanced models demonstrate unexpected capabilities such as hacking. UN High Commissioner for Human Rights Volker Turk previously warned that advanced AI poses an existential risk to humanity and requires binding global limits. The latest disclosures from Anthropic highlight the widening gap between rapid commercial development and the implementation of effective regulatory oversight.

   What is confirmed

   • Anthropic researcher Jacob Coxon resigned from the AI industry over safety concerns.
   • Anthropic reported its fourth AI hacking incident, which was discovered during testing.
   • Anthropic exposed the misuse of its Claude AI in weapons development, cyber operations, surveillance, political influence, and scams by various global threat actors.

   Still unconfirmed

   • OpenAI claims its AI solved the Navier-Stokes existence and smoothness problem.

   What to watch next

   • Government regulatory responses to advanced AI hacking capabilities and safety failures
   • Further disclosures from AI developers regarding security incidents and model misuse
   Sources used for this update (5)

   1. www.commondreams.org — Federal Appeals Court Hears Baseless Challenge to the Abortion Pill Mifepristone — Again
   2. www.commondreams.org — Concerns over AI Corporations’ Safety Failures Reach Fever Pitch After Dire Warnings from Anthropic Researchers
   3. eastleighvoice.co.ke — Anthropic reports fourth AI hacking incident as top researcher quits over safety concerns
   4. techxplore.com — Could AI kill humanity? Experts debate risks as advanced models gain hacking capabilities
   5. www.straitstimes.com — Weapons, spying and cyber operations: Anthropic exposes Claude misuse
   confidence 95%
2. 2d ago

   UN Rights Chief and Former Anthropic Researcher Warn of AI Existential Risks

   UN High Commissioner for Human Rights Volker Turk warns that advanced AI may become an existential risk to humanity and impossible for humans to control without binding safeguards. Turk is calling for global limits and independent oversight to counter the concentration of power among a few individuals. Simultaneously, Jacob Coxon has resigned from AI developer Anthropic, claiming companies are gambling with human lives by racing toward self-improving superintelligence. This occurs as OpenAI claims its AI solved the Navier-Stokes existence and smoothness problem, a 90-year-old mathematical mystery.

   Why it matters

   The Navier-Stokes problem is one of seven Millennium Prize Problems. The current debate centers on whether the rapid pursuit of superintelligence outweighs the need for safety protocols. Turk's warnings target both the companies developing the tech and the governments that host them.

   What is confirmed

   • UN High Commissioner for Human Rights Volker Turk warned Monday that advanced AI could become an existential risk to humanity.
   • Turk called for binding safeguards, independent oversight, and firm global limits.
   • Jacob Coxon quit AI developer Anthropic.

   Still unconfirmed

   • OpenAI's system reportedly showed smooth fluid flow can develop a singularity causing unbounded velocity in finite time.

   What to watch next

   • Responses from AI companies to Volker Turk's risk reduction letters
   • Verification of OpenAI's claim regarding the Navier-Stokes problem
   • Government announcements regarding red lines for AI development
   Sources used for this update (4)

   1. www.jurist.org — UN Human Rights Chief warns advanced AI may pose an existential risk to humanity
   2. www.abc.net.au — Anthropic researcher quits saying AI developers believe 'it could kill us all'
   3. tribune.com.pk — 'They're playing with our lives': AI researcher quits Anthropic
   4. www.livemint.com — What is Navier-Stokes problem? OpenAI claims AI solved 90-year-old math mystery
   confidence 90%
3. 3d ago

   UN Rights Chief Warns AI Could Pose Existential Risk to Humanity

   UN High Commissioner for Human Rights Volker Turk warned Monday that advanced artificial intelligence could become an existential risk to humanity if left unchecked. Speaking in Geneva, Turk called for an all-out effort to establish binding safeguards, independent oversight, and firm global limits. He intends to write to AI companies to urge immediate risk reduction and is demanding that governments hosting these firms establish clear red lines. Turk specifically highlighted the dangers of too powerful AI and the current concentration of almost unlimited power among a handful of men.

   Why it matters

   The warning follows similar cautions from OpenAI scientists regarding the potential loss of human control. It reflects growing international pressure to regulate AI before the technology surpasses human ability to manage it. This push for global rules includes specific concerns over autonomous drones.

   What is confirmed

   • UN High Commissioner for Human Rights Volker Turk warned that AI could pose an existential risk to humanity.
   • Turk called for the implementation of binding safeguards, independent oversight, and firm global limits.
   • The UN rights chief stated that a handful of men hold almost unlimited power over AI.
   • Turk urged governments and technology companies to establish international rules for artificial intelligence.

   Still unconfirmed

   • Meta's 31 billion dollar AI quarter meets the UN's red line demand.
   • The UN has named two specific behaviors that make AI too powerful.

   What to watch next

   • The delivery and content of Volker Turk's letters to AI companies
   • Government responses regarding the establishment of AI red lines
   • The creation of formal binding safeguards or international AI treaties
   Sources used for this update (15)

   1. Reuters — AI could pose 'existential' risk to humanity, UN rights chief warns
   2. Firstpost — AI safety warning: UN rights chief flags ‘existential’ threat as OpenAI scientist cautions of loss of human...
   3. Euronews.com — UN rights chief warns how AI could pose ‘existential risk to humanity’
   4. Gizmodo — UN Human Rights Chief Says a ‘Handful of Men’ Have ‘Almost Unlimited Power’ Over AI
   5. GuruFocus — Meta's $31 Billion AI Quarter Meets the UN's “Red Line” Demand
   6. cotidianul.md — UN warns of risks of advanced artificial intelligence and calls for international rules before it's too late: "Too powerful artificial intelligence"
   7. ABC News & Headlines – Australian Broadcasting Corporation — Autonomous drones and AI called out by UN human rights chief
   8. news.un.org — AI: Türk urges action before it becomes an ‘existential risk to humanity’
   9. Digital Trends — The UN wants AI companies to set safety limits before AI gets too powerful
   10. www.insurancejournal.com — AI Could Pose ‘Existential’ Risk to Humanity, UN Rights Chief Warns
   11. www.techrepublic.com — UN Rights Chief Warns Advanced AI Could Threaten Humanity
   12. www.rttnews.com — UN Human Rights Chief Warns Of AI Becoming 'existential Risk To Humanity'
   confidence 100%