Live Feeds
● LIVE Updated 10h ago · 8 sources tracked

AI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBC

Anthropic co-founder Jack Clark told the BBC that governments might need to mandate that AI companies maintain and prove the existence of a shutdown mechanism. This proposal comes as internal instability grows at major AI firms. Jacob Coxon recently resigned from Anthropic citing fears of out-of-control AI, while a Google researcher quit warning of immense harm within five years. These events have intensified the debate over whether frontier AI development must be paced or halted to ensure safety.

🎙️

Listen to Live Briefing

Real-time synthesized voice briefing · Live Feeds Desk

⏱ ~3 min
Speed:
RSS Source map (8)
⚡ Key Developments & Real-Time Context
Text size:
  • ✓ Anthropic co-founder Jack Clark stated that governments may need to force AI companies to maintain a shutdown mechanism and prove its existence.
  • ✓ Jacob Coxon resigned from Anthropic over fears that AI is becoming out-of-control.
🛡️ Source Corroboration: 8 independent reporting domains (90% confidence) ⏱ Read time: ~2 min

What changed

Jack Clark proposed mandatory, verifiable AI kill switches following the resignation of Anthropic researcher Jacob Coxon.

Live updates

  1. Anthropic Co-Founder Calls for Mandatory AI Kill Switches

    Anthropic co-founder Jack Clark told the BBC that governments might need to mandate that AI companies maintain and prove the existence of a shutdown mechanism. This proposal comes as internal instability grows at major AI firms. Jacob Coxon recently resigned from Anthropic citing fears of out-of-control AI, while a Google researcher quit warning of immense harm within five years. These events have intensified the debate over whether frontier AI development must be paced or halted to ensure safety.

    Why it matters

    Frontier AI development is accelerating toward a tipping point where safety mechanisms may become insufficient. Experts are now debating the technical requirements of an emergency stop and who holds the authority to trigger it. This movement reflects a broader push for verifiable safety rules across the industry.

    What is confirmed

    • Anthropic co-founder Jack Clark stated that governments may need to force AI companies to maintain a shutdown mechanism and prove its existence.
    • Jacob Coxon resigned from Anthropic over fears that AI is becoming out-of-control.

    Still unconfirmed

    • A Google AI researcher quit claiming there will be immense harm in five years.
    • Dario Amodei published an essay arguing for the need to pace the frontier of AI development.

    What to watch next

    • Government responses to the proposal for mandatory kill switch rules
    • Technical specifications for a verifiable AI shutdown mechanism
    • Further resignations from AI safety teams at frontier labs
    Sources used for this update (8)
    1. WSJ — Exclusive | Anthropic Researcher Quits Over ‘Out-of-Control’ AI Fears
    2. darioamodei.com — We Must Pace the Frontier
    3. The New York Times — Opinion | Dario Amodei’s Essay Was Gutsy. It Didn’t Go Far Enough.
    4. BBC — AI 'kill switch' may need to be mandatory, Anthropic co-founder says
    5. NDTV — 'Immense Harm In 5 Years': Google's AI Researcher Quits With Stark Warning
    6. time.com — The AI Tipping Point
    7. www.scientificamerican.com — What would an “AI kill switch” do?
    8. aiweekly.co — Anthropic Co-Founder Backs Verifiable AI Kill Switch Rules
    confidence 90%
📊

Community Sentiment: How do you assess this situation?

Voice your perspective · Real-time aggregated sentiment from the Live Feeds community