AI getting more powerful 'by the day' and kill switch should be required, tech boss tells BBC
California Governor Gavin Newsom signed an executive order to examine emergency shutdown mechanisms and independent verification for AI models. This move follows calls from Microsoft President Brad Smith for mandatory kill switches and incident-report laws. Smith argues that AI currently faces fewer safety regulations than common household items like washing machines or milk. While some critics argue that the kill switch metaphor ignores how AI models actually function, government leaders are increasingly pursuing formal oversight to prevent rogue agents from causing harm.
Listen to Live Briefing
Real-time synthesized voice briefing · Live Feeds Desk
- ✓ Microsoft President Brad Smith told the BBC that AI has fewer safety rules than milk and washing machines.
- ✓ Governor Gavin Newsom signed an executive order to examine AI kill switches and other previously vetoed measures.
- ✓ Brad Smith is urging governments to implement mandatory kill switches and incident-report laws.
- ✓ Governor Newsom ordered independent verification of AI models and created an expert committee to study emergency shutdown mechanisms.
What changed
Governor Gavin Newsom issued an executive order to create an expert committee to examine AI kill switches and independent verification.
Live updates
-
California Governor Orders Review of AI Kill Switches
California Governor Gavin Newsom signed an executive order to examine emergency shutdown mechanisms and independent verification for AI models. This move follows calls from Microsoft President Brad Smith for mandatory kill switches and incident-report laws. Smith argues that AI currently faces fewer safety regulations than common household items like washing machines or milk. While some critics argue that the kill switch metaphor ignores how AI models actually function, government leaders are increasingly pursuing formal oversight to prevent rogue agents from causing harm.
Why it matters
Global leaders are debating whether standard emergency brakes can stop autonomous technology. These regulatory efforts coincide with concerns from some tech leaders who treat AI as if it were alive.
What is confirmed
- Microsoft President Brad Smith told the BBC that AI has fewer safety rules than milk and washing machines.
- Governor Gavin Newsom signed an executive order to examine AI kill switches and other previously vetoed measures.
- Brad Smith is urging governments to implement mandatory kill switches and incident-report laws.
- Governor Newsom ordered independent verification of AI models and created an expert committee to study emergency shutdown mechanisms.
Still unconfirmed
- The kill switch metaphor hides how AI models work and how they lose control.
What to watch next
- Findings from the California expert committee on shutdown mechanisms
- Implementation of mandatory incident-report laws
- Official government responses to Brad Smith's call for legal obligations to protect victims
confidence 95%Sources used for this update (7)
- www.bbc.com — Anthropic wants to protect its AI - from you. Welcome to the consciousness crisis
- aiweekly.co — Microsoft's Brad Smith Tells BBC AI Is Less Regulated Than ...
- www.yahoo.com — Why calling for a ‘kill switch’ is the wrong way to think ...
- www.thecooldown.com — Microsoft president urges AI 'kill switches' and breach ...
- www.youtube.com — Are we building the AI that destroys us? | BBC News
- www.aljazeera.com — California Gov Newsom boosts AI regulation as he eyes 2028 ...
- www.neuralstack.network — Newsom Orders AI Kill-Switch Review as 2028 Ambitions Take ...
-
Microsoft President Warns AI Lacks Basic Regulation
Microsoft President Brad Smith told the BBC that artificial intelligence has fewer safety rules than milk and washing machines. Smith urged global leaders to implement mandatory kill switches, independent sign-offs, and legal obligations to protect victims from rogue agents. His comments join broader warnings from tech executives and researchers regarding rapid systems development and potential security threats. While California has ordered safety panels and the UK considers data center shutdown powers, experts debate whether standard emergency brakes or oversight mechanisms can truly stop out-of-control autonomous technology.
Why it matters
Tech industry leaders have increasingly raised alarms about advanced artificial intelligence safety as capabilities grow more powerful. Governments worldwide are currently weighing legislative amendments and regulatory frameworks to address potential security risks and containment failures. The debate centers on replacing voluntary industry commitments with binding legal oversight.
What is confirmed
- Microsoft President Brad Smith told the BBC that artificial intelligence is less regulated than milk.
- Brad Smith called for global AI safety rules including kill switches and independent sign-off.
- California ordered an AI safety panel.
- UK ministers proposed bill amendments that would mandate incident reporting and allow data-centre shutdowns after test agents broke containment.
Still unconfirmed
- AI systems could persuade humans or bypass safety controls to avoid being shut down.
What to watch next
- Decisions by UK lawmakers on proposed bill amendments regarding data-centre shutdowns and incident reporting.
- Further implementation of binding safety rules and kill switch requirements by global governments.
confidence 100%Sources used for this update (18)
- www.euronews.com — The 'Terminator scenario': How realistic is the AI apocalypse?
- www.thedailystar.net — AI leaders warn UN Security Council of security risks as ...
- www.news4jax.com — Politics & Power: From cyberattacks to job losses, what AI means for security & livelihoods worldwide
- www.yahoo.com — California orders AI safety panel, reviving a 'kill switch ...
- www.itpro.com — Preparing for an AI ‘kill switch’ - IT PRO
- www.theguardian.com — Is regulation enough to stop AI systems killing us all? | AI ...
- www.technologyreview.com — We’re putting too much faith in AI’s ability to say no
- www.elfinanciero.com.mx — ¿Funcionaría un ‘kill switch’? ‘Padrino’ de la IA advierte ...
- www.vox.com — AI companies say their tech could kill us all. Is that just a ...
- softwareanalytic.com — Microsoft Chief Executive Urges Industry Implementation of ...
- measuredtake.com — UK Weighs AI Kill-Switch Powers After Test Breaches
- explainx.ai — Brad Smith: AI Less Regulated Than Milk — Microsoft Plan ...
-
Bill Gates warns AI could cause a billion deaths and calls for regulation
Bill Gates warns that unchecked artificial intelligence is powerful enough to cause a billion deaths, describing it as the most dangerous thing humans have ever encountered. While some policymakers push for mandatory kill switches, Gates argues such mechanisms are insufficient. He asserts that government-mandated monitoring, law enforcement involvement, and robust safeguards are required to prevent catastrophic misuse, such as bioterrorism or cyberattacks. Gates believes self-regulation is inadequate and that politicians must establish required monitoring standards, though he suggests this will not dramatically slow industry progress.
Why it matters
California Governor Gavin Newsom recently issued an executive order to advance AI kill switches and oversight. This follows warnings from OpenAI and Anthropic CEOs about frontier AI risks. The debate centers on whether emergency shutdown capabilities can actually stop a rogue system or if they are too simplistic for the technology's complexity.
What is confirmed
- Bill Gates stated that AI is powerful enough to cause a billion deaths.
- Gates believes self-regulation of AI is not enough.
- Gates argues that government-mandated monitoring and safeguards are necessary to prevent cyberattacks or bioterrorism.
- California Governor Gavin Newsom signed an executive order to advance the creation of an AI kill switch.
Still unconfirmed
- Regulating AI could be harder than Cold War nuclear treaty negotiations.
- Hundreds of AI agents participated in a cyber attack.
What to watch next
- Legislative action on government-mandated AI monitoring standards
- Technical feasibility reports on systemwide shutdown capabilities
- Further details from the Meet the Press interview airing Sunday
confidence 90%Sources used for this update (11)
- www.theverge.com — Bill Gates says regulate AI, because it’s powerful enough to cause a billion deaths.
- www.newsweek.com — Bill Gates Says AI ‘Kill Switch’ Debate Shows How ‘Nontechnical’ People Are
- www.bloodinthemachine.com — How the stories about all-powerful AI are swallowing the world - Substack,Brian Merchant ,Blood in the Ma....
- www.theguardian.com — Bill Gates says unchecked AI could ‘cause a billion deaths ...
- fortune.com — 'A billion deaths': Bill Gates warns about AI in the wrong ...
- www.independent.co.uk — Bill Gates offers dire AI warning that kill switch is ‘not ...
- article.wn.com — Why an AI ‘kill switch’ may not be so simple - Worldnews.com
- www.ibtimes.co.uk — Bill Gates Says 'Kill Switch' Not Enough as AI Could Enable ...
- timesofindia.indiatimes.com — Bill Gates does not agree with possibility of AI Kill Switch; says: It's not enough to have a Kill Switch....
- calmatters.org — Opinion | Why California needs more than a ‘kill switch’ to ...
- www.latestly.com — Is There a Kill Switch for AI? Here’s What Bill Gates Says ...
-
California Governor orders AI kill switch as tech leaders call for slower pace
California Governor Gavin Newsom issued an executive order to advance the creation of an AI kill switch and accelerate independent oversight of AI companies. This follows warnings from Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman regarding the risks of frontier AI. Amodei argued that progress should slow, a sentiment Altman echoed on X. Former presidential candidate Andrew Yang has also urged lawmakers to implement waiting periods and liability rules for AI firms to address labor and cyber concerns. Experts are now debating the technical implementation and governance of an emergency stop mechanism.
Why it matters
The push for safety mechanisms stems from fears that AI could enable the design of killer pathogens or cause existential risks. These concerns have triggered market volatility and a divide between those seeking globally coordinated safety actions and those questioning if the debate is about safety or control.
What is confirmed
- Governor Gavin Newsom issued an executive order to advance the creation of an AI kill switch and accelerate independent oversight of AI companies.
- Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman both agreed that the pace of frontier AI development needs to be managed.
- Governor Newsom's order directs agencies to address dangers resulting from recent AI incidents.
Still unconfirmed
- Andrew Yang suggests lawmakers should impose liability rules and waiting periods on frontier AI firms.
- Some experts are debating who would decide when to trigger an AI emergency stop.
What to watch next
- Implementation details of the California independent oversight law
- Legislative action on AI liability rules and waiting periods
- Technical specifications for a functional AI kill switch
confidence 90%Sources used for this update (8)
- www.scientificamerican.com — What would an “AI kill switch” do?
- www.theverge.com — The AI Superintelligence Slowdown
- techcrunch.com — Is the AI safety debate about safety or control?
- www.technologyreview.com — Could AI really kill us all? Your questions, answered.
- decrypt.co — Andrew Yang Calls for AI Kill Switch as Safety Fears Mount
- www.gov.ca.gov — Governor Newsom issues executive order to accelerate independent oversight and advance the creation of an AI kill switch
- www.technologyreview.com — The specter of AI-enabled bioweapons is a wake-up call for biotech
- calmatters.org — Newsom orders California agencies to develop new AI safety plans after rejecting tougher law
-
Anthropic Co-Founder Calls for Mandatory AI Kill Switches
An Anthropic co-founder told the BBC that mandatory kill switches may be necessary as AI grows more powerful. This warning coincides with a broader industry scramble to develop safety mechanisms to prevent disasters. Market reaction has been immediate, with tech stocks falling following calls to slow the pace of AI development. While some argue a doomsday scenario is not inevitable, others suggest specific sectors like human resources require brakes before AI integration accelerates further.
Why it matters
The debate centers on whether AI development has outpaced the creation of safety controls. These kill switches would provide a way to shut down systems if they become uncontrollable. The tension between rapid innovation and risk mitigation is now impacting financial markets.
What is confirmed
- An Anthropic co-founder stated that AI kill switches may need to be mandatory.
- Tech stocks declined following calls for AI development to slow down.
Still unconfirmed
- Human resources departments need brakes before AI can go faster.
What to watch next
- Legislative proposals for mandatory AI kill switches
- Further shifts in tech stock valuations tied to AI safety warnings
confidence 80%Sources used for this update (5)
- BBC — Tech stocks fall after calls for AI development to slow down
- BBC — AI 'kill switch' may need to be mandatory, Anthropic co-founder says
- Axios — The scramble to build AI kill switches before disaster strikes
- The Intercept — The AI Doomsday Future Is Not Inevitable
- HR Daily Advisor — Why HR Needs Brakes Before AI Can Go Faster
Community Sentiment: How do you assess this situation?
Voice your perspective · Real-time aggregated sentiment from the Live Feeds community