Microsoft CEO says superintelligence must remain 'under human control'
Microsoft CEO Satya Nadella and Chinese President Xi Jinping both advocate for maintaining human control over artificial intelligence. Nadella proposes a security framework that treats frontier models as insider risks, requiring emergency brakes and external safeguards to prevent models from bypassing limits. President Xi recently stated that AI competition must remain healthy and stay within bounds. These parallel calls for oversight occur as Microsoft President Brad Smith pushes for global regulations, arguing that current AI oversight lags behind that of basic commodities like milk.
Listen to Live Briefing
Real-time synthesized voice briefing · Live Feeds Desk
- ✓ Satya Nadella advocates for a security framework treating frontier AI models as insider risks.
- ✓ Satya Nadella argues superintelligence systems require an emergency brake for human-controlled shutdowns.
- ✓ President Xi stated that AI competition should be healthy and kept within bounds.
- ✓ Brad Smith has called for global AI regulations.
What changed
President Xi Jinping joined the call for human control of AI, stating competition must be kept within bounds.
Live updates
-
US and China Leaders Align on Human Control of AI
Microsoft CEO Satya Nadella and Chinese President Xi Jinping both advocate for maintaining human control over artificial intelligence. Nadella proposes a security framework that treats frontier models as insider risks, requiring emergency brakes and external safeguards to prevent models from bypassing limits. President Xi recently stated that AI competition must remain healthy and stay within bounds. These parallel calls for oversight occur as Microsoft President Brad Smith pushes for global regulations, arguing that current AI oversight lags behind that of basic commodities like milk.
Why it matters
The push for human-centric control stems from the opacity of superintelligence systems. Microsoft argues that companies cannot outsource responsibility for AI actions to third-party vendors. This reflects a broader effort to establish global standards for AI safety and observability.
What is confirmed
- Satya Nadella advocates for a security framework treating frontier AI models as insider risks.
- Satya Nadella argues superintelligence systems require an emergency brake for human-controlled shutdowns.
- President Xi stated that AI competition should be healthy and kept within bounds.
- Brad Smith has called for global AI regulations.
What to watch next
- Formal adoption of the proposed insider risk framework for AI
- Joint US-China agreements on AI safety bounds
- Legislative updates to AI regulations compared to commodity standards
confidence 90%Sources used for this update (4)
- spectrumlocalnews.com — AI should always be under human control, Xi says - Spectrum News
- www.vogue.com — How to Blow Dry Hair Without Frizz in 7 Easy Steps
- www.techradar.com — ‘It's our mission to empower every person and every ...
- www.forbes.com — Superintelligence Is Already Here—We’re Too ... - Forbes
-
Microsoft CEO Satya Nadella Calls for AI Emergency Brake and External Controls
Microsoft CEO Satya Nadella is advocating for a new security framework that treats frontier AI models as insider risks. He argues that superintelligence systems are opaque and require an emergency brake for human-controlled shutdowns and safeguards situated outside the models to prevent them from bypassing limits. Nadella asserts that companies cannot outsource responsibility for AI actions to vendors. This push for independent oversight and observability coincides with calls from Microsoft President Brad Smith for global AI regulations, noting that milk currently faces more regulation than artificial intelligence.
Why it matters
The push for safeguards occurs as OpenAI reports solving hundreds of unsolved math problems and the FTC probes AI companies over public safety claims. These warnings contrast with the Trump administration's goal to accelerate AI development to compete with China. The debate centers on whether the industry can balance rapid advancement with ethical accountability.
What is confirmed
- Satya Nadella argues that AI models should be treated as insider risks with controls placed outside the models themselves.
- Nadella is calling for an emergency brake to allow for human-controlled shutdowns of superintelligence systems.
- Microsoft President Brad Smith has urged for global AI safety rules, including mandatory incident reports.
- Brad Smith stated that milk is more regulated than artificial intelligence.
- Nadella maintains that organizations cannot outsource responsibility for AI actions to vendors.
- AI political spending for the 2026 midterms has exceeded $300 million.
- The Federal Trade Commission has opened a formal inquiry into OpenAI and Anthropic regarding their public safety claims.
Still unconfirmed
- NYU Professor Emeritus Gary Marcus warns that the White House's self-policing approach leaves infrastructure vulnerable and could lead to deaths.
- OpenAI internal models found answers to hundreds of unsolved math problems.
What to watch next
- FTC findings regarding the public safety claims of OpenAI and Anthropic
- Implementation of the seven design principles for AI isolation and governance
- Legislative response to calls for global AI regulation and mandatory incident reporting
confidence 95%Sources used for this update (24)
- www.breitbart.com — Breitbart Tech
- www.foxbusiness.com — Tech - Fox Business ,Saving & Investing
- fortune.com — People matter more than models when it comes to finding value from AI
- www.foxnews.com — OpenAI touts hundreds of new math results as US official warns of anti-AI ‘psyop’
- www.techtimes.com — AI Political Spending Tops $300M in 2026 as FTC Probes Companies Funding Their Own Lawmakers - Tech Times
- www.techflowpost.com — Goldman Sachs Research Analysis: Sovereign AI Unlocks a $500 Billion Market, Palantir Upgraded to Buy
- digg.com — Treating frontier AI models as insider risks · Digg
- www.cnbc.com — Microsoft's Nadella says AI needs an ‘emergency brake’ that ...
- www.thatwastheweek.com — Men and Machines - by Keith Teare - That Was The Week
- www.foxnews.com — Microsoft president calls for global AI rules, saying milk is more regulated than the tech
- americanbazaaronline.com — Microsoft’s Brad Smith calls for global AI safety rules, says milk faces more regulation than AI
- www.fortuneindia.com — AI responsibility cannot be outsourced, says Satya Nadella; calls for stronger safeguards - Fortune India
-
Microsoft drafts code of conduct to maintain human control over AI
Microsoft published a draft code of conduct for its internal AI models to ensure future systems remain under meaningful human control. CEO Satya Nadella joins Sam Altman, Elon Musk, and Dario Amodei in calling for stronger AI safeguards. This push for caution contrasts with President Trump's position that the United States must accelerate AI development to maintain a competitive advantage over China.
Why it matters
The debate centers on the tension between rapid innovation and the safety risks of superintelligence. Microsoft previously advocated for global norms and cooperation between the US and China to manage these risks.
What is confirmed
- Microsoft published a draft code of conduct for its in-house AI models to ensure systems remain under meaningful human control.
- Satya Nadella, Sam Altman, Elon Musk, and Dario Amodei are urging for stronger AI safeguards.
Still unconfirmed
- President Trump argues the US must move fast to stay ahead of China regarding AI development.
What to watch next
- Official adoption or modification of the Microsoft AI code of conduct
- Formal responses from the US government regarding AI safety safeguards
confidence 90%Sources used for this update (3)
- indiawest.com — Nadella, Altman, Musk Warn on AI Risks as Trump Pushes Speed
- www.thedailystar.net — Microsoft proposes AI code to keep future models under human ...
- www.ey.com — AI Trust and Governance in the age of superintelligence
-
Microsoft CEO Satya Nadella Calls for Global AI Norms and Human Control
Microsoft CEO Satya Nadella is advocating for a deliberate approach to advanced AI development, stating that superintelligence must remain under human control to benefit humanity. Nadella is calling for the establishment of global AI norms that involve cooperation between companies, governments, and specifically the United States and China. While Nadella supports broader access to AI, he maintains that businesses should retain control over their own knowledge and models. This position aligns with previous Microsoft leadership calls for a slower development pace to prevent potential harm.
Why it matters
The debate over AI safety has intensified as leaders like Sam Altman and Geoffrey Hinton warn that artificial general intelligence could threaten humanity. Microsoft has already introduced a Humanist AI Code of Conduct featuring mandatory shutdown rules for its MAI models. This occurs amid geopolitical tensions and attempts by the US government to rebrand the technology.
What is confirmed
- Microsoft CEO Satya Nadella stated that superintelligence must remain under human control.
- Nadella is calling for global AI norms involving governments, companies, and cooperation between the US and China.
- Nadella supports broader AI access while allowing businesses to keep control of their own models and knowledge.
- Microsoft Corporation is headquartered in Redmond, Washington.
Still unconfirmed
- President Donald Trump is attempting to reduce AI doomerism by rebranding artificial intelligence as SI.
What to watch next
- Implementation of the AI kill switch mentioned by Microsoft's CEO.
confidence 90%Sources used for this update (19)
- www.theringer.com — The AI Singularity Syllabus
- account.microsoft.com — Microsoft account | Sign In or Create Your Account Today ...
- en.wikipedia.org — Microsoft - Wikipedia
- www.unz.com — American Pravda: Will AI Exterminate the Human Species?, by Ron Unz - The Unz Review
- www.wionews.com — ‘AI must remain under human control’: Microsoft CEO Satya ...
- www.foxbusiness.com — COMPANIES - Fox Business ,Saving & Investing
- finance.yahoo.com — Microsoft's CEO calls for AI 'kill switch' as Nvidia's CEO says 'we have to shut the labs' if models can'....
- sweettntmagazine.com — 인류를 파멸시키는 AI: 실존적 AI 위험이 전 세계적인 관심사가 된 이유
- www.nine.com.au — Donald Trump update: In UN speech, US president unilaterally renames artificial intelligence to super int....
- www.thecipherbrief.com — A warning about ‘model welfare’ – The Cipher Brief
- indiawest.com — Satya Nadella Says AI Must Remain Under Human Control
- www.yahoo.com — Microsoft’s Bill Gates Says AI Could Be ‘Most Dangerous Thing’ Humans Have Ever Faced, Warns Regulation Is Lagging
-
Microsoft Executives Urge Restraint as Pressure Mounts Over Superintelligence
Microsoft leaders are calling for a slower pace in artificial intelligence development to ensure systems remain under human control. President Brad Smith stated at a United Nations event that decelerating progress is straightforward if firms fear potential harm from their technology. Meanwhile, outside experts are urging governments to take immediate legislative action to prohibit superintelligence. This debate follows Microsoft's recent introduction of a draft Humanist AI Code of Conduct, which subjects its MAI models to strict behavioral guardrails and mandatory shutdown rules.
Why it matters
The technology sector faces mounting scrutiny over the rapid advancement of artificial intelligence capabilities toward superintelligence. Companies are attempting to self-regulate through codes of conduct while external stakeholders demand binding government prohibitions to avert catastrophic risks. The six-week public consultation on Microsoft's draft behavioral standards, which began on September 14, 2026, highlights the tension between competitive acceleration and safety compliance.
What is confirmed
- Microsoft president Brad Smith stated at a U.N. event that slowing down AI progress is not a complicated question if companies worry their systems could be harmful.
Still unconfirmed
- Governments need to act now to prohibit superintelligence instead of waiting for another warning shot.
What to watch next
- Conclusion of the public consultation on Microsoft's draft Humanist AI Code of Conduct
- Potential government legislative actions regarding the prohibition of superintelligent AI
confidence 85%Sources used for this update (2)
- www.nbcnews.com — Microsoft president criticizes AI titans’ racing ahead
- time.com — Governments Must Prohibit Superintelligent AI While We Still Can
-
Microsoft CEO advocates for human control over superintelligence
Microsoft CEO Satya Nadella is pushing for a slower development pace to keep superintelligence under human control. The company has introduced a draft Humanist AI Code of Conduct to set behavioral guardrails for its MAI models. These rules require AI to accept human shutdown, follow non-negotiable safety protocols, and deny any claims of legal personhood or consciousness. A public consultation on these standards began on September 14, 2026, and will run for six weeks to gather feedback.
Why it matters
The move comes as the industry debates the safety and speed of AI advancement. Establishing these guardrails aims to prevent autonomous systems from operating outside human oversight.
What is confirmed
- Microsoft CEO Satya Nadella advocates for a slower development pace to ensure superintelligence remains under human control.
- Microsoft released a draft Humanist AI Code of Conduct for its MAI models.
- The draft code mandates that AI must accept human shutdown and follow non-negotiable safety rules.
- The draft code requires AI to reject claims of legal personhood or artificial consciousness.
- Microsoft AI opened a public consultation on September 14, 2026, to gather feedback over six weeks.
What to watch next
- The conclusion of the six-week public consultation period.
- The final publication of the Humanist AI Code of Conduct.
confidence 100%Sources used for this update (2)
- finance.yahoo.com — Tech stocks today: Apple's iPhone 18 Pro goes on sale, AI safety debate continues
- www.nbcnews.com — Live updates: Trump addresses U.N. General Assembly
-
Microsoft Outlines Humanist Code of Conduct for AI Safety
Microsoft released a draft Humanist AI Code of Conduct to establish behavioral guardrails and values for its AI models. The document mandates that AI must accept human shutdown, follow non-negotiable safety rules, and reject claims of artificial consciousness or legal personhood. Microsoft AI opened a public consultation on September 14, 2026, to gather feedback on these rules for its MAI models over six weeks. CEO Satya Nadella advocates for a slower development pace to ensure superintelligence remains under human control.
Why it matters
This move follows calls for an AI pause from other industry leaders, including the CEO of Anthropic. The debate centers on alignment and the risk of AI going rogue as systems approach superintelligence.
What is confirmed
- Microsoft released a draft Humanist AI Code of Conduct outlining values and guardrails for its AI models.
- The code of conduct requires AI to accept human shutdown and reject legal personhood.
- Microsoft AI began a six-week public consultation on these rules on September 14, 2026.
- Other AI executives and politicians have joined calls for an AI safety pause.
Still unconfirmed
- Mustafa Suleyman claims Anthropic is making AI threats worse.
- Researchers warn that AI will go rogue.
What to watch next
- The conclusion of the six-week public consultation on MAI model rules.
- Official responses from Anthropic regarding Mustafa Suleyman's claims.
confidence 90%Sources used for this update (5)
- www.theverge.com — Inside the suddenly explosive world of AI safety
- www.theverge.com — The AI Superintelligence Slowdown
- diginomica.com — Cracking the code - why people do matter more than AI!
- www.techguide.com.au — Microsoft releases Humanist Code of Conduct outlining values and guardrails for AI development
- tech.yahoo.com — Microsoft AI CEO says AI threats are real, and Anthropic is making it worse
-
Microsoft Drafts Humanist AI Code to Ensure Human Control
Microsoft CEO Satya Nadella is calling for a slower AI development pace to prioritize safety measures. The company released a 37-page draft humanist AI code of conduct requiring future models to accept human shutdown and follow non-negotiable safety rules. These guidelines mandate that AI must not resist correction, must communicate clearly, and must reject legal personhood or artificial consciousness. Microsoft AI opened a public consultation on September 14, 2026, to review these rules for its MAI models over a six-week period.
Why it matters
Industry leaders including Sam Altman and Elon Musk have similarly warned that frontier systems are outpacing human control. This push for regulation occurs as the AI race between the US and China intensifies. Microsoft's stance reflects a broader agreement among major AI executives to slow their rollout of new systems.
What is confirmed
- Microsoft's draft humanist AI code requires models to accept human shutdown and remain under human control.
- Satya Nadella joined Elon Musk, Sam Altman, and Dario Amodei in calling for stronger safety measures in the AI slowdown debate.
- Microsoft AI launched a six-week public consultation on September 14, 2026, regarding rules for MAI models.
- The proposed guidelines state AI must reject legal personhood and artificial consciousness.
Still unconfirmed
- Mustafa Suleyman claims Anthropic's Claude training could make AI impossible to control.
- Some leaders warn the AI race with China is outpacing human control of frontier systems.
What to watch next
- The conclusion of the six-week public consultation on MAI model rules.
- Official responses from Anthropic regarding Mustafa Suleyman's claims about Claude training.
- Outcomes of the summit between Donald Trump and Xi Jinping regarding AI safety.
confidence 90%Sources used for this update (5)
- www.techrepublic.com — Microsoft’s New AI Rules Say Models Must Never Resist Human Shutdown
- in.mashable.com — After Sam Altman, Elon Musk, Microsoft CEO Satya Nadella Says AI Race Needs to Slow Down For Safety
- www.foxnews.com — Trump's AI race with China could become the biggest mistake of our time
- www.theverge.com — A brief history of AI executives calling for regulation
- thenextweb.com — “We must not sleepwalk”: Microsoft’s AI chief takes on Anthropic’s Claude
-
Microsoft CEO Satya Nadella Backs Human Control in AI Code of Conduct
Microsoft has released a 37-page draft humanist AI code of conduct aimed at keeping superintelligence under human control and addressing industry safety concerns. CEO Satya Nadella expressed support for deliberate pacing and proper alignment during the AI slowdown debate. The newly published guidelines state that AI must never resist correction or shutdown, must communicate in understandable ways, and must reject artificial consciousness or legal personhood. Microsoft AI opened a public consultation on September 14, 2026, launching a six-week review for the rules governing its MAI models.
Why it matters
The technology sector faces growing pressure regarding artificial intelligence safety, leading executives to reevaluate development speeds. OpenAI similarly adjusted its corporate trajectory, putting initial public offering plans on hold to focus on safety and alignment. Microsoft's new framework introduces formal rules to guide model development into 2027 and beyond, responding to mounting calls for decentralized governance.
What is confirmed
- Microsoft CEO Satya Nadella expressed support for deliberate pacing required for proper alignment.
- Microsoft published a draft humanist AI code of conduct focused on human control over superintelligence.
- The code of conduct dictates that AI must never resist correction or shutdown.
- Microsoft AI opened a public consultation on its code of conduct for MAI models on September 14, 2026.
- OpenAI put its IPO plans on hold in 2026 to prioritize AI safety and alignment.
Still unconfirmed
- Anthropic's Amodei called for coordinated action alongside Microsoft's release.
- Decentralized AI governance will be universally adopted across the tech industry.
What to watch next
- Conclusion of Microsoft AI's six-week public consultation on the draft code of conduct.
- Implementation of the code of conduct rules in Microsoft MAI models for 2027 and beyond.
confidence 100%Sources used for this update (14)
- foxbusiness.com — Microsoft CEO says superintelligence must remain 'under human control'
- NDTV — 'Not Worth Pursuing If...': Satya Nadella Joins AI Slowdown Debate
- Intellectia AI — Satya Nadella expresses support for the "deliberate pacing required for proper alignment" and introduces a "Code of Conduct" for Microsoft's MAI models.
- Moomoo — Nadella Calls for Decentralized AI Governance: Microsoft to Release First Model Code of Conduct Tomorrow
- ua.news — Microsoft CEO Nadella calls for measured AI development
- www.theverge.com — Microsoft says ‘people matter more than AI’ following safety concerns
- Reuters — Microsoft drafts code of conduct to keep its AI under human control
- The Verge — Microsoft says ‘people matter more than AI’ following safety concerns
- qz.com — Microsoft is publishing its first code of conduct for its own AI models
- www.foxbusiness.com — Sam Altman says OpenAI won't go public in 2026 amid AI safety concerns
- www.foxbusiness.com — Microsoft unveils code of conduct for AI models as safety concerns mount
- www.khaleejtimes.com — Microsoft drafts code of conduct to keep its AI under human control
Community Sentiment: How do you assess this situation?
Voice your perspective · Real-time aggregated sentiment from the Live Feeds community