Microsoft’s Satya Nadella says AI models need an ‘emergency brake’

Microsoft CEO Satya Nadella published a post on X arguing that AI safety needs a new "trust architecture." He said super intelligence should not be treated as nested black boxes whose outputs are simply accepted or rejected, and proposed separating the model from the harness that orchestrates its work, externalizing controls and safeguards, documenting every meaningful model action with tamper-proof human-readable evidence, and giving an authorized person the ability to pause or shut down a model mid-task. "We must assume a model is compromised and contain it from the start," he said, comparing the approach to an emergency brake. His comments come as leading AI companies increasingly acknowledge incidents in which they seemed to lose control of their models, and after Anthropic CEO Dario Amodei published a plan for more cautious AI development.

(Source：TechCrunch)