Satya Nadella says a company's relationship with AI should have trust issues - Business Insider
Microsoft CEO Satya Nadella says companies shouldn't trust AI models. Satya Nadella says that in the relationship between AI and a company, trust issues can be healthy. In a lengthy X post on Saturday, the Microsoft CEO said companies don't always understand an AI model's decisions or behavior, so they need to build walls to protect themselves from the tech. After all, it's very possible that AI is already exploring new connections. "We need to surround non-deterministic models with strong, deterministic system design, human controls, and reliable operating procedures, and establish industry standards where existing ones are insufficient," Nadella said. "Treating frontier closed and open weight models like insider risks is a way to build such a system. "Nadella said that AI models aren't inherently malicious, but anything with access to vital systems can become compromised or make mistakes. He added that AI models shouldn't be able to operate the controls that determine what they can access or what actions they can take. "Today this means separating the model from the harness that orchestrates its work, as well as the action space that defines what it can do.
