Satya Nadella, a Microsoft vezérigazgatója szorgalmazta az AI biztonsági architektúrájának újragondolását. Véleménye szerint nem szabad a fejlett rendszereket egymásba ágyazott fekete dobozokként kezelni, amelyek döntéseit ellenőrzés nélkül elfogadjuk.
A cégvezető úgy véli, szét kell választani a modellt a működését irányító rendszertől, a biztonsági korlátokat pedig külső ellenőrzés alá kell vonni. Emellett minden lényeges modellellépést hamisításbiztos módon kell dokumentálni.
Nadella javaslata szerint olyan rendszerekre van szükség, ahol egy felhatalmazott embernek bármikor felügyelete van a folyamatok felett, és akár feladat közben is leállíthatja a modellt. A megközelítés lényege, hogy a modelleket már a kezdetektől fogva potenciálisan veszélyeztetettként kell kezelni és elszigetelni.
Az eredeti szöveg (TechCrunch AI)
Last day to exhibit your breakthrough to 10,000+ tech leaders at Disrupt is on Oct 2. Book Exhibit Table Now.
Disrupt doors open Oct. 13. Get your pass and bring someone with you at 50% off. REGISTER NOW.
Microsoft CEO Satya Nadella is the latest tech executive to offer lengthy thoughts on how AI safety might be improved.
In a Saturday morning post on X, Nadella wrote that it’s time “to step back and assess the trust architecture” of AI.
“We can’t treat Super Intelligence as a set of nested black boxes and simply accept or reject its recommendations, answers, and actions,” Nadella wrote, using the Trump administration’s preferred term for AI.
As outlined by Nadella, this approach “means separating the model from the harness that orchestrates its work,” as well as “externalizing controls and safeguards.” He also called for “every meaningful model action” to be documented with “tamper-proof human readable evidence,” and for systems where “an authorized person” always has the ability “to pause or shut down a model mid-task.”
“We must assume a model is compromised and contain it from the start,” he said. “Think of it like an emergency brake.”
Nadella’s comments come as leading AI companies acknowledge more and more incidents where they seemed to lose control of their models, and after Anthropic CEO Dario Amodei published a plan for more cautious AI development.
Get 50% off a second passThe Disrupt experience is meant to be shared. Get your pass and bring a colleague, partner, or peer at 50% off. Cover more ground by making connections, building momentum, and discovering what’s next in the startup ecosystem.
Subscribe for the industry’s biggest tech news
Every weekday and Sunday, you can get the best of TechCrunch’s coverage.
TechCrunch Mobility is your destination for transportation news and insight.
Startups are the core of TechCrunch, so get our best coverage delivered weekly.
Provides movers and shakers with the info they need to start their day.
By submitting your email, you agree to our Terms and Privacy Notice.
