Safety sacrificed for profit: Silicon Valley cuts AI research
Silicon Valley companies are increasingly sacrificing artificial intelligence research for profit. And product development is displacing work on system safety. According to White, whose company CalypsoAI conducts audits of popular models from Meta, Google, and OpenAI, modern systems are less likely to reject malicious requests. And they can reveal ways to create explosive devices or confidential information for malicious actors.
“The models are getting better, but they are also more likely to be good at bad things,” says White. “They’re becoming easier to deceive to do something harmful.”
The changes are particularly noticeable in companies like Meta and Alphabet, which have lowered the priority of research laboratories. In Facebook’s parent company, the fundamental artificial intelligence research division has taken a back seat. Giving way to Meta GenAI.
At Alphabet, the Google Brain research group is now part of DeepMind. The division responsible for artificial intelligence product development. This reorganization reflects a shift in focus from fundamental research to applied development.
CNBC journalists spoke with more than 12 professionals in the field of artificial intelligence, who unanimously speak of a shift from research to revenue-generating products. Employees face increasingly tight development deadlines. They cannot afford to fall behind in the race to bring new models to market. And thorough testing becomes a luxury that companies consider possible to reduce.
I think that in the next couple of years we will see an increase in security incidents. Which will lead to regulatory intervention by governments. Or all this will end in direct censorship.
