Get updates delivered to you daily. Free and customizable.
Business Insider
Why California's AI safety bill is driving a wedge through Silicon Valley
By Hasan Chowdhury,
10 hours ago
Elon Musk and Sam Altman are taking opposing views on a controversial AI safety bill.
Steve Granitz, Andrew Caballero-Reynolds/Getty Images
Some in Silicon Valley have long argued that AI needs rules.
A new bill in California that introduces such rules is splitting opinion, however.
The SB 1047 AI safety bill has won support from Elon Musk, but faces opposition from Sam Altman.
Silicon Valley seems to agree that artificial intelligence is the future. An imminent bill that could dictate AI development , however, is revealing deep schisms among tech leaders over the way the technology should be rolled out to the world.
SB 1047, an AI safety bill tabled in California seven months ago by Sen. Scott Weiner, is set to face a vote in the California State Assembly this week, but not everyone with a position in the AI race appears to be on the same page.
The core aim of the bill passed by the state's Senate in a bipartisan vote in May is to introduce a set of measures that, in theory at least, curb risks posed by the most powerful AI models, such as the potential to be used to create dangerous weapons or cyber-attacks.
Such measures include forcing companies operating in California to allow third parties to test their models for safety and pushing them to include a "kill switch" that could shut down their models if deemed necessary.
Many with a horse in the AI race have already vocalized their frustrations over the bill.
In a social media post on Monday, Elon Musk , who founded AI company xAI last year and has a long-standing rivalry with OpenAI's Altman, said that although it was "a tough call and will make some people upset," he thinks "California should probably pass the SB 1047 AI safety bill."
"For over 20 years, I have been an advocate for AI regulation, just as we regulate any product/technology that is a potential risk to the public," Musk wrote on X.
Elon Musk has been vocal about the risks posed by AI.
The bill has proven to be so divisive for a number of reasons.
Why Silicon Valley is split on SB 1047
First, there is the question of its impact on innovation.
According to the anti-SB 1047 camp, the bill's stringent measures threaten to slow the development of future models, something that could prove dangerous as the US faces a rising AI power in the form of China.
That, at least, was the argument put forward by OpenAI's chief strategy officer, Jason Kwon, in the company's letter to Sen. Weiner. Not only would the bill "slow the pace of innovation," Kwon said, but it could trigger an exodus of "California's world-class engineers and entrepreneurs."
The regulation's impact on AI models that aren't among the most powerful and possible consequences for startups is also raising questions.
Legal 'patchwork'
A16z general partner Anjney Midha, for instance, wrote in The Financial Times last month that the bill's categorization of powerful models as anything with a training cost of more than $100 million set a "relatively low bar" given that "AI development costs run to billions."
There is also a view that the federal government should take the lead on regulations of this magnitude. OpenAI's Kwon, for instance, suggested that governance of AI at a state level could create a "patchwork" of laws.
Sen. Weiner, of course, dismisses this idea. Responding to OpenAI's letter , he said that "ideally Congress would handle this," but its lack of action to date makes him skeptical that it will take action anytime soon.
Its purpose, OpenAI said, was to generate content and commentary on topics such as the US presidential election.
That is just one illustration of AI's nefarious potential. Whether SB 1047 is the right way to address that threat will be a subject of fierce debate in the coming months.
Get updates delivered to you daily. Free and customizable.
It’s essential to note our commitment to transparency:
Our Terms of Use acknowledge that our services may not always be error-free, and our Community Standards emphasize our discretion in enforcing policies. As a platform hosting over 100,000 pieces of content published daily, we cannot pre-vet content, but we strive to foster a dynamic environment for free expression and robust discourse through safety guardrails of human and AI moderation.
Comments / 0