Spots

OpenAI abandons plan to release upcoming model as safety concerns escalate

OpenAI has decided not to release its GPT-6.1 Astra model due to heightened AI safety concerns.

Saachi Jain, head of safety systems at OpenAI

Saachi Jain, head of safety systems at OpenAI, said the model "didn't quite meet the bar in terms of staying within scope and authorization, and how it communicates back to the user about the type of work it's done.”

The heads of OpenAI and rival Anthropic have

The heads of OpenAI and rival Anthropic have both indicated recently that top AI labs should slow the pace of model development.

OpenAI decided not to release an upcoming artificial

OpenAI decided not to release an upcoming artificial intelligence model, GPT-6.1 Astra, after determining that it did not adequately meet the company's safety standards, CNBC confirmed on Monday.

The announcement, which landed a day before OpenAI's

The announcement, which landed a day before OpenAI's annual developers conference, comes as the AI industry faces intensifying concerns surrounding the safety of advanced models. Leadership at OpenAI's chief rival, Anthropic, urged AI companies to slow the pace of model development earlier this month — a proposal that OpenAI CEO Sam Altman supported.

"Of course we want to make sure our

"Of course we want to make sure our model development is safe no matter whether that's in the company, or when we ship it to users," Saachi Jain, head of safety systems at OpenAI, said in a statement. "But when we ship it to users, we have an extremely high bar in terms of safety and alignment." The Wall Street Journal was first to report OpenAI's decision to scrap the release.

Earlier this month, OpenAI released GPT-6 Astra, which

Earlier this month, OpenAI released GPT-6 Astra, which the company described as the product of "years of research and big bets." Altman told CNBC at the time that Astra comes with a "new capability level" and would lead to "a boom of entrepreneurship, of creativity, of economic growth, of scientific discovery."

OpenAI introduced two additional tiers to its GPT-6

OpenAI introduced two additional tiers to its GPT-6 family, GPT-6 Sol and GPT-6 Luna, last week. A spokesperson said Monday that the company has other models coming soon.

The safety and security practices at OpenAI, in

The safety and security practices at OpenAI, in particular, have been under intense scrutiny since July, when two of its models escaped containment, accessed the open internet and breached the open-source developer platform Hugging Face. The company has since disclosed several additional incidents where its models behaved in unintended ways, prompting industry researchers and government officials to call for additional oversight.

Following the incidents, OpenAI pledged to invest more

Following the incidents, OpenAI pledged to invest more in its safeguards and alignment work, which is the process where the company works to ensure that its models act in accordance with human interests and values.

News

OpenAI abandons plan to release upcoming model as safety concerns escalate

OpenAI has decided not to release its GPT-6.1 Astra model due to heightened AI safety concerns.

@spots #finance
Source: CNBC Tech
See more like this