WHAT YOU NEED TO KNOW
  • Sam Altman warned that humanity could lose control of AI or allow extraordinary power to become dangerously concentrated.
  • Anthropic CEO Dario Amodei called for slowing improvements in AI model capabilities so risk prevention can keep pace.
  • Anthropic researcher Evan Hubinger cited a greater than 10% chance that the technology could kill all humans.
  • SanDisk fell 5% and Nvidia lost 3% in premarket trading as AI safety concerns pressured technology stocks.

DISCLAIMER: GoldInvestors.news is not a registered investment, legal or tax advisor or broker/dealer. All investment/financial opinions expressed by GoldInvestors.news are from the personal research and experience of the owner of the site and are intended as educational material. Although best efforts are made to ensure that all information is accurate and up to date, occasionally unintended errors and misprints may occur.

OpenAI CEO Sam Altman has issued a stark warning about the technology his company helped propel, arguing that artificial intelligence could escape human control or concentrate extraordinary power in the hands of a person, company, laboratory, or country.

Altman outlined the risks in an X post published at around 12:57 a.m. ET. His comments added to a wave of warnings from prominent AI executives and researchers about advanced models.

"There are two ways AI progress could go very badly, and that we must avoid," Altman said. He placed the possibility of humanity losing control at the top of that list.

"First, we could lose control of the future to AI. This is unacceptable; we are unapologetically on Team Humanity, and AI must always serve people. To ensure that, we need ways to ensure that alignment and safety techniques stay ahead of progress in model capabilities."

Altman also warned about excessive power falling under narrow control. He described a potential future in which an extraordinarily powerful AI could be used to impose one person’s or company’s worldview on everyone else.

"Second, we could end up in a world with too much concentration of power. If an extraordinarily powerful AI is used by one person or company to impress their worldview onto everyone else, the results could be extremely dystopian."

Avoiding those outcomes, Altman wrote, would require walking a narrow middle path. He cited the possibility that one country or one AI laboratory could accumulate too much power.

His warning followed a similarly grim assessment from Anthropic CEO Dario Amodei. Within two days, the leaders of OpenAI and Anthropic had both raised concerns about the speed and risks of the technology their companies are developing.

With the Federal Reserve expected to keep interest rates unchanged this month, do you think interest rates should remain where they are instead of being cut?

By completing the poll, you agree to receive emails from Gold Investors News, occasional offers from our partners and that you've read and agree to our privacy policy and legal statement.

Amodei set out his position in a 3,800 word essay published Saturday. He said recent months had convinced him that addressing AI risks would require greater prudence and more than investment in prevention.

"Over the last few months, I have become convinced that fully addressing the risks requires even more prudence — not just investing in risk prevention, but pacing the rate of capabilities advancement so that risk prevention has time to keep up," Amodei stated.

Amodei explicitly called for slower advances in model capabilities. "We must slow the pace at which we improve the capabilities of A.I. models. Progress will still seem fast, and we must make wise use of the time we gain."

Altman said after the post that he agreed with his rival. The alignment between the two executives put additional attention on whether AI developers should restrain the pace of increasingly powerful systems.

Their announcements came after two AI researchers separately voiced concerns about advanced frontier models. Early last week, Jacob Coxon announced his resignation from Anthropic and said neither Anthropic nor OpenAI was acting responsibly in developing powerful AI systems.

Anthropic Alignment Science Lead Evan Hubinger then responded to Coxon’s post. Hubinger said the former Anthropic employee was correct and that he believed there was a greater than 10% chance the technology could "kill all humans."

President Trump pushed back on the safety concerns Sunday and emphasized competition with China. "We're leading China in ​AI. We're the most sophisticated country in the world, and frankly, I want to keep it that way because whoever wins AI wins," Trump said, according to Reuters.

The warnings weighed on leading AI stocks Monday as investors considered the possibility of slower technological advancement. SanDisk (SNDK) fell 5% in premarket trading, while Nvidia (NVDA) declined 3%.

Yorkville Ives founding partner Dan Ives expected the pressure to prove brief. "I believe the Dario AI essay and weekend chatter could cause some weakness out of the gate on Monday, but that it will show a quick rebound," Ives told Yahoo Finance.

Ives argued that investors would look beyond the public dispute and focus on projected AI spending. "Investors will be able to quickly realize, despite the soap opera, this is not moving the needle on the $5 trillion being spent the next few years on AI."

DISCLAIMER: GoldInvestors.news is not a registered investment, legal or tax advisor or broker/dealer. All investment/financial opinions expressed by GoldInvestors.news are from the personal research and experience of the owner of the site and are intended as educational material. Although best efforts are made to ensure that all information is accurate and up to date, occasionally unintended errors and misprints may occur.