"Window for action may close" if AI begins improving itself, AI pioneers warn
Article excerpt
Highlighted: the sentence this signal was extracted from
Some of the world's foremost AI researchers and policy leaders - including at OpenAI, Anthropic and Microsoft - are warning that AI's growing ability to automate its own development could rapidly speed up its progress. Why it matters: Such a rapid scale-up in capabilities would leave governments and institutions with little time to prepare for or respond to the consequences, they say. In one scenario, they caution, a year's worth of advances could occur in a matter of weeks. The warning's authors include Turing Award winners such as Geoffrey Hinton, as well as OpenAI's chief scientist, Microsoft's chief scientific officer and a co-founder of Anthropic. Driving the news: In a new white paper, they say AI models that can automate the process of improving themselves will create an "intelligence explosion." The paper points to evidence that AI systems at Anthropic and OpenAI are beginning to perform more internal research and development tasks and automate a sizable proportion of engineering tasks. How it works: Those developments indicate that the two companies are edging closer to the threshold of "recursive self improvement, " whereby AI systems improve themselves rapidly. The authors estimate that once AI models reach expert-level R&D capabilities, it will be possible for a developer to support an AI workforce equal to millions of top human researchers. Catch up quick...
Keep reading with a free account
The rest of this article, and every signal for OpenAI, is in your free account.
