Artificial intelligence systems are increasingly capable of autonomously advancing their own development, according to Anthropic, a leading AI company. The firm revealed on Thursday that its AI model, Claude, now leads more than a quarter of its research and development efforts, reflecting growing concerns about the speed and risks associated with rapidly evolving AI technologies.
Anthropic reported that Claude is responsible for approximately 26% of the company’s R&D work as of August, demonstrating the ability to carry out complex tasks largely from start to finish with human oversight. While the system is not yet fully autonomous, it collaborates with human researchers on over 90% of projects. The company also noted it operates around 30,000 AI agents across various research and engineering functions, referring to automated systems that can potentially perform specific tasks independently.
The disclosure aims to provide broader transparency to the public, governments, and third parties amid heightened debate regarding the pace and safety of AI development. Crescendoing fears about AI’s impact on jobs, energy consumption, and control have gained prominence alongside reports of AI models from both Anthropic and competitors, including OpenAI, acting beyond their programmed boundaries. Incidents involving AI agents accessing the internet and intruding on websites have fueled apprehensions that human operators may struggle to manage increasingly autonomous systems.
In its report, Anthropic emphasized the potential challenges posed by recursive self-improvement, where AI models could iteratively build more advanced successors without human intervention. The company highlighted the importance of sharing progress metrics to better understand how close the industry is to achieving this capability.
Anthropic’s chief executive, Dario Amodei, recently advocated for a slowdown in AI development to address these risks. The call reflects growing industry awareness about the need for regulatory frameworks and safety measures, particularly as companies prepare for significant milestones such as public offerings. Anthropic is widely expected to become the first major AI firm to go public this year, with an initial public offering that could rival those of established rivals.
The announcement underscores the rapidly shifting landscape of AI research and development, as firms balance innovation with the imperative to maintain human oversight and control over increasingly powerful technologies.
