7
Will AI R&D Automation Cause a Software Intelligence Explosion? | Forethought
www.forethought.orgAI companies are increasingly using AI systems to accelerate AI research and development. Today’s AI systems help researchers write code, analyze research papers, and generate training data. Future systems could be significantly more capable – potentially automating the entire AI development cycle from formulating research questions and designing experiments to implementing, testing, and refining new AI systems. We argue that such systems could trigger a runaway feedback loop in which they quickly develop more advanced AI, which itself speeds up the development of even more advanced AI, resulting in extremely fast AI progress, even without the need for additional computer chips. Empirical evidence on the rate at which AI research efforts improve AI algorithms suggests that this positive feedback loop could overcome diminishing returns to continued AI research efforts. We evaluate two additional bottlenecks to rapid progress: training AI systems from scratch takes months, and improving AI algorithms often requires computationally expensive experiments. However, we find that there are possible workarounds that could enable a runaway feedback loop nonetheless.
I’m not anti-AI like most of the people here on Lemmy, but I’m certainly not as bullish on AI R&D as the author. Current techniques are not sufficient to replace expert humans, and it’s unclear if they ever will be.
Right now I expect AI to grow to replace non-experts in most text-only jobs, but it will probably take a full redesign of the algorithms to go beyond that. Like, you can only get so far by doing the statistically correct thing - research progress happens by thinking outside the box.
Same here, been watching and testing closely from day one, and the AI hate is certainly understandable, but it is a new tool in the toolbox, and once you learn how to use it correctly and understand it’s limitations (e.g. you wouldn’t use a hammer to build a 50 meter bridge span) it can provide quite a bit of leverage, which saves you time and let’s you spend more time scrolling on Lemmy and writing comments like these.
The AI hype, particularly in the financial markets is really overbought IMO, and that’s the bubble that is bursting, egged on by the tariffs and general geopolitical uncertainty. (I’ve only yesterday realised that the Climate Emergency will never be properly priced into the markets)
Anyway, just 100% agreeing: AGI let alone ASI is not happening, and most likely the destruction of our civilisation (first by war, then by natural disaster) will likely preceed it, especially if we were hoping to roll it out in a responsible and regulated manner.