7
Will AI R&D Automation Cause a Software Intelligence Explosion? | Forethought
www.forethought.orgAI companies are increasingly using AI systems to accelerate AI research and development. Today’s AI systems help researchers write code, analyze research papers, and generate training data. Future systems could be significantly more capable – potentially automating the entire AI development cycle from formulating research questions and designing experiments to implementing, testing, and refining new AI systems. We argue that such systems could trigger a runaway feedback loop in which they quickly develop more advanced AI, which itself speeds up the development of even more advanced AI, resulting in extremely fast AI progress, even without the need for additional computer chips. Empirical evidence on the rate at which AI research efforts improve AI algorithms suggests that this positive feedback loop could overcome diminishing returns to continued AI research efforts. We evaluate two additional bottlenecks to rapid progress: training AI systems from scratch takes months, and improving AI algorithms often requires computationally expensive experiments. However, we find that there are possible workarounds that could enable a runaway feedback loop nonetheless.
Same here, been watching and testing closely from day one, and the AI hate is certainly understandable, but it is a new tool in the toolbox, and once you learn how to use it correctly and understand it’s limitations (e.g. you wouldn’t use a hammer to build a 50 meter bridge span) it can provide quite a bit of leverage, which saves you time and let’s you spend more time scrolling on Lemmy and writing comments like these.
The AI hype, particularly in the financial markets is really overbought IMO, and that’s the bubble that is bursting, egged on by the tariffs and general geopolitical uncertainty. (I’ve only yesterday realised that the Climate Emergency will never be properly priced into the markets)
Anyway, just 100% agreeing: AGI let alone ASI is not happening, and most likely the destruction of our civilisation (first by war, then by natural disaster) will likely preceed it, especially if we were hoping to roll it out in a responsible and regulated manner.