The shift from scaling up the pre-training compute of AI systems to scaling up their inference compute may have profound effects on AI governance. The nature of these effects depends crucially on whether this new inference compute will primarily be used during external deployment or as part of a mor
Yes, I think that is what the problem is here. Some people used to have the idea that more scaling would be enough for reasoning to appear, but that hasn’t happened.
Yeah, and the problem is also the expectation. They don’t want to say the product is done, it’s the best it can do because it hurts their shares, money source.
the idea that more scaling would be enough for reasoning to appear
That’s kinda like saying that with bigger and more boilers you can eventually make a steam engine fly. To be fair, somebody eventually flew a steam powered plane but it was never a success story.
Yes, I think that is what the problem is here. Some people used to have the idea that more scaling would be enough for reasoning to appear, but that hasn’t happened.
Yeah, and the problem is also the expectation. They don’t want to say the product is done, it’s the best it can do because it hurts their shares, money source.
That’s kinda like saying that with bigger and more boilers you can eventually make a steam engine fly. To be fair, somebody eventually flew a steam powered plane but it was never a success story.