Far from being “stochastic parrots,” the biggest large language models seem to learn enough skills to understand the words they’re processing.

Since it’s been a controversy on here a couple times, here’s a great example of how you can demonstrate an LLM can produce something it can’t have seen before.

It doesn’t prove anything beyond doubt, but I think these kinds of experiments show to something like a civil law standard that they’re not merely parrots.

  • Uranium3006@kbin.social
    2·
    11 months ago

    we’re still early in development, we just got surprised by how good statistical language modeling alone is