Models that are more reliable and less energy-intensive could help us to better prepare for extreme weather.
  • LughMAEnglish
    2·
    4 months ago

    I really suspect this is how the plateau of productivity will look for machine learning.

    It seems finding more data to scale up LLMs is a bottleneck too.

    • CanadaPlus@lemmy.sdf.orgOPEnglish
      2·
      4 months ago

      Yeah, that’s part of why I think that. There’s also just the alignment issue that no amount of training will fix. At the end of the day, an LLM is a very smart internet simulator, you treat it like something else at your peril, and training it to be something else is very much an open problem.