• Immersive_Matthew@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    7
    arrow-down
    3
    ·
    8 months ago

    While the article makes a big deal about a lack of data and even hint at synthetic data as an option, the truth is synthetic data is already being used and is just as good apparently at training. Such a misinformation article designed to stir the AI haters especially the headline.

    • voidxOPMA
      link
      fedilink
      English
      arrow-up
      5
      ·
      8 months ago

      They seem to be experimenting with that for sure, but need to ensure quality of the model doesn’t degrade, as per source article:

      Anthropic’s chief scientist, Jared Kaplan, said some types of synthetic data can be helpful. Anthropic said it used “data we generate internally” to inform its latest versions of its Claude models. OpenAI also is exploring synthetic data generation, the spokeswoman said.