• j4k3@lemmy.world
    link
    fedilink
    English
    arrow-up
    13
    ·
    19 days ago

    I would create an entire ecosystem I control an call it something like Meta, reddit, or Fediverse

      • foggy@lemmy.world
        link
        fedilink
        arrow-up
        4
        ·
        edit-2
        19 days ago

        Sure maybe a really beastly one, but all the available models right now have relatively poor context windows. When assisting in complex setups, they let go of information frequently to keep the dialogue flowing. Suddenly it’ll be giving you code snippets like

        BASE_URL = [your base URL]

        even when it should know my base URL.

        So like, yeah, openai could probably show an AI create a fediverse instance. It’d take as much electricity as Manhattan uses in a day. But I doubt even OpenAIs new pro o1 model could achieve this, currently.

        In fact, the context window was a significant weakness in the o1-preview. It was even worse than 4o.