Futurology Today
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
☆ Yσɠƚԋσʂ ☆@lemmy.ml to Open Source@lemmy.mlEnglish ·
edit-2
9 months ago

LocalAI is the free, open source locally run drop-in replacement REST API for OpenAI

github.com

external-link
message-square
5
link
fedilink
  • cross-posted to:
  • technology@lemmygrad.ml
33
external-link

LocalAI is the free, open source locally run drop-in replacement REST API for OpenAI

github.com

☆ Yσɠƚԋσʂ ☆@lemmy.ml to Open Source@lemmy.mlEnglish ·
edit-2
9 months ago
message-square
5
link
fedilink
  • cross-posted to:
  • technology@lemmygrad.ml
GitHub - mudler/LocalAI: :robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference
github.com
external-link
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf,...
alert-triangle
You must log in or register to comment.
  • Eyck_of_denesle@lemmy.zip
    link
    fedilink
    arrow-up
    2
    ·
    9 months ago

    Looks nice. I just started using gpt4all. Will try this one too.

    • ☆ Yσɠƚԋσʂ ☆@lemmy.mlOP
      link
      fedilink
      arrow-up
      1
      ·
      9 months ago

      gpt4all has been my go to as well, this one’s neat cause it can do multimodal stuff

      • Eyck_of_denesle@lemmy.zip
        link
        fedilink
        arrow-up
        1
        ·
        9 months ago

        It’s 43 gb, do we have to download all of it?

        • ☆ Yσɠƚԋσʂ ☆@lemmy.mlOP
          link
          fedilink
          arrow-up
          1
          ·
          8 months ago

          I’m guessing it’s the models but not sure

  • stink@lemmygrad.ml
    link
    fedilink
    English
    arrow-up
    1
    ·
    9 months ago

    I can’t get it to run a gguf locally sadly D:

    I think I’m being stupid but it keeps downloading the pre-loaded models and not one I downloaded online

Open Source@lemmy.ml

opensource@lemmy.ml

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !opensource@lemmy.ml

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

  • Open Source Initiative
  • Free Software Foundation
  • Electronic Frontier Foundation
  • Software Freedom Conservancy
  • It’s FOSS
  • Android FOSS Apps Megathread

Rules

  • Posts must be relevant to the open source ideology
  • No NSFW content
  • No hate speech, bigotry, etc

Related Communities

  • !libre_culture@lemmy.ml
  • !libre_software@lemmy.ml
  • !libre_hardware@lemmy.ml
  • !linux@lemmy.ml
  • !technology@lemmy.ml

Community icon from opensource.org, but we are not affiliated with them.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 122 users / day
  • 1.8K users / week
  • 3.89K users / month
  • 10.9K users / 6 months
  • 19 local subscribers
  • 39.6K subscribers
  • 2.15K Posts
  • 32.8K Comments
  • Modlog
  • mods:
  • Evan@lemmy.ml
  • kevincox@lemmy.ml
  • CrypticCoffee@lemmy.ml
  • Lettuce eat lettuce@lemmy.ml
  • BE: 0.19.11
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code
  • join-lemmy.org