this post was submitted on 17 Mar 2024
127 points (90.4% liked)

Open Source

31122 readers
271 users here now

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 4 points 7 months ago (2 children)

So what exactly is this? Open-source ChatGPT-alternatives have existed before and alongside ChatGPT the entire time, in the form of downloading oogabooga or a different interface and downloading an open source model from Huggingface. They aren't competitive because users don't have terabytes of VRAM or AI accelerators.

[–] [email protected] 3 points 7 months ago* (last edited 7 months ago) (1 children)

Edit: spelling. The Facebook LLM is pretty decent and has a huge amount of tokens. You can install it locally and feed your own data into the model so it will become tailor made.

[–] [email protected] 5 points 7 months ago (2 children)

I think you mean tailor. As in, clothes fitted to you.

[–] [email protected] 1 points 7 months ago

Exactly, my auto carrot likes Taylor.

[–] [email protected] 0 points 7 months ago

It's basically a UI for downloading and running models. You don't need terabytes of VRAM to run most models though. A decent GPU and 16 gigs of RAM or so works fine.