this post was submitted on 03 Nov 2024
393 points (98.0% liked)

Open Source

31710 readers
96 users here now

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 17 points 1 month ago* (last edited 1 month ago) (1 children)

This is a really great use of LLM! Seriously great job! Once it's fully self-hostable (including the LLM model), I will absolutely find it space on the home server. Maybe using Rupeshs fastdcpu as the model and generation backend could work. I don't remember what his license is, though.

Edit: added link.

[โ€“] [email protected] 10 points 1 month ago

Thanks! I'm already eyeing ollama for this.