this post was submitted on 03 Nov 2024
386 points (98.5% liked)

Open Source

31035 readers
801 users here now

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 13 points 2 days ago (1 children)

Is there any interest in getting local models to run using this? I’d rather not use Gemini, and then all the data can reside locally (and not require a login).

I’d be happy to work on this, though I’m a python developer not a typescript one.

[–] [email protected] 6 points 2 days ago (1 children)

Yeah, good idea. It's possible to do that with WebLLM & Langchain. Once Langchain is integrated, it's kinda similar to the Python Version so should be do-able I think.

[–] [email protected] 2 points 2 days ago (1 children)

Ah interesting — again happy to help out if there’s anything I can contribute to. I can make a feature request on github if there’s interest.

[–] [email protected] 2 points 2 days ago

Please do :). I take any help I can get.