DarkThoughts

Yes, databases (saved on a hard drive). SillyTavern has Smart Context but that seems not that easy to install so I have no idea how well that actually works in practice yet.

I honestly have no idea what you're referring to now. I never asked for any ideas.

I was being sarcastic. If you pay for a prostitute you might as well pay for an AI service such as novelai.

And I replied to that comment, without any mouth foaming.

If they're local they'd be basically useless due to a lack of computing power and potential lack of indexing for a search engine chatbot, so I doubt it. It would also have to be so polished that it wouldn't require further user knowledge / input, and that's just not a thing with any local LLM I've come across. Mozilla can gladly prove me wrong though. I certainly wouldn't mind if they generally can make the whole process of local LLMs easier and more viable.

Yes, but what would a local model do for you in this case? Chatbots in browsers are typically used as an alternative / more contextualized search engine. For that you need proper access to an index of search results. Most people will also not have enough computing power to make use of any complex chatbot / larger context sizes.

Yeah, I heard they're also very privacy friendly.

I don't know, I'm not a weeb.

All of those could be terrible to be honest, because AI is a data tracking vacuum. An AI adblocker or content filter sounds cool at first, but it would mean it reads and analyzes your data, just like the shit you do with chatbots too. Reading your mails? That's basically what Google does for years with gmail, that's why they have such a good spam filter. I agree that a chatbot would be kinda useless though, even if privacy friendly, which in of itself would be great but I just don't see the use. This could simply be outsourced to a website.

There's no way it would be running locally.

The answers to both of those things depends very heavily on the details. I think focusing on their main products is a good thing, but adding AI sounds like one of those likely terrible decisions. We definitely need privacy friendly & open source based AI though, in all areas, so I hope this is Mozilla pushing for something sensible here.

You need a little gpu server farm for proper models & context sizes though. Single consumer gpus don't have enough vram for that.