Linux
From Wikipedia, the free encyclopedia
Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).
Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.
Rules
- Posts must be relevant to operating systems running the Linux kernel. GNU/Linux or otherwise.
- No misinformation
- No NSFW content
- No hate speech, bigotry, etc
Related Communities
Community icon by Alpár-Etele Méder, licensed under CC BY 3.0
KoboldAI has an "KoboldGPT" mode, which is for answering questions. You can try it at https://lite.koboldai.net/ or run it on your own.
Here's an example conversation I just had with it (emoji icons added):
🤖 Hello, I am KoboldGPT, your personal AI assistant. What would you like to know?
🧑 What is the name of the original version of the game Monopoly?
🤖 The original version of the game Monopoly is called "The Landlord's Game." It was created by Elizabeth Magie in the early 20th century. However, the most well-known version of Monopoly today is based on a variant called "Monopoly" that was designed by Charles Darrow in 1935.
🧑 Did "The Landlord's Game" have any purpose besides being a board game?
🤖 Yes, "The Landlord's Game" had a specific purpose beyond being a board game. Elizabeth Magie created it as a way to illustrate the negative aspects of concentrating land in private monopolies. She believed that it could be used as a tool for teaching economic concepts such as rent, taxes, and the distribution of wealth.
🧑 What economic ideology was associated with this game?
🤖 Elizabeth Magie was influenced by Henry George's philosophy of Georgism. Georgists believe that land should belong to all people equally, and that taxation should be based on the value of land rather than on income or production.
As others said you can host Koboldai on your own, and if you don't have a powerful GPU, anyone can use powerful llm models via the AI horde
i don't know a single thing about whatever these things your talking about are, but i just want to say, you're the first person i've ever seen suggest that edge isn't a joke.
There are quite a few of them out there. Just a few from my notes (in reverse chronological order)
- https://github.com/persimmon-ai-labs/adept-inference
- https://github.com/shellc/laozy
- https://github.com/imartinez/privateGPT
- https://github.com/Josh-XT/AGiXT
- https://github.com/tloen/alpaca-lora
The self-hosted AI/ML system has been here for a while. Granted, the vast majority of them require downloading pre-trained models before they can be used due to how much it costs to build a system of weights from scratch.
I sometimes wonder if it would be possible to build and train a truly open source model with BOINC or something. The last 30 years of history show that it's entirely feasible to build a massively distributed computing cluster, why not leverage this to build a model? I know how naive that sounds immediately after writing it, mostly because of the difficulty of getting a large enough training data set, which unfortunately has risk written all over it (read: people poisoning the model, ala Microsoft's experiment with Tay on birbsite some years back).
petals.dev It's basically bittorrent for AI. A public swarm for running and training LLMs.
Wao didn't know this one, impressive thx for sharing !
man -k
That's just garden-variety intelligence, nothing artificial about it.
OpenAssistant
I think it's far more likely that easier solutions to hosting your own LLM/ChatGPT/etc will be pushed, rather than someone (or a group of someones) offering and maintaining it - as you mentioned, that takes a lot of resources. Think about the issues that various Fediverse software has had in terms of keeping up with the load sometimes, and LLMs use way more than most Fediverse applications. Especially if you want it to be as snappy as the current ones already out there.
Chatbot arena ranks LLM, including some truly open source ones (apache license)
Regarding UI, maybe look here?
For images there are foss options that you can run locally, like stable diffusion which is so good that it rivals its proprietary counterparts.
But for text it's a horror, there are some you can try (see gpt4all), but in general chatgpt has no real competition; the foss options are currently very bad, and even the proprietary options from big corporations like bard or llama are pitiful.
but I can’t help but see the fact that there is no alternative to Bing GPT
Regarding this, there are other services that also use GPT for search, here a couple:
Maybe something like this? https://huggingface.co/ https://huggingface.co/chat/
The model seems to be based on the Llama model (but not only, there seem to be multiple models). Tho I didn't really look into it on how they get their database. It also has more hallucinations than chatgpt.
Huggingchat is pretty good. And the model is Open source. No need for a phone number in your account and not by a company whose name is hypocritical even.
"What's the date?"
I'm not able to provide you with the current date as I am a text-based AI language model and do not have access to real-time information. However, I can tell you the date based on my knowledge cutoff, which is December 2022. Please note that this information may not be up-to-date or accurate. Is there anything else I can help you with?
You won't get the date.
The date mentioned in the answer may also be an halucination from the bot, depending on the dataset.
And an answer to Bing chat / bard is pretty hard to do if something like this even exists, as the bot has to be able to search the Web.
Interesting. I was able to pull the date from https://www.perplexity.ai however
Because it's a search engine using gpt3. Nothing special/Foss about it. Or at least I don't see any Foss sources.
I heard about LocalAI, but I never tried it.
I've tried it, very practical. It's a drop in replacement for OpenAI APIs, so you can work with other tools that use their models and API as back end.
Bavarder is good. Works on Linux too
At work today, I just heard the term, "Federated Machine Learning" - where individual corporations keep their proprietary learning data, but make the models shareable. I wonder if something similar could be done with activitypub?
(Feel free to steal this idea if it's worth stealing)
This doesn't work when an important part of the process is making sure your data is actually good. If the data is proprietary, there is no way to make sure it is usable.
I installed Edge on Linux because it's fun watching Linux people get angry about it
You're a monster
I admire your trolling power