this post was submitted on 05 Jan 2024
136 points (95.3% liked)
Technology
59217 readers
2773 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I'm afraid that if AI ends up being just a fad, Mozilla won't be able to recover from this bet.
I don't think AI will be a fad in the same way blockchain/crypto-currency was. I certainly think there's somewhat of a hype bubble surrounding AI, though - it's the hot, new buzzword that a lot of companies are mentioning to bring investors on board. "We're planning to use some kind of AI in some way in the future (but we don't know how yet). Make cheques out to ________ please"
I do think AI does have actual, practical uses, though, unlike blockchain which always came off as a "solution looking for a problem". Like, I'm a fairly normal person and I've found good uses for AI already in asking it various questions where it gives better answers than search engines, in writing code for me (I can't write code myself), etc. Whereas I've never touched anything to do with crypto.
AI feels like a space that will continue to grow for years, and that will be implemented into more and more parts of society. The hype will die down somewhat, but I don't see AI going away.
The thing is, AI has been around for a really long time and has lots of established use-cases. Unfortunately, none of them are to do with generative language/image models. AI is mainly used for classifying data as part of data science. But data science is extremely unsexy to the average person, so for them AI has become synonymous with the ChatGPTs and DALLEs of the world.
Don't worry, once the hype fades, we can start calling LLMs "machine learning" again
deleted
Yeah, so far we've had discriminative AI (takes complex input, gives simple output).
Now we have generative AI (takes simple input, gives complex output).
I imagine, the discussion above is about generative AI...
I'd caution against using it for these things due to its tendency to make stuff up. I've tried using ChatGPT for both, but in my experience if I can't find something on google myself, ChatGPT will claim to know the answer but give me something that just isn't true. For coding it can do basic things, but if I wanna use a library or some other more granular task it'll do something like make up a function call that doesn't exist. The worst part is that it looks right, so I used to waste time trying to figure out why it doesn't work for me, when it turns out it doesn't work for anybody. For factual information, I had to correct a friend who gave me fake stats on airline reliability to help me make a flight choice - he got them from GPT 4 and while the numbers looked right, they deviated from other info. In general you never want to trust any specific numbers from LLMs because they're trained to look right rather than to actually be right.
For me LLMs have proven most useful for things like brainstorming or coming up with an image I can use for illustration purposes. Because those things don't need to be exactly right.
I agree completely. I think AI can be a valuable tool if you use it correctly, but it requires you to be able to prompt it properly and to be able to use its output in the right way - and knowing what it's good at and what it's not. Like you said, for things like brainstorming or looking for inspiration, it's great. And while its artistic output is very derivative - both because it's literally derived from all the art it's been trained on and simply because there's enough other AI art out there that it doesn't really have a unique "voice" most of the time - you could easily use it as a foundation to create your own art.
To expand on my asking it questions: the kind of questions I find it useful for are ones like "what are some reasons why people may do x?" or "what are some of the differences between y and z?". Or an actual question I asked ChatGPT a couple of months ago based on a conversation I'd been having with a few people: "what is an example of a font I could use that looks somewhat professional but that would make readers feel slightly uncomfortable?" (After a little back and forth, it ended up suggesting a perfect font.)
Basically, it's good for divergent questions, evaluative questions, inferent questions, etc. - open-ended questions - where you can either use its response to simulate asking a variety of people (or to save yourself from looking through old AskReddit and Quora posts...) or just to give you different ideas to consider, and it's good for suggestions. And then, of course, you decide which answers are useful/appropriate. I definitely wouldn't take anything "factual" it says as correct, although it can be good for giving you additional things to look into.
As for writing code: I've only used it for simple-ish scripts so far. I can't write code, but I'm just about knowledgeable enough to read code to see what it's doing, and I can make my own basic edits. I'm perfectly okay at following the logic of most code, it's just that I don't know the syntax. So I'm able to explain to ChatGPT exactly what I want my code to do, how it should work, etc, and it can write it for me. I've had some issues, but I've (so far) always been able to troubleshoot and eventually find a solution to them. I'm aware that if want to do anything more complex then I'll need to expand my coding knowledge, though! But so far, I've been able to use it to write scripts that are already beyond my own personal coding capabilities which I think is impressive.
I generally see LLMs as similar to predictive text or Google searches, in that they're a tool where the user needs to:
And just like how people having access to predictive text or Google doesn't make everyone's spelling/grammar/punctuation/sentence structure perfect or make everyone really knowledgeable, AIs/LLMs aren't going to magically make everyone good at everything either. But if people use them correctly, they can absolutely enhance that person's own output (be it their productivity, their creativity, their presentation or something else).
If it was a fad then why does the crypto currency simply doesn't die? Because I'm waiting on that for some time and nothing really happens.
I'd see 2 reasons:
But to put it simply - they don't die because they don't have to. There is no single company that would pull the plug. By it's design, they can coexist in our world and no one can stop it, doesn't matter if people use it or not
It's like a torrent with millions of seeders. As long as there is at least one seeder, the torrent will exist even if the files it contains aren't really useful
deleted
It's not. It's massively expensive though. There's money pouring into it because it's the next big thing. Eventually, the companies that can afford to consistently power a massive LLM learning server farm will be the ones to keep going, the rest will flounder, get acquired, or disappear. Mozilla isn't a big enough fish and won't get acquired. AI is not a fad, but it's not a sustainable business model for a company like Mozilla so I hope all their eggs aren't going in that basket.
Hell I think there's a solid argument to be made that it's not even a sustainable model for the biggest players. As it stands they're offering remarkably little functionality for how much it costs them. On the other hand, mozillas work in this space up until now has largely been on bringing previously unimaginable functionality to locally hosted open source models and datasets. And that does look to be a sustainable business model.
I was very sceptical towards the recent hypes (space exploration, cryptocurencies, self driving cars, ...) which turned out to be fads but this time ... this time I'm going to guess it isn't going to be a fad. Well it depends what we imagine by "AI" - will you have a robot pal like in movie I Robot or AI Artificial Intelligence? Probably not. Will AI predictions and learning be put into majority of programms and quite clever AI voice-assistants will appear like in movie Her? Yeah, I guess this could happen. My main reasons are: