Technology

60129 readers

2740 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 2 years ago

MODERATORS

[email protected]

396

Sam Altman Says AI Using Too Much Energy, Will Require Breakthrough Energy Source (futurism.com)

submitted 11 months ago by [email protected] to c/[email protected]

239 comments fedilink hide all child comments

"There's no way to get there without a breakthrough," OpenAI CEO Sam Altman said, arguing that AI will soon need even more energy.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 7 points 11 months ago (1 children)

The models get more efficient and smaller very fast if you look just a year back. I bet we’ll run some small LLMs locally on our phones (I don’t really believe in the other form factors yet) sooner as we believe. I’d say prior 2030.

[–] [email protected] 5 points 11 months ago (1 children)

I can already locally host a pretty decent ai chatbot on my old M1 Macbook (llama v2 7B) which writes at the same speed I can read, its probably already possible with the top of the line phones.

[–] [email protected] 3 points 11 months ago* (last edited 11 months ago) (2 children)

Lol, "old M1 laptop" 3 to 4 years is not old, damn!

(I have running macbookpro5,3 (mid 2009) on Arch, lol)

But nice to hear that M1 (an thus theoretically even the iPad, if you are not talking about M1 pro / M1 max) can already run llamma v2 7B.

Have you tried the mistralAI already, should be a bit more powerful and a bit more efficient iirc. And it is Apache 2.0 licensed.

https://mistral.ai/news/announcing-mistral-7b/

[–] [email protected] 3 points 11 months ago

But nice to hear that M1 (a thus theoretically even the iPad, if you are not talking about M1 pro / M1 max) can already run llamma v2 7B.

An iPhone XR/XS can run Stable Diffusion, believe it or not.

[–] [email protected] 2 points 11 months ago* (last edited 11 months ago)

3 to 4 years is not old

Huh, nice. I got the macbook air secondhand so I thought it was older. Thanks for the suggestion, I'll try mistralAI next, perhaps on my phone as a test.