Technology

59030 readers

3070 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

[email protected]

105

1-bit LLMs Could Solve AI’s Energy Demands (spectrum.ieee.org)

submitted 5 months ago by [email protected] to c/[email protected]

36 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 4 points 5 months ago (2 children)

The problem is that using those tools no matter how energy efficient will add to the total amount of energy humans use, because even if an AI generates an image faster than a human could, the human still needs 100W constantly.

This doesn't mean, that we shouldn't make it more efficient but let's be honest, more energy efficient AI just means that we would use even more AI everywhere.

[–] [email protected] 4 points 5 months ago* (last edited 5 months ago) (1 children)

Solution: remove human

That’s what a lot of news sites are doing, getting rid of large parts of the employees and having the remaining do the same work with LLM. If you burn the no longer needed employees as an alternative heating solution your energy usage drops effectively to zero

[–] [email protected] 1 points 5 months ago

True, but It's still not what I meant unless they kill those humans. The employees that did that work before still need the 100W. It might be that they can now do something else (or just be unemployed) but the net energy usage is not going down.

[–] [email protected] 2 points 5 months ago (1 children)

But speaking of efficiency, a human can do more useful tasks while AI is crunching numbers. But that is very subjective.

[–] [email protected] 2 points 5 months ago* (last edited 5 months ago) (1 children)

It depends what you mean by useful. Most humans are (at least at the moment) more versatile than even the most advanced AI we have. But you have to keep in mind that there are jobs with pretty mundane tasks where you don't really need the intelligence and versatility of a human.

[–] [email protected] 1 points 5 months ago

Thats what I meant, keep the tasks separated, and let both what they do better than the other half.