this post was submitted on 02 Dec 2023
158 points (85.3% liked)

Technology

59357 readers
6005 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago
MODERATORS
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
158
Bill Gates feels Generative AI has plateaued, says GPT-5 will not be any better (indianexpress.com)
submitted 11 months ago by [email protected] to c/[email protected]
77 comments fedilink hide all child comments
 

Bill Gates feels Generative AI has plateaued, says GPT-5 will not be any better::The billionaire philanthropist in an interview with German newspaper Handelsblatt, shared his thoughts on Artificial general intelligence, climate change, and the scope of AI in the future.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 2 points 11 months ago (1 children)

First, they do have senses. For example, many LLMs can "see" images. Second, they're actually pretty good at describing things. What they're really bad at is analysis and logic, which is not related to senses at all.

[–] [email protected] 1 points 11 months ago* (last edited 11 months ago) (1 children)

I'm not so convinced that logic is completely unrelated to the senses. How did you learn to count, add, and subtract mentally? You used your fingers. I don't know about you, but even though I don't count my fingers anymore I still tend to "visualize" math operations. Would I be capable of that if I were born blind? Maybe I'd figure out how to do the same thing in a different dimension of awareness, but I have no doubt that being able to conceptualize visually helps my own logic. As for more complicated math, I can't do that mentally either, I need a calculator and/or scratch paper. Maybe analogues to those can be implemented into the model? Maybe someone should just train a model on khan academy videos, and it'll pick this stuff up emergently? I'm not saying that the ability to visualize is the only roadblock though, I'm sure that improvements could be made to the models themselves, but I bet that it'll be key to human-like reasoning

[–] [email protected] 1 points 11 months ago

That's a good point.