61
this post was submitted on 15 Jul 2024
61 points (96.9% liked)
Technology
59424 readers
2921 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Microsoft CTO Kevin Scott is of course not a reliable source due to conflict of interest and his position in the US corporate world.
If anything, the fact that he is doing damage control PR around "LLM scaling laws" suggests something is amiss. Let's see how things develop.
I believe this sums it up.
Yeah. There's a very narrow corner that demands huge models, and that's use cases where there's no room for mistakes. That space is exciting, but also deeply bogged down in uncertainty, due both to laws and as-yet-undelivered, but 100% certainly coming-soon, law-creating-disasters.
Everywhere else, I suspect we've seen as good as we're going to get, from current generation AI.
Tech firm CEOs know this too, but there's not much interesting on the table to "bet the farm" on to court "swing for the fences" investors (gullible suckers) right now.
While I agree about the conflict of interest, I would largely say the same thing despite no such conflict of interest. However I see intelligence as a modular and many dimensional concept. If it scales as anticipated, it will still need to be organized into different forms of informational or computational flow for anything resembling an actively intelligent system.
On that note, the recent developments with active inference like RXinfer are astonishing given the current level of attention being paid. Seeing how llms are being treated, I'm almost glad it's not being absorbed into the hype and hate cycle.