this post was submitted on 20 Nov 2023
138 points (93.7% liked)
Technology
59292 readers
4160 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Mostly starting over code wise.
I’ve had to rebuild a thing or two in my day, and building it the second time is always faster, but still, you’ve got to write all the crap over again.
This will undoubtedly be way faster than doing a startup from scratch, but they’re literally starting from a position of having no code checked in at all.
That and re-training the models once the code is rewritten. Presumably MS doesn’t have access to the same training sets (they almost certainly have their own, but we don’t know the breadth or quality by comparison to OpenAIs data sets)
They don't need to start over. Have you been following the open source model progression the last 5-6 months? Those LLMs have made crazy progress in such a short span of time. They can easily take one of those existing models and improve upon them or at least borrow as much as needed. And I also find it hard to believe that Microsoft hasn't been secretly developing their own model(s) at all.
I agree that losing their original egg is definitely a setback, but for all we know this fresh start with Microsoft may allow them to try some new and better ideas they couldn't afford to do at ChatGPT due to the sunk investment costs they had in their original tool.
Anywho, time will tell!