this post was submitted on 24 Nov 2023
109 points (76.3% liked)

Technology

59322 readers
4980 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

OpenAI was working on advanced model so powerful it alarmed staff::Reports say new model Q* fuelled safety fears, with workers airing their concerns to the board before CEO Sam Altman’s sacking

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 51 points 11 months ago (2 children)

There's a huge discrepency between the scary warnings about Q* calling it the lead-up to artificial superintelligence, and the actual discussion of the capabilities of Q* (it is good-enough at logic to solve some math problems).

My theory: the actual capabilities of Q* are perfectly nice and useful and unfrightening... but somebody pointed out the obvious: Q* can write code.

Either

  1. "Q* is gonna take my job!"

  2. "As we enhance Q*, it's going to get better at writing code... and we'll use Q* to write our AI code. This thing might not be our hypothetical digital God, but it might make it."

[–] [email protected] 30 points 11 months ago (4 children)

Did they really have to name it Q?

[–] [email protected] 9 points 11 months ago

It's going to create a super intelligent AI that's more irritating than anything else.

[–] [email protected] 5 points 11 months ago (1 children)

It's possible it's related to the Q* function from Q-learning, a strategy used in deep reinforcement learning!

[–] [email protected] 2 points 11 months ago (1 children)

.... or this is the origin of the Q and we're all fucked. I find my hypothesis much more plausible.

[–] [email protected] 1 points 11 months ago

plausible: check

testable: TBD

falsifiable: TBD

still, 1 out of 3. not bad!

[–] [email protected] 5 points 11 months ago

It's apparently Q* (pronounced Q star).

[–] [email protected] 3 points 11 months ago

At least they didn't name it AM?

[–] [email protected] 14 points 11 months ago (1 children)

Nah. Programming is... really hard to automate, and machine learning more so. The actual programming for it is pretty straightforward, but to make anything useful you need to get training data, clean it, and design a structure, which is much too general for an LLM.

[–] [email protected] 2 points 11 months ago (2 children)

Programming is like 10% writing code and 90% managing client expectations in my small experience.

[–] [email protected] 1 points 11 months ago (1 children)

Programming is 10% writing code, 80% being up at 3 in the morning wondering whY THE FUCKING CODE WON'T RUN CORRECTLY (it was a typo that you missed despite looking at it over 10 times), and 10% managing expectations

[–] [email protected] 2 points 11 months ago* (last edited 11 months ago) (1 children)

Typos in programming aren't really a thing, unless you're using the shittiest tools possible.

[–] [email protected] 1 points 11 months ago

Typos are very much a problem in programming. Variables can be set to the wrong value without the programmer noticing, you can call the wrong method (example RotateZ instead of RotateX), and in more advanced programming such as Java/C# reflection the IDE can't correct you.

[–] [email protected] 1 points 11 months ago

But a lot of the crap you have to do only exists because projects are large enough to require multiple separate teams, so you get all the overhead of communication between the teams, etc.

If the task gets simple enough that a single person can manage it, a lot of the coordination overhead will disappear too.

In the end though, people may find out that the entire product, that they are trying to develop using automation, is no longer relevant anyway.