this post was submitted on 15 Jun 2024
35 points (60.4% liked)

Technology

59698 readers
2795 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 13 points 5 months ago* (last edited 5 months ago) (2 children)

turing test is designed to see if an AI can pass for human in a conversation.

I'm pretty sure that I could ask a human that question in a normal conversation.

The idea of the Turing test was to have a way of telling humans and computers apart. It is NOT meant for putting some kind of 'certified' badge on that computer, and ...

That's not what LLMs are for.

...and you can't cry 'foul' if I decide to use a question for which your computer was not programmed :-)

[–] [email protected] 4 points 5 months ago* (last edited 5 months ago) (1 children)

In a normal conversation sure.

In this kind Turing tests you may be disqualified as a jury for asking that question.

Good science demands controlled areas and defined goals. Everyone can organize a homebrew touring tests but there also real proper ones with fixed response times, lengths.

Some touring tests may even have a human pick the best of 5 to provide to the jury. There are so many possible variations depending on test criteria.

[–] [email protected] 0 points 5 months ago* (last edited 5 months ago) (1 children)

you may be disqualified as a jury for asking that question.

You want to read again about the scientific basics of the Turing test (hint: it is not a tennis match)

[–] [email protected] 0 points 5 months ago

There is no competition in science (or at least there shouldn't be). You are subjectively disqualified from judging llm's if you draw your conclusions on an obvious trap which you yourself have stated is beyond the scope of what it was programmed to do.

[–] [email protected] -2 points 5 months ago

It wasn't programmed for any questions. It was trained hehe