this post was submitted on 23 Nov 2024
300 points (99.7% liked)

Technology

60112 readers
1818 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 2 years ago
MODERATORS
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
300
Microsoft’s controversial Recall scraper is finally entering public preview (arstechnica.com)
submitted 1 month ago by [email protected] to c/[email protected]
46 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 0 points 1 month ago (1 children)

I tried llama3.1:8b and it's absolutely horrible.

[–] [email protected] 1 points 1 month ago* (last edited 1 month ago)

You can use larger "open" models through free or dirt-cheap APIs though.

TBH local LLMs are still kinda "meh" unless you have a high vram GPU. I agree that 8b is kinda underwhelming, but the step up to like Qwen 14B is enormous.