Somebody please explain me in very simple words why do I need an AI capable chip in my personal computer. And under Linux, for the most.
this post was submitted on 24 Nov 2024
25 points (93.1% liked)
Linux
8178 readers
408 users here now
Welcome to c/linux!
Welcome to our thriving Linux community! Whether you're a seasoned Linux enthusiast or just starting your journey, we're excited to have you here. Explore, learn, and collaborate with like-minded individuals who share a passion for open-source software and the endless possibilities it offers. Together, let's dive into the world of Linux and embrace the power of freedom, customization, and innovation. Enjoy your stay and feel free to join the vibrant discussions that await you!
Rules:
-
Stay on topic: Posts and discussions should be related to Linux, open source software, and related technologies.
-
Be respectful: Treat fellow community members with respect and courtesy.
-
Quality over quantity: Share informative and thought-provoking content.
-
No spam or self-promotion: Avoid excessive self-promotion or spamming.
-
No NSFW adult content
-
Follow general lemmy guidelines.
founded 1 year ago
MODERATORS
IKR, am fine with using cpu and gpu to run llms locally (even tho am trying to avoid using llms), But npus SRSLY
Offline translation is pretty great. Some image editing tools are pretty great. Games may utilise them in the future. Offline image recognition for searching for images (e.g. "show me pics of grandma"), etc.
It's not particularly widely used now, but the same was true for hardware video encode/decode, hardware accelerated encryption/decryption, etc.
Quick local translate, image upscale, ai fill tool. Just throwing ideas out.
image processing is pretty intense and would likely be handled by the GPU. Efficient embedded NN accelerators like this are meant to be used for more passive things, like noise cancelation or like you mentioned, translation.
I don't know the architecture of AI accelerator in Ryzen processors but I do know a fair amount of image deblurring and denoising tools run on the neural engine on Apple Silicon. The neural engine is good enough for a lot of tasks, provided that your model only uses relatively simple operators and doesn't need full precision.
This isnt for you, nor for me. I don't need an AI-capable chip, I could just use my GPU if for some reason I wanted to run a local transformer model.
Do any desktop models have this hardware?