this post was submitted on 27 Jul 2024
64 points (100.0% liked)
Linux
47321 readers
682 users here now
From Wikipedia, the free encyclopedia
Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).
Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.
Rules
- Posts must be relevant to operating systems running the Linux kernel. GNU/Linux or otherwise.
- No misinformation
- No NSFW content
- No hate speech, bigotry, etc
Related Communities
Community icon by Alpár-Etele Méder, licensed under CC BY 3.0
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
CUDA hell remains. :(
AMD needs to get their ducks in a row. They already have the advantage of not being Nvidia
That's just because they release worse products.
If AMD had Nvidia's marketshare, they would be just as scummy as the business climate allows.
In fact, AMD piggybacks off of Nvidia's scumbaggery to charge more for their GPUs rather than engage in an actual price war.
Who would've thunk that big, for profit, tech companies don't care about us :T
It's all by design.
it's breaking down. Pytorch supports ROCm now.
ROCm is it's own hell (unless they finally put some resources into it in the past couple years)
They put in the absolute minimum amount of resources for it.
It's also littered with bugs as the ZLUDA project has noted
Yes, the CUDA is the only reason why I consider NVIDIA. I really hate this company but the AMD tech stack is really inferior.
I've heard this but don't really understand it... At a high level, what makes cuda so much better?
So is CUDA good or bad?
I keep reading it's hell, but the best. Apparently it's the single one reason why Nvidia is so big with AI, but it sucks.
What is it?
Both.
The good: CUDA is required for maximum performance and compatibility with machine learning (ML) frameworks and applications. It is a legitimate reason to choose Nvidia, and if you have an Nvidia card you will want to make sure you have CUDA acceleration working for any compatible ML workloads.
The bad: Getting CUDA to actually install and run correctly is a giant pain in the ass for anything but the absolute most basic use case. You will likely need to maintain multiple framework versions, because new ones are not backwards-compatible. You'll need to source custom versions of Python modules compiled against specific versions of CUDA, which opens a whole new circle of Dependency Hell. And you know how everyone and their dog publishes shit with Docker now? Yeah, have fun with that.
That said, AMD's equivalent (ROCm) is just as bad, and AMD is lagging about a full generation behind Nvidia in terms of ML performance.
The easy way is to just use OpenCL. But that's not going to give you the best performance, and it's not going to be compatible with everything out there.
almost sounds like god doesn't want us doing machine learning
I think this will change. Nvidia hired devs on Nouveau, NVK is coming along, etc
Last I checked, there is no evidence Nvidia has hired anyone to work on Nouveau.
https://www.phoronix.com/news/Ben-Skeggs-Joins-NVIDIA
Right, I'm well aware that that article is the reason why a bunch of people have been making the unsubstantiated claim that Nvidia has hired people to work on Nouveau.
Nvidia hired the former lead Nouveau maintainer and he contributed a bunch of patches a couple of months ago after they hired him. That was his first contribution since stepping down and I'm fairly certain it was his last because there's no way Phoronix would miss the opportunity to milk this some more if they could. He had said when stepping down that he was open to contributing every once in a while, so this wasn't very surprising either way. To be clear, it is not evidence that he or anyone else was hired by Nvidia to work on Nouveau. Otherwise, I'd like to ask what he's been doing since, because that was over three months ago.