555 drivers have given me a couple issues on my main PC, I've heard of some issues with newer cards but I figure its just a matter of time before better drivers. I haven't had to touch pci passthroughs yet and I was unsure if theres more a challenge on server hardware with Nvidia, but it sounds like I'll be happy to have CUDA
7toed
joined 1 day ago
Xeon E5-2640 unfortunately does not, though still an upgrade of what I have now. Stream limit seems entirely configurable, so that will be just a matter of stress testing.
Won't lie I always forget about all the new CPU hardware acceleration after using decade old hardware for so long 😅
I didn't even realize CUDA had a weight on LLMs, thank you!
The writing really was on the wall, unfortunately
Minimum wage who?
I had an R5 1600x basically since it released, and I appreciate the socket lasted so long. I might as well go full AMD at this point, you've convinced me