this post was submitted on 20 Feb 2024
143 points (94.4% liked)

Selfhosted

40218 readers
1060 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS
 

It looks like !buildapc community isn't super active so I apologize for posting here. Mods, let me know if I should post there instead.

I built my first PC when I was I think 10-11 years old. Built my next PC after that and then sort of moved toward pre-made HP/Dell/etc. My last PC's mobo just gave out and I'm looking to replace the whole thing. I've read over the last few years that prefabs from HP/Dell/etc. have gone to shit and don't really work like they used to. Since I'm looking to expand comfortably, I've been thinking of giving building my own again.

I remember when I was a young lad, that there were two big pain points when putting the rig together: motherboard alignment with the case (I shorted two mobos by having it touch the bare metal of the grounded case; not sure how that happened but it did) and CPU pin alignment so you don't bend any pins when inserting into the socket.

Since it's been several decades since my last build, what are some things I should be aware of? Things I should avoid?

For example, I only recently learned what M.2 SSD are. My desktop has (had) SATA 3.5" drives, only one of which is an SSD.

I'll admit I am a bit overwhelmed by some of my choices. I've spent some time on pcpartpicker and feel very overwhelmed by some of the options. Most of my time is spent in code development (primarily containers and node). I am planning on installing Linux (Ubuntu, most likely) and I am hoping to tinker with some AI models, something I haven't been able to do with my now broken desktop due to it's age. For ML/AI, I know I'll need some sort of GPU, knowing only that NVIDIA cards require closed-source drivers. While I fully support FOSS, I'm not a OSS purist and fully accept that using a closed source drivers for linux may not be avoidable. Happy to take recommendations on GPUs!

Since I also host a myriad of self hosted apps on my desktop, I know I'll need to beef up my RAM (I usually go the max or at least plan for the max).

My main requirements:

  • Intel i7 processor (I've tried i5s and they can't keep up with what I code; I know i9s are the latest hotness but don't think the price is worth it; I've also tried AMD processors before and had terrible luck. I'm willing to try them again but I'd need a GOOD recommendation)
  • At least 3 SATA ports so that I can carry my drives over
  • At least one M.2 port (I cannibalized a laptop I recycled recently and grabbed the 1TB M.2 card)
  • On-board Ethernet/NIC (on-board wifi/bluetooth not required, but won't complain if they have them)
  • Support at least 32 GB of RAM
  • GPU that can support some sort of ML/AI with DisplayPort (preferred)

Nice to haves:

  • MoBo with front USB 3 ports but will accept USB 2 (C vs A doesn't matter)
  • On-board sound (I typically use headphones or bluetooth headset so I don't need anything fancy. I mostly listen to music when I code and occasionally do video calls.)

I threw together this list: https://pcpartpicker.com/list/n6wVRK

It didn't matter to me if it was in stock; just wanted a place to start. Advice is very much appreciated!

EDIT: WOW!! I am shocked and humbled by the great advice I've gotten here. And you've given me a boost in confidence in doing this myself. Thank you all and I'll keep replying as I can.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 7 points 9 months ago (4 children)

I for one would not purchase any Intel hardware as long as AMD is around. Not that they're bad or anything, but AMD gives me much Kore "bang for the buck". To future proof your rig, I strongly suggest you go with the latest socket (be it Intel or AMD, doesn't matter) and make sure you get DDR5 RAM. PCI Gen 4, and then have at it.

Getting an 80 Plus Gold power supply is always nice too.

And then there's the cooling. I see you went with a radiator and fan, but I strongly suggest getting some type of liquid cooling. The prices are not that bad anymore (unlike about 10 years ago, which was insane).

As for the board, you'll get all kinds of different suggestions. Some people swear by Asus, I'd rather go with Gigabyte (love the Aorus line), so it'll come down to brand trust at the end of the day.

As for the card, I hear a lot of crap given to Nvidia about being closed source, and I sort of agree that's messed up, but ATI cards (while pretty good) are always a step behind Nvidia. Plus, most distros have them working out of the box.

It can be intimidating after so many years, but its way simpler than it was back then.

Good luck man, you got this, there's nothing to fear but fear itself.

[–] [email protected] 3 points 9 months ago

I for one would not purchase any Intel hardware as long as AMD is around. Not that they’re bad or anything, but AMD gives me much Kore “bang for the buck”.

If you have a processor line in mind, let me know. Happy to give them another look, given my experience with AMD is 30 some years old.

And then there’s the cooling. I see you went with a radiator and fan, but I strongly suggest getting some type of liquid cooling. The prices are not that bad anymore (unlike about 10 years ago, which was insane).

I'm not tied to the cooling solution I picked. I just picked something that looked affordable and did what I wanted. I'd love to do liquid cooling so long as it isn't a pain. I helped my friend back in high school do liquid cooling and it was a proper mess. We came close to shorting his entire rig.

As for the board, you’ll get all kinds of different suggestions. Some people swear by Asus, I’d rather go with Gigabyte (love the Aorus line), so it’ll come down to brand trust at the end of the day.

I have zero brand loyalty here. The boards I'm looking at right now all have embedded wifi with the annoying antenna...I really want bluetooth embedded so it seems like I'll have to have wifi but just not use it.

[–] [email protected] 3 points 9 months ago (1 children)

ATI cards (while pretty good) are always a step behind Nvidia.

Ok, you mean AMD. They bought ATI like 20 years ago now and that branding is long dead.

And AMD cards are hardly "a step behind" Nvidia. This is only true if you buy the 24GB top card of the series. Otherwise you'll get comparable performance from AMD at a better value.

Plus, most distros have them working out of the box.

Unless you're running a kernel <6.x then every distro will support AMD cards. And even then, you could always install the proprietary blobs from AMD and get full support on any distro. The kernel version only matters if you want to use the FOSS kernel drivers for the cards.

[–] [email protected] 1 points 9 months ago (1 children)

I agree that I could be wrong on the comparison. Maybe they are not that far behind, but guaranteed not at the same level when comparing apples to apples. I wish that wasn't the case, but it still is.

[–] [email protected] 2 points 9 months ago (1 children)

when comparing apples to apples.

But this isn't really easy to do, and impossible in some cases.

Historically, Nvidia has done better than AMD in gaming performance because there's just so much game specific optimizations in the Nvidia drivers, whereas AMD didn't.

On the other hand, AMD historically had better raw performance in scientific calculation tasks (pre-deeplearning trend).

Nvidia has had a stranglehold on the AI market entirely because of their CUDA dominance. But hopefully AMD has finally bucked that tend with their new ROCm release that is a drop-in replacement for CUDA (meaning you can just run CUDA compiled applications on AMD with no changes).

Also, AMD's new MI300X AI processor is (supposedly) wiping the floor with Nvidia's H100 cards. I say "supposedly" because I don't have $50k USD to buy both cards and compare myself.

[–] [email protected] 2 points 9 months ago

I have absolutely no counter for you on this one, as I'm jot aware of the highest level stuff between manufacturers. And it makes sense. Nvidia has been the goto manufacturer for gaming and developers usually improve their code based on what's needed to run the best possible on Nvidia hardware. I'll research Kore on this when I have a chance, this seems to he a very interesting topic. Thank you for pointing this out.

[–] [email protected] 3 points 9 months ago (1 children)

May I ask why water cooling? Its just more loud and more expensive afaik, they just look awesome.

Decent air coolers are cheap, silent and easier to install. When I was overclocking i5 9600k temperature was not an issue at all. Is it different with CPUs today?

[–] [email protected] 1 points 9 months ago

Simple, the difference in cost is negligible in terms of keeping the CPU at way lower temperatures, extending the life of the CPU and better avoiding throttling. And they are not louder than a regular fan with heatsink, since the fans spin at lower RPMs most of the time because they don't need to increase it since the CPU is already running cooler. And if you add a high end GPU, that's way louder and will drown the noise of any other fan in the rig when it kicks in.

[–] [email protected] -1 points 9 months ago (1 children)

AMD graphics are terrible at any kind of media encoding or decoding. That probably won't affect most people but it can be a problem for self hosting.

I also find that Intel CPUs are much easier to find than AMD when it comes to used hardware.

[–] [email protected] 2 points 9 months ago (1 children)

They are not terrible, they just don't hold a candle to a Nvidia card of the same tier. And the Op is buying new not old. Not once did I say anything bad about any brand, like the Op, I'm not married to any of them, and only speak out of personal experience. I dont make money from them, they make money out of me.

[–] [email protected] 2 points 9 months ago* (last edited 9 months ago) (1 children)

I take it your taking about Intel? AMD GPUs tend to be a pretty good deal as there are tons of them used on eBay.

[–] [email protected] 1 points 9 months ago (1 children)

Maybe, I've never bought PC parts on eBay, or used for that matter. Too risky from my perspective. And yes, I'm talking about AMD GPUs. They are very good, but still behind Nvidia in every aspect.

[–] [email protected] 4 points 9 months ago (1 children)

Except for Linux support. Nvidia is awful on Linux compared to Intel (best) and AMD (solid).

[–] [email protected] 1 points 9 months ago (2 children)

Name one example in which an Nvidia card from the same gen of an AMD GPU performed equal or worse, regardless of the driver. Why do you think that even manufacturers focused on hardware for Linux choose Nvidia over AMD GPUs? Cost? Unlikely, since Nvidia is usually more expensive.

[–] [email protected] 5 points 9 months ago (1 children)

Cost wise I believe they are close. For instance, according to Toms Hardware a RTX 3070 is the same cost and performance as a 6700XT.

https://www.tomshardware.com/features/nvidia-geforce-rtx-3070-vs-amd-radeon-rx-6700-xt

What your saying doesn't align with what I've seen and read online. Admittedly I'm not a GPU expert so maybe I'm just out of touch. Anyway I wouldn't by Nvidia because the free software drivers are still being worked on. We are seeing a lot of progress with NVK but its nowhere near complete.

To be honest with you I mostly use Intel integrated graphics which works very well and can even do some light gaming.

[–] [email protected] 1 points 9 months ago

By all means, unless I wanted to play some AAA games, I wouldn't get any dedicated GPU. AMD and Intel's integrated cards are more than adequate for most usecases of daily computer use, and work great in any Linux distros. For example, my work PC runs on a Ryzen 7 7735HS with the integrated 680m iGPU. I usually have 3 or 4 workspaces open at once, each running a different browser (Vivaldi, Brave, Librewolf and Mullvad) with anywhere between 4 to 20+ tabs open on each, OnlyOffice on one workspace and LibreOffuce Calc on another one, a Flatpak of Teams for work, freetube, and a bunch of different dashboards, and an instance of Sins of a Solar Empire (I play while I work). I still have to see my CPU go past 20%. Now, for more powerful needs, I have a laptop running on an Intel 11th gen I7 with a 3070TI Nvidia card. Great laptop (System76 Gazelle16), but I barely ever use it, since I don't really need that much power anyways. The days of forcibly having a dedicated GPU to avoid CPU lag on daily use computing are long gone. Unless you're going to push things to the limit with heavy video rendering, AAA gaming or AI, any integrated GPU will suffice.

[–] [email protected] 2 points 9 months ago (1 children)

Some value software freedom more than performance, and the open source Nouveau Nvidia driver isn't quite there yet on performance.

[–] [email protected] 1 points 9 months ago

I absolutely agree with your statement. However, the point in his questions is performance, because of his work with AI. I'd rather Nvidia opensourced their drivers (which is being worked on already, and has been for a while), I think that probably every Linux user wants this to happen already, but that does not change the fact that, even if proprietary drivers are needed for the vest performance, Nvidia is still ahead of anything else out there. But like you, I'm not a fan of having proprietary crap on my devices.